2024-08-17T02:10:38.894 INFO:root:teuthology version: 1.2.0 2024-08-17T02:10:38.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:10:39.005 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858261 branch: wip-mchangir-mgr-volumes-print-thread-name-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} email: mchangir@redhat.com first_in_suite: false job_id: '7858261' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - filesystem is online with fewer MDS than max_mds - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: enable_coprs: - ceph/el9 flavor: default sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e owner: scheduled_mchangir@teuthology priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5995 sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e sleep_before_teardown: 0 suite: fs suite_branch: wip-mchangir-mgr-volumes-print-thread-name-quincy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e targets: smithi002.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHfI/U+AJOLfOkJH5H2FqzROc71NQDaHWDYazChVZxyltxpwBRcERg7tAKA5vvxpSjH3zLSFFZJkXP/j9DS5qwQ= smithi145.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAlgxbOa7uZs1KZGiZhLpLmblf0AG1KfQcGpguw9Dw/fha+ecBaGXuT2CocZNeScZY+JUT6t6rpSmbyVDTJrdtY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-17_01:02:08 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-17T02:10:39.005 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa; will attempt to use it 2024-08-17T02:10:39.005 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks 2024-08-17T02:10:39.006 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-17T02:10:39.007 INFO:teuthology.task.internal:Checking packages... 2024-08-17T02:10:39.029 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2577e8139c6b8786f9d6d6ea21b8da9244b9260e' 2024-08-17T02:10:39.029 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-17T02:10:39.029 INFO:teuthology.packaging:ref: None 2024-08-17T02:10:39.029 INFO:teuthology.packaging:tag: None 2024-08-17T02:10:39.029 INFO:teuthology.packaging:branch: wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:10:39.029 INFO:teuthology.packaging:sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:10:39.029 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:10:39.173 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1375.g2577e813 2024-08-17T02:10:39.175 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-17T02:10:39.182 INFO:teuthology.task.internal:no buildpackages task found 2024-08-17T02:10:39.182 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-17T02:10:39.205 INFO:teuthology.task.internal:Saving configuration 2024-08-17T02:10:39.221 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-17T02:10:39.273 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-17T02:10:39.300 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858261', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:52.645089', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHfI/U+AJOLfOkJH5H2FqzROc71NQDaHWDYazChVZxyltxpwBRcERg7tAKA5vvxpSjH3zLSFFZJkXP/j9DS5qwQ='} 2024-08-17T02:10:39.318 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858261', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:52.646642', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAlgxbOa7uZs1KZGiZhLpLmblf0AG1KfQcGpguw9Dw/fha+ecBaGXuT2CocZNeScZY+JUT6t6rpSmbyVDTJrdtY='} 2024-08-17T02:10:39.318 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-17T02:10:39.325 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-08-17T02:10:39.325 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-08-17T02:10:39.325 INFO:teuthology.run_tasks:Running task console_log... 2024-08-17T02:10:39.439 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f06718afac0>, signals=[15]) 2024-08-17T02:10:39.439 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-17T02:10:39.445 INFO:teuthology.task.internal:Opening connections... 2024-08-17T02:10:39.445 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:10:39.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:10:39.523 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi145.front.sepia.ceph.com 2024-08-17T02:10:39.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:10:39.600 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-17T02:10:39.607 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2024-08-17T02:10:39.625 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2024-08-17T02:10:39.625 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2024-08-17T02:10:39.683 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2024-08-17T02:10:39.683 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2024-08-17T02:10:39.683 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2024-08-17T02:10:39.683 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:10:39.683 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2024-08-17T02:10:39.683 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:10:39.684 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:10:39.684 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2024-08-17T02:10:39.684 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:10:39.684 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:10:39.684 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:10:39.684 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:10:39.684 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:10:39.684 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:10:39.685 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2024-08-17T02:10:39.719 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2024-08-17T02:10:39.737 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2024-08-17T02:10:39.737 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2024-08-17T02:10:39.794 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2024-08-17T02:10:39.794 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="9" 2024-08-17T02:10:39.794 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2024-08-17T02:10:39.794 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:10:39.794 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="9" 2024-08-17T02:10:39.794 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:10:39.794 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:10:39.794 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2024-08-17T02:10:39.794 INFO:teuthology.orchestra.run.smithi145.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:10:39.794 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:10:39.795 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:10:39.795 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:10:39.795 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:10:39.795 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:10:39.795 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2024-08-17T02:10:39.827 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-17T02:10:39.836 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-17T02:10:39.883 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-17T02:10:39.883 DEBUG:teuthology.orchestra.run.smithi002:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:10:39.886 DEBUG:teuthology.orchestra.run.smithi145:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:10:39.902 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-17T02:10:39.931 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-17T02:10:39.931 DEBUG:teuthology.orchestra.run.smithi002:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:10:39.944 DEBUG:teuthology.orchestra.run.smithi145:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:10:40.087 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-17T02:10:40.142 INFO:teuthology.run_tasks:Running task kernel... 2024-08-17T02:10:40.156 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-17T02:10:40.157 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-08-17T02:10:40.157 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-08-17T02:10:40.157 DEBUG:teuthology.orchestra.run.smithi002:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:10:40.158 DEBUG:teuthology.orchestra.run.smithi145:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:10:40.174 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:10:40.174 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:10:40.177 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:10:40.178 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:10:40.326 DEBUG:teuthology.task.kernel:sha1 for client.1 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:10:40.326 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:10:40.326 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2024-08-17T02:10:40.336 DEBUG:teuthology.task.kernel:sha1 for client.0 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:10:40.336 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:10:40.336 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-08-17T02:10:40.343 INFO:teuthology.orchestra.run.smithi145.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:10:40.343 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:10:40.343 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:10:40.344 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum upgrade -y linux-firmware 2024-08-17T02:10:40.354 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:10:40.355 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:10:40.355 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:10:40.355 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum upgrade -y linux-firmware 2024-08-17T02:10:42.787 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-08-17T02:10:43.238 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - BaseOS 6.5 MB/s | 8.2 MB 00:01 2024-08-17T02:10:46.023 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - AppStream 12 MB/s | 20 MB 00:01 2024-08-17T02:10:46.213 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 8.8 MB/s | 20 MB 00:02 2024-08-17T02:10:50.831 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - CRB 6.7 MB/s | 6.6 MB 00:00 2024-08-17T02:10:51.321 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 5.6 MB/s | 6.6 MB 00:01 2024-08-17T02:10:52.265 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - Extras packages 85 kB/s | 18 kB 00:00 2024-08-17T02:10:52.930 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 18 kB 00:00 2024-08-17T02:10:53.219 INFO:teuthology.orchestra.run.smithi145.stdout:Extra Packages for Enterprise Linux 27 MB/s | 22 MB 00:00 2024-08-17T02:10:53.984 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 24 MB/s | 22 MB 00:00 2024-08-17T02:10:58.625 INFO:teuthology.orchestra.run.smithi145.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-08-17T02:10:59.615 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-08-17T02:11:00.693 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-08-17T02:11:00.707 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-08-17T02:11:00.708 INFO:teuthology.orchestra.run.smithi145.stdout: Package Architecture Version Repository Size 2024-08-17T02:11:00.708 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-08-17T02:11:00.708 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrading: 2024-08-17T02:11:00.708 INFO:teuthology.orchestra.run.smithi145.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:11:00.708 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:11:00.708 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-08-17T02:11:00.708 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-08-17T02:11:00.708 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrade 1 Package 2024-08-17T02:11:00.708 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:11:00.708 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 383 M 2024-08-17T02:11:00.708 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-08-17T02:11:01.737 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-08-17T02:11:01.742 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-08-17T02:11:01.742 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-08-17T02:11:01.742 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-08-17T02:11:01.742 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2024-08-17T02:11:01.742 INFO:teuthology.orchestra.run.smithi002.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:11:01.742 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:11:01.742 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-08-17T02:11:01.742 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-08-17T02:11:01.743 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 1 Package 2024-08-17T02:11:01.743 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:11:01.743 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 383 M 2024-08-17T02:11:01.743 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-08-17T02:11:16.858 INFO:teuthology.orchestra.run.smithi145.stdout:linux-firmware-20240716-145.el9.noarch.rpm 24 MB/s | 383 MB 00:16 2024-08-17T02:11:16.858 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:11:16.858 INFO:teuthology.orchestra.run.smithi145.stdout:Total 24 MB/s | 383 MB 00:16 2024-08-17T02:11:18.648 INFO:teuthology.orchestra.run.smithi002.stdout:linux-firmware-20240716-145.el9.noarch.rpm 23 MB/s | 383 MB 00:16 2024-08-17T02:11:18.648 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:11:18.648 INFO:teuthology.orchestra.run.smithi002.stdout:Total 23 MB/s | 383 MB 00:16 2024-08-17T02:11:19.950 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-08-17T02:11:20.056 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-08-17T02:11:20.056 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-08-17T02:11:21.880 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-08-17T02:11:21.966 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-08-17T02:11:21.967 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-08-17T02:11:23.343 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-08-17T02:11:23.343 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-08-17T02:11:25.345 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-08-17T02:11:25.345 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-08-17T02:11:32.293 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-08-17T02:11:33.117 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:11:33.210 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:11:33.762 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:11:33.762 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:11:34.397 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-08-17T02:11:34.466 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:11:34.466 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:11:34.466 INFO:teuthology.orchestra.run.smithi145.stdout:Upgraded: 2024-08-17T02:11:34.467 INFO:teuthology.orchestra.run.smithi145.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:11:34.467 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:11:34.467 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-08-17T02:11:34.788 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:11:34.788 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:11:34.936 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:11:34.937 DEBUG:teuthology.orchestra.run.smithi145:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:11:34.942 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi145.front.sepia.ceph.com to complete... 2024-08-17T02:11:35.125 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:11:35.206 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:11:35.779 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:11:35.779 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:11:36.484 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:11:36.484 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:11:36.485 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2024-08-17T02:11:36.485 INFO:teuthology.orchestra.run.smithi002.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:11:36.485 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:11:36.485 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-08-17T02:11:36.807 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:11:36.807 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:11:36.953 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:11:36.954 DEBUG:teuthology.orchestra.run.smithi002:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:11:36.957 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi002.front.sepia.ceph.com to complete... 2024-08-17T02:11:47.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17 02:11:47 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:11:47.430 INFO:teuthology.orchestra.run.smithi145.stderr:FINISHED --2024-08-17 02:11:47-- 2024-08-17T02:11:47.430 INFO:teuthology.orchestra.run.smithi145.stderr:Total wall clock time: 12s 2024-08-17T02:11:47.430 INFO:teuthology.orchestra.run.smithi145.stderr:Downloaded: 1 files, 344M in 12s (28.5 MB/s) 2024-08-17T02:11:47.433 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:11:47.433 DEBUG:teuthology.orchestra.run.smithi145:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:11:49.490 INFO:teuthology.orchestra.run.smithi145.stdout:Verifying... ######################################## 2024-08-17T02:11:49.547 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing... ######################################## 2024-08-17T02:11:49.597 INFO:teuthology.orchestra.run.smithi145.stdout:Updating / installing... 2024-08-17T02:11:57.704 INFO:teuthology.orchestra.run.smithi145.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:12:06.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17 02:12:06 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:12:06.013 INFO:teuthology.orchestra.run.smithi002.stderr:FINISHED --2024-08-17 02:12:06-- 2024-08-17T02:12:06.013 INFO:teuthology.orchestra.run.smithi002.stderr:Total wall clock time: 29s 2024-08-17T02:12:06.013 INFO:teuthology.orchestra.run.smithi002.stderr:Downloaded: 1 files, 344M in 29s (12.0 MB/s) 2024-08-17T02:12:06.016 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:12:06.017 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:12:08.188 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying... ######################################## 2024-08-17T02:12:08.235 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing... ######################################## 2024-08-17T02:12:08.288 INFO:teuthology.orchestra.run.smithi002.stdout:Updating / installing... 2024-08-17T02:12:16.668 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:12:38.069 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi145.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:12:38.070 DEBUG:teuthology.orchestra.run.smithi145:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:12:38.193 INFO:teuthology.orchestra.run.smithi145.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:12:38.193 INFO:teuthology.orchestra.run.smithi145.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:12:38.194 INFO:teuthology.orchestra.run.smithi145.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:12:38.194 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:12:38.194 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:12:38.194 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:12:38.194 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:12:38.194 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:12:38.194 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:12:38.194 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:12:38.194 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:12:38.194 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:12:38.194 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:12:38.194 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:12:38.195 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:12:38.195 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:12:38.195 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:12:38.195 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:12:38.195 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:12:38.195 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:12:38.195 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:12:38.195 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:12:38.195 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:12:38.195 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:12:38.195 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:12:38.195 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:12:38.195 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:12:38.196 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:12:38.196 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:12:38.196 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:12:38.196 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:12:38.196 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:12:38.196 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:12:38.196 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:12:38.196 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:12:38.196 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:12:38.196 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:12:38.196 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:12:38.196 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:12:38.197 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:12:38.197 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:12:38.197 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:12:38.197 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:12:38.197 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:12:38.197 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:12:38.197 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:12:38.197 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:12:38.197 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:12:38.197 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:12:38.197 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:12:38.197 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:12:38.198 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:12:38.198 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:12:38.198 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:12:38.198 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:12:38.198 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:12:38.198 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:12:38.198 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:12:38.198 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:12:38.198 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:12:38.198 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:12:38.198 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:12:38.199 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:12:38.199 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:12:38.199 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:12:38.199 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:12:38.199 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:12:38.199 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:12:38.199 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:12:38.199 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:12:38.199 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:12:38.199 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:12:38.199 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:12:38.199 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:12:38.199 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:12:38.199 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:12:38.200 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:12:38.200 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:12:38.200 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:12:38.200 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:12:38.200 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:12:38.200 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:12:38.200 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:12:38.200 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:12:38.200 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:12:38.200 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:12:38.200 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:12:38.201 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:12:38.201 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:12:38.201 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:12:38.201 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:12:38.201 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:12:38.201 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:12:38.201 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:12:38.201 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:12:38.201 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:12:38.201 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:12:38.201 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:12:38.201 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:12:38.201 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:12:38.201 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:12:38.202 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:12:38.202 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:12:38.202 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:12:38.202 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:12:38.202 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:12:38.202 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:12:38.202 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:12:38.202 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:12:38.202 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:12:38.202 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:12:38.202 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:12:38.203 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:12:38.203 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:12:38.203 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:12:38.203 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:12:38.203 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:12:38.203 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:12:38.203 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:12:38.203 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:12:38.203 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:12:38.203 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:12:38.203 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:12:38.203 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:12:38.203 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:12:38.204 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:12:38.204 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:12:38.204 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:12:38.204 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:12:38.204 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:12:38.204 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:12:38.204 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:12:38.204 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:12:38.204 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:12:38.204 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:12:38.204 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:12:38.204 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:12:38.204 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:12:38.205 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:12:38.205 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:12:38.205 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:12:38.205 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:12:38.205 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:12:38.205 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:12:38.205 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:12:38.205 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:12:38.205 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:12:38.205 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:12:38.205 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:12:38.205 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:12:38.205 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:12:38.205 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:12:38.206 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:12:38.206 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:12:38.206 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:12:38.206 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:12:38.206 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:12:38.206 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:12:38.206 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:12:38.206 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:12:38.206 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:12:38.206 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:12:38.206 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:12:38.206 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:12:38.207 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:12:38.207 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:12:38.207 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:12:38.207 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:12:38.207 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:12:38.207 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:12:38.207 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:12:38.207 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:12:38.207 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:12:38.207 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:12:38.207 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:12:38.207 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:12:38.208 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:12:38.208 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:12:38.208 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:12:38.208 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:12:38.208 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:12:38.208 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:12:38.208 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:12:38.208 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:12:38.208 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:12:38.208 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:12:38.208 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:12:38.208 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:12:38.208 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:12:38.208 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:12:38.209 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:12:38.209 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:12:38.209 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:12:38.209 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:12:38.209 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:12:38.209 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:12:38.209 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:12:38.209 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:12:38.209 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:12:38.209 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:12:38.209 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:12:38.209 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:12:38.209 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:12:38.210 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:12:38.210 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:12:38.210 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:12:38.210 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:12:38.210 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:12:38.210 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:12:38.210 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:12:38.210 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:12:38.210 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:12:38.210 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:12:38.210 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:12:38.210 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:12:38.211 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:12:38.211 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:12:38.211 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:12:38.211 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:12:38.211 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:12:38.211 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:12:38.211 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:12:38.211 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:12:38.211 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:12:38.211 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:12:38.211 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:12:38.211 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:12:38.211 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:12:38.212 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:12:38.212 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:12:38.212 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:12:38.212 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:12:38.212 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:12:38.212 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:12:38.212 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:12:38.212 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:12:38.212 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:12:38.212 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:12:38.212 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:12:38.212 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:12:38.212 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:12:38.213 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:12:38.213 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:12:38.213 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:12:38.213 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:12:38.213 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:12:38.213 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:12:38.213 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:12:38.213 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:12:38.213 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:12:38.213 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:12:38.213 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:12:38.213 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:12:38.213 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:12:38.213 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:12:38.214 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:12:38.214 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:12:38.214 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:12:38.214 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:12:38.214 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:12:38.214 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:12:38.214 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:12:38.214 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:12:38.214 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:12:38.214 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:12:38.214 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:12:38.214 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:12:38.214 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:12:38.215 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:12:38.215 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:12:38.215 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:12:38.215 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:12:38.215 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:12:38.215 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:12:38.215 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:12:38.215 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:12:38.215 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:12:38.215 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:12:38.215 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:12:38.215 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:12:38.215 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:12:38.216 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:12:38.216 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:12:38.216 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:12:38.216 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:12:38.216 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:12:38.216 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:12:38.216 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:12:38.216 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:12:38.216 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:12:38.216 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:12:38.216 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:12:38.216 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:12:38.216 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:12:38.216 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:12:38.217 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:12:38.217 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:12:38.217 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:12:38.217 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:12:38.217 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:12:38.217 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:12:38.217 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:12:38.217 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:12:38.217 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:12:38.217 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:12:38.217 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:12:38.217 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:12:38.217 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:12:38.217 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:12:38.218 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:12:38.218 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:12:38.218 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:12:38.218 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:12:38.218 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:12:38.218 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:12:38.218 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:12:38.218 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:12:38.218 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:12:38.218 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:12:38.218 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:12:38.218 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:12:38.218 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:12:38.218 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:12:38.219 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:12:38.219 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:12:38.219 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:12:38.219 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:12:38.219 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:12:38.219 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:12:38.219 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:12:38.219 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:12:38.219 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:12:38.219 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:12:38.219 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:12:38.219 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:12:38.219 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:12:38.220 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:12:38.220 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:12:38.220 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:12:38.220 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:12:38.220 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:12:38.220 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:12:38.220 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:12:38.220 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:12:38.220 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:12:38.220 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:12:38.220 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:12:38.220 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:12:38.220 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:12:38.221 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:12:38.221 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:12:38.221 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:12:38.221 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:12:38.221 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:12:38.221 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:12:38.221 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:12:38.221 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:12:38.221 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:12:38.221 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:12:38.221 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:12:38.221 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:12:38.221 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:12:38.222 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:12:38.222 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:12:38.222 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:12:38.222 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:12:38.222 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:12:38.222 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:12:38.222 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:12:38.222 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:12:38.222 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:12:38.222 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:12:38.222 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:12:38.222 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:12:38.222 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:12:38.223 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:12:38.223 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:12:38.223 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:12:38.223 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:12:38.223 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:12:38.223 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:12:38.223 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:12:38.223 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:12:38.223 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:12:38.223 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:12:38.223 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:12:38.223 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:12:38.223 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:12:38.224 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:12:38.224 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:12:38.224 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:12:38.224 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:12:38.224 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:12:38.224 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:12:38.224 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:12:38.224 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:12:38.224 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:12:38.224 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:12:38.224 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:12:38.225 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:12:38.225 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:12:38.225 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:12:38.225 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:12:38.225 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:12:38.225 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:12:38.225 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:12:38.225 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:12:38.225 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:12:38.226 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:12:38.226 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:12:38.226 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:12:38.226 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:12:38.226 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:12:38.226 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:12:38.226 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:12:38.226 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:12:38.226 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:12:38.226 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:12:38.226 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:12:38.226 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:12:38.226 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:12:38.227 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:12:38.227 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:12:38.227 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:12:38.227 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:12:38.227 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:12:38.227 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:12:38.227 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:12:38.227 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:12:38.227 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:12:38.227 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:12:38.227 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:12:38.227 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:12:38.227 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:12:38.227 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:12:38.228 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:12:38.228 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:12:38.228 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:12:38.228 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:12:38.228 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:12:38.228 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:12:38.228 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:12:38.228 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:12:38.228 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:12:38.228 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:12:38.228 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:12:38.228 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:12:38.228 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:12:38.228 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:12:38.229 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:12:38.229 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:12:38.229 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:12:38.229 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:12:38.229 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:12:38.229 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:12:38.229 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:12:38.229 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:12:38.229 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:12:38.229 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:12:38.229 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:12:38.229 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:12:38.229 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:12:38.229 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:12:38.229 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:12:38.230 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:12:38.230 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:12:38.230 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:12:38.230 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:12:38.230 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:12:38.230 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:12:38.230 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:12:38.230 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:12:38.230 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:12:38.230 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:12:38.230 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:12:38.230 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:12:38.231 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:12:38.231 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:12:38.231 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:12:38.231 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:12:38.231 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:12:38.231 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:12:38.231 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:12:38.231 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:12:38.231 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:12:38.231 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:12:38.231 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:12:38.231 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:12:38.231 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:12:38.232 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:12:38.232 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:12:38.232 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:12:38.232 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:12:38.232 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:12:38.232 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:12:38.232 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:12:38.232 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:12:38.232 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:12:38.232 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:12:38.232 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:12:38.232 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:12:38.232 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:12:38.233 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:12:38.233 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:12:38.233 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:12:38.233 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:12:38.233 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:12:38.233 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:12:38.233 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:12:38.233 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:12:38.233 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:12:38.233 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:12:38.233 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:12:38.233 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:12:38.234 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:12:38.234 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:12:38.234 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:12:38.234 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:12:38.234 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:12:38.234 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:12:38.234 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:12:38.234 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:12:38.234 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:12:38.234 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:12:38.234 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:12:38.234 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:12:38.234 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:12:38.235 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:12:38.235 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:12:38.235 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:12:38.235 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:12:38.235 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:12:38.235 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:12:38.235 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:12:38.235 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:12:38.235 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:12:38.235 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:12:38.235 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:12:38.235 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:12:38.235 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:12:38.235 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:12:38.236 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:12:38.236 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:12:38.236 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:12:38.236 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:12:38.236 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:12:38.236 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:12:38.236 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:12:38.236 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:12:38.236 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:12:38.236 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:12:38.236 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:12:38.236 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:12:38.236 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:12:38.237 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:12:38.237 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:12:38.237 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:12:38.237 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:12:38.237 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:12:38.237 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:12:38.237 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:12:38.237 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:12:38.237 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:12:38.237 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:12:38.237 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:12:38.237 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:12:38.237 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:12:38.237 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:12:38.238 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:12:38.238 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:12:38.238 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:12:38.238 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:12:38.238 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:12:38.238 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:12:38.238 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:12:38.238 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:12:38.238 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:12:38.238 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:12:38.238 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:12:38.239 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:12:38.239 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:12:38.239 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:12:38.239 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:12:38.239 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:12:38.239 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:12:38.239 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:12:38.239 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:12:38.239 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:12:38.239 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:12:38.239 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:12:38.239 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:12:38.239 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:12:38.239 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:12:38.239 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:12:38.240 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:12:38.240 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:12:38.240 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:12:38.240 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:12:38.240 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:12:38.240 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:12:38.240 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:12:38.240 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:12:38.240 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:12:38.240 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:12:38.240 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:12:38.240 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:12:38.240 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:12:38.241 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:12:38.241 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:12:38.241 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:12:38.241 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:12:38.241 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:12:38.241 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:12:38.241 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:12:38.241 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:12:38.241 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:12:38.241 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:12:38.241 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:12:38.241 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:12:38.241 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:12:38.242 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:12:38.242 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:12:38.242 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:12:38.242 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:12:38.242 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:12:38.242 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:12:38.242 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:12:38.242 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:12:38.242 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:12:38.242 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:12:38.242 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:12:38.242 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:12:38.243 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:12:38.243 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:12:38.243 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:12:38.243 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:12:38.243 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:12:38.243 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:12:38.243 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:12:38.243 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:12:38.243 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:12:38.243 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:12:38.243 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:12:38.243 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:12:38.243 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:12:38.244 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:12:38.244 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:12:38.244 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:12:38.244 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:12:38.244 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:12:38.244 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:12:38.244 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:12:38.244 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:12:38.244 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:12:38.244 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:12:38.244 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:12:38.244 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:12:38.244 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:12:38.245 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:12:38.245 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:12:38.245 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:12:38.245 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:12:38.245 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:12:38.245 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:12:38.245 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:12:38.245 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:12:38.245 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:12:38.245 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:12:38.245 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:12:38.245 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:12:38.245 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:12:38.246 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:12:38.246 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:12:38.246 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:12:38.246 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:12:38.246 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:12:38.246 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:12:38.246 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:12:38.246 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:12:38.246 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:12:38.246 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:12:38.246 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:12:38.247 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:12:38.247 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:12:38.247 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:12:38.247 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:12:38.247 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:12:38.247 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:12:38.247 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:12:38.247 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:12:38.247 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:12:38.247 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:12:38.247 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:12:38.247 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:12:38.247 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:12:38.247 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:12:38.248 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:12:38.248 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:12:38.248 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:12:38.248 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:12:38.248 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:12:38.248 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:12:38.248 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:12:38.248 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:12:38.248 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:12:38.248 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:12:38.248 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:12:38.248 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:12:38.248 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:12:38.249 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:12:38.249 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:12:38.249 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:12:38.249 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:12:38.249 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:12:38.249 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:12:38.249 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:12:38.249 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:12:38.249 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:12:38.249 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:12:38.249 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:12:38.249 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:12:38.249 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:12:38.249 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:12:38.250 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:12:38.250 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:12:38.250 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:12:38.250 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:12:38.250 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:12:38.250 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:12:38.250 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:12:38.250 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:12:38.250 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:12:38.250 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:12:38.250 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:12:38.250 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:12:38.250 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:12:38.250 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:12:38.251 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:12:38.251 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:12:38.251 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:12:38.251 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:12:38.251 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:12:38.251 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:12:38.251 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:12:38.251 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:12:38.251 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:12:38.251 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:12:38.251 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:12:38.251 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:12:38.251 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:12:38.252 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:12:38.252 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:12:38.252 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:12:38.252 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:12:38.252 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:12:38.252 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:12:38.252 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:12:38.252 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:12:38.252 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:12:38.252 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:12:38.252 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:12:38.252 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:12:38.253 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:12:38.253 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:12:38.253 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:12:38.253 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:12:38.253 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:12:38.253 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:12:38.253 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:12:38.253 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:12:38.253 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:12:38.253 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:12:38.253 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:12:38.253 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:12:38.253 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:12:38.254 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:12:38.254 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:12:38.254 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:12:38.254 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:12:38.254 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:12:38.254 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:12:38.254 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:12:38.254 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:12:38.254 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:12:38.254 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:12:38.254 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:12:38.254 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:12:38.255 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:12:38.255 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:12:38.255 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:12:38.255 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:12:38.255 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:12:38.255 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:12:38.255 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:12:38.255 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:12:38.255 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:12:38.255 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:12:38.255 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:12:38.255 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:12:38.255 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:12:38.256 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:12:38.256 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:12:38.256 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:12:38.256 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:12:38.256 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:12:38.256 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:12:38.256 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:12:38.256 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:12:38.256 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:12:38.256 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:12:38.256 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:12:38.256 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:12:38.256 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:12:38.257 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:12:38.257 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:12:38.257 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:12:38.257 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:12:38.257 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:12:38.257 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:12:38.257 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:12:38.257 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:12:38.257 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:12:38.257 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:12:38.257 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:12:38.257 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:12:38.257 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:12:38.258 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:12:38.258 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:12:38.258 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:12:38.258 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:12:38.258 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:12:38.258 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:12:38.258 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:12:38.258 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:12:38.258 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:12:38.258 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:12:38.258 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:12:38.258 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:12:38.258 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:12:38.259 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:12:38.259 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:12:38.259 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:12:38.259 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:12:38.259 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:12:38.259 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:12:38.259 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:12:38.259 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:12:38.259 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:12:38.259 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:12:38.259 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:12:38.259 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:12:38.260 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:12:38.260 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:12:38.260 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:12:38.260 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:12:38.260 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:12:38.260 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:12:38.260 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:12:38.260 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:12:38.260 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:12:38.260 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:12:38.260 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:12:38.260 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:12:38.260 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:12:38.260 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:12:38.260 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:12:38.261 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:12:38.261 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:12:38.261 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:12:38.261 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:12:38.261 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:12:38.261 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:12:38.261 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:12:38.261 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:12:38.261 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:12:38.261 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:12:38.261 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:12:38.261 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:12:38.261 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:12:38.262 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:12:38.262 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:12:38.262 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:12:38.262 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:12:38.262 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:12:38.262 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:12:38.262 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:12:38.262 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:12:38.262 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:12:38.262 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:12:38.262 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:12:38.262 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:12:38.262 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:12:38.263 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:12:38.263 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:12:38.263 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:12:38.263 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:12:38.263 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:12:38.263 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:12:38.263 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:12:38.263 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:12:38.263 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:12:38.263 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:12:38.263 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:12:38.263 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:12:38.264 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:12:38.264 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:12:38.264 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:12:38.264 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:12:38.264 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:12:38.264 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:12:38.264 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:12:38.264 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:12:38.264 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:12:38.264 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:12:38.264 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:12:38.264 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:12:38.264 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:12:38.265 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:12:38.265 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:12:38.265 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:12:38.265 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:12:38.265 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:12:38.265 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:12:38.265 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:12:38.265 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:12:38.265 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:12:38.265 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:12:38.265 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:12:38.265 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:12:38.265 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:12:38.266 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:12:38.266 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:12:38.266 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:12:38.266 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:12:38.266 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:12:38.266 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:12:38.266 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:12:38.266 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:12:38.266 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:12:38.266 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:12:38.266 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:12:38.266 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:12:38.266 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:12:38.267 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:12:38.267 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:12:38.267 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:12:38.267 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:12:38.267 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:12:38.267 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:12:38.267 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:12:38.267 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:12:38.267 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:12:38.267 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:12:38.267 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:12:38.267 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:12:38.267 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:12:38.267 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:12:38.268 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:12:38.268 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:12:38.268 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:12:38.268 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:12:38.268 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:12:38.268 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:12:38.268 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:12:38.268 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:12:38.268 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:12:38.268 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:12:38.268 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:12:38.268 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:12:38.268 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:12:38.269 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:12:38.269 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:12:38.269 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:12:38.269 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:12:38.269 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:12:38.269 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:12:38.269 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:12:38.269 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:12:38.269 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:12:38.269 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:12:38.269 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:12:38.269 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:12:38.269 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:12:38.269 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:12:38.270 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:12:38.270 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:12:38.270 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:12:38.270 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:12:38.270 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:12:38.270 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:12:38.270 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:12:38.270 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:12:38.270 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:12:38.270 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:12:38.270 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:12:38.271 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:12:38.271 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:12:38.271 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:12:38.271 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:12:38.271 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:12:38.271 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:12:38.271 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:12:38.271 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:12:38.271 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:12:38.271 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:12:38.271 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:12:38.271 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:12:38.271 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:12:38.271 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:12:38.272 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:12:38.272 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:12:38.272 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:12:38.272 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:12:38.272 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:12:38.272 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:12:38.272 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:12:38.272 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:12:38.272 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:12:38.272 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:12:38.272 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:12:38.272 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:12:38.272 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:12:38.272 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:12:38.273 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:12:38.273 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:12:38.273 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:12:38.273 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:12:38.273 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:12:38.273 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:12:38.273 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:12:38.273 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:12:38.273 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:12:38.273 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:12:38.273 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:12:38.273 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:12:38.273 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:12:38.274 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:12:38.274 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:12:38.274 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:12:38.274 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:12:38.274 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:12:38.274 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:12:38.274 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:12:38.274 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:12:38.274 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:12:38.274 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:12:38.274 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:12:38.274 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:12:38.275 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:12:38.275 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:12:38.275 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:12:38.275 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:12:38.275 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:12:38.275 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:12:38.275 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:12:38.275 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:12:38.275 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:12:38.275 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:12:38.275 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:12:38.275 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:12:38.275 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:12:38.275 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:12:38.276 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:12:38.276 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:12:38.276 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:12:38.276 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:12:38.276 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:12:38.276 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:12:38.276 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:12:38.276 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:12:38.276 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:12:38.276 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:12:38.276 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:12:38.276 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:12:38.276 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:12:38.277 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:12:38.277 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:12:38.277 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:12:38.277 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:12:38.277 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:12:38.277 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:12:38.277 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:12:38.277 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:12:38.277 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:12:38.277 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:12:38.277 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:12:38.277 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:12:38.277 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:12:38.278 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:12:38.278 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:12:38.278 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:12:38.278 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:12:38.278 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:12:38.278 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:12:38.278 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:12:38.278 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:12:38.278 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:12:38.278 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:12:38.278 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:12:38.278 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:12:38.278 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:12:38.279 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:12:38.279 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:12:38.279 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:12:38.279 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:12:38.279 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:12:38.279 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:12:38.279 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:12:38.279 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:12:38.279 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:12:38.279 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:12:38.279 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:12:38.279 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:12:38.279 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:12:38.279 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:12:38.280 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:12:38.280 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:12:38.280 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:12:38.280 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:12:38.280 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:12:38.280 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:12:38.280 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:12:38.280 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:12:38.280 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:12:38.280 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:12:38.280 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:12:38.280 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:12:38.280 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:12:38.281 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:12:38.281 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:12:38.281 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:12:38.281 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:12:38.281 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:12:38.281 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:12:38.281 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:12:38.281 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:12:38.281 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:12:38.281 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:12:38.281 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:12:38.281 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:12:38.281 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:12:38.282 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:12:38.282 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:12:38.282 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:12:38.282 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:12:38.282 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:12:38.282 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:12:38.282 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:12:38.282 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:12:38.282 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:12:38.282 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:12:38.282 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:12:38.282 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:12:38.282 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:12:38.283 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:12:38.283 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:12:38.283 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:12:38.283 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:12:38.283 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:12:38.283 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:12:38.283 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:12:38.283 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:12:38.283 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:12:38.283 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:12:38.283 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:12:38.283 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:12:38.283 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:12:38.284 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:12:38.284 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:12:38.284 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:12:38.284 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:12:38.284 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:12:38.284 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:12:38.284 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:12:38.284 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:12:38.284 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:12:38.284 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:12:38.284 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:12:38.284 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:12:38.284 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:12:38.284 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:12:38.285 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:12:38.285 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:12:38.285 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:12:38.285 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:12:38.285 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:12:38.285 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:12:38.285 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:12:38.285 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:12:38.285 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:12:38.285 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:12:38.285 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:12:38.285 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:12:38.286 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:12:38.286 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:12:38.286 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:12:38.286 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:12:38.286 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:12:38.286 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:12:38.286 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:12:38.286 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:12:38.286 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:12:38.286 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:12:38.286 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:12:38.286 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:12:38.286 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:12:38.286 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:12:38.287 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:12:38.287 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:12:38.287 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:12:38.287 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:12:38.287 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:12:38.287 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:12:38.287 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:12:38.287 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:12:38.287 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:12:38.287 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:12:38.287 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:12:38.287 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:12:38.287 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:12:38.288 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:12:38.288 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:12:38.288 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:12:38.288 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:12:38.288 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:12:38.288 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:12:38.288 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:12:38.288 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:12:38.288 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:12:38.288 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:12:38.288 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:12:38.288 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:12:38.289 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:12:38.289 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:12:38.289 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:12:38.289 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:12:38.289 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:12:38.289 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:12:38.289 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:12:38.289 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:12:38.289 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:12:38.289 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:12:38.289 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:12:38.289 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:12:38.289 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:12:38.290 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:12:38.290 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:12:38.290 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:12:38.290 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:12:38.290 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:12:38.290 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:12:38.290 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:12:38.290 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:12:38.290 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:12:38.290 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:12:38.290 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:12:38.290 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:12:38.291 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:12:38.291 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:12:38.291 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:12:38.291 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:12:38.291 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:12:38.291 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:12:38.291 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:12:38.291 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:12:38.291 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:12:38.291 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:12:38.291 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:12:38.291 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:12:38.291 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:12:38.291 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:12:38.292 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:12:38.292 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:12:38.292 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:12:38.292 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:12:38.292 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:12:38.292 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:12:38.292 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:12:38.292 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:12:38.292 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:12:38.292 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:12:38.292 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:12:38.292 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:12:38.292 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:12:38.292 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:12:38.292 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:12:38.293 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:12:38.293 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:12:38.293 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:12:38.293 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:12:38.293 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:12:38.293 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:12:38.293 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:12:38.293 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:12:38.293 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:12:38.293 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:12:38.293 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:12:38.293 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:12:38.293 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:12:38.294 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:12:38.294 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:12:38.294 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:12:38.294 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:12:38.294 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:12:38.294 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:12:38.294 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:12:38.294 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:12:38.294 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:12:38.294 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:12:38.294 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:12:38.294 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:12:38.295 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:12:38.295 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:12:38.295 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:12:38.295 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:12:38.295 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:12:38.295 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:12:38.295 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:12:38.295 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:12:38.295 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:12:38.295 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:12:38.295 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:12:38.295 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:12:38.295 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:12:38.296 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:12:38.296 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:12:38.296 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:12:38.296 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:12:38.296 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:12:38.296 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:12:38.296 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:12:38.296 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:12:38.296 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:12:38.296 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:12:38.296 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:12:38.296 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:12:38.296 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:12:38.296 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:12:38.297 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:12:38.297 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:12:38.297 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:12:38.297 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:12:38.297 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:12:38.297 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:12:38.297 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:12:38.297 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:12:38.297 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:12:38.297 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:12:38.297 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:12:38.297 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:12:38.297 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:12:38.298 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:12:38.298 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:12:38.298 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:12:38.298 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:12:38.298 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:12:38.298 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:12:38.298 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:12:38.298 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:12:38.298 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:12:38.298 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:12:38.298 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:12:38.298 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:12:38.298 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:12:38.299 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:12:38.299 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:12:38.299 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:12:38.299 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:12:38.299 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:12:38.299 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:12:38.299 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:12:38.299 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:12:38.299 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:12:38.299 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:12:38.299 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:12:38.299 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:12:38.299 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:12:38.300 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:12:38.300 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:12:38.300 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:12:38.300 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:12:38.300 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:12:38.300 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:12:38.300 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:12:38.300 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:12:38.300 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:12:38.300 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:12:38.300 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:12:38.300 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:12:38.300 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:12:38.300 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:12:38.301 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:12:38.301 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:12:38.301 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:12:38.301 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:12:38.301 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:12:38.301 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:12:38.301 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:12:38.301 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:12:38.301 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:12:38.301 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:12:38.301 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:12:38.301 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:12:38.301 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:12:38.301 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:12:38.302 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:12:38.302 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:12:38.302 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:12:38.302 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:12:38.302 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:12:38.302 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:12:38.302 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:12:38.302 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:12:38.302 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:12:38.302 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:12:38.302 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:12:38.302 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:12:38.302 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:12:38.303 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:12:38.303 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:12:38.303 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:12:38.303 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:12:38.303 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:12:38.303 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:12:38.303 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:12:38.303 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:12:38.303 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:12:38.303 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:12:38.303 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:12:38.303 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:12:38.303 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:12:38.304 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:12:38.304 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:12:38.304 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:12:38.304 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:12:38.304 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:12:38.304 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:12:38.304 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:12:38.304 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:12:38.304 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:12:38.304 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:12:38.304 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:12:38.304 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:12:38.304 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:12:38.304 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:12:38.305 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:12:38.305 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:12:38.305 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:12:38.305 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:12:38.305 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:12:38.305 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:12:38.305 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:12:38.305 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:12:38.305 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:12:38.305 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:12:38.305 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:12:38.305 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:12:38.305 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:12:38.306 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:12:38.306 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:12:38.306 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:12:38.306 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:12:38.306 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:12:38.306 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:12:38.306 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:12:38.306 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:12:38.306 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:12:38.306 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:12:38.306 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:12:38.306 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:12:38.306 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:12:38.307 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:12:38.307 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:12:38.307 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:12:38.307 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:12:38.307 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:12:38.307 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:12:38.307 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:12:38.307 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:12:38.307 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:12:38.307 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:12:38.307 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:12:38.307 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:12:38.307 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:12:38.308 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:12:38.308 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:12:38.308 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:12:38.308 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:12:38.308 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:12:38.308 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:12:38.308 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:12:38.308 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:12:38.308 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:12:38.308 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:12:38.308 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:12:38.308 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:12:38.308 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:12:38.309 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:12:38.309 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:12:38.309 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:12:38.309 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:12:38.309 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:12:38.309 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:12:38.309 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:12:38.309 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:12:38.309 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:12:38.309 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:12:38.309 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:12:38.309 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:12:38.309 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:12:38.310 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:12:38.310 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:12:38.310 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:12:38.310 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:12:38.310 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:12:38.310 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:12:38.310 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:12:38.310 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:12:38.310 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:12:38.310 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:12:38.310 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:12:38.310 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:12:38.310 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:12:38.311 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:12:38.311 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:12:38.311 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:12:38.311 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:12:38.311 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:12:38.311 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:12:38.311 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:12:38.311 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:12:38.311 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:12:38.311 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:12:38.311 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:12:38.311 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:12:38.311 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:12:38.312 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:12:38.312 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:12:38.312 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:12:38.312 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:12:38.312 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:12:38.312 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:12:38.312 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:12:38.312 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:12:38.312 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:12:38.312 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:12:38.312 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:12:38.312 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:12:38.312 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:12:38.312 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:12:38.313 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:12:38.313 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:12:38.313 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:12:38.313 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:12:38.313 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:12:38.313 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:12:38.313 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:12:38.313 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:12:38.313 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:12:38.313 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:12:38.313 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:12:38.313 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:12:38.314 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:12:38.314 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:12:38.314 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:12:38.314 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:12:38.314 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:12:38.314 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:12:38.314 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:12:38.314 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:12:38.314 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:12:38.314 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:12:38.314 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:12:38.314 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:12:38.314 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:12:38.315 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:12:38.315 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:12:38.315 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:12:38.315 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:12:38.315 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:12:38.315 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:12:38.315 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:12:38.315 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:12:38.315 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:12:38.315 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:12:38.315 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:12:38.315 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:12:38.315 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:12:38.315 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:12:38.316 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:12:38.316 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:12:38.316 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:12:38.316 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:12:38.316 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:12:38.316 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:12:38.316 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:12:38.316 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:12:38.316 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:12:38.316 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:12:38.316 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:12:38.316 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:12:38.316 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:12:38.317 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:12:38.317 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:12:38.317 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:12:38.317 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:12:38.317 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:12:38.317 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:12:38.317 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:12:38.317 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:12:38.317 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:12:38.317 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:12:38.317 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:12:38.317 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:12:38.317 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:12:38.317 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:12:38.317 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:12:38.318 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:12:38.318 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:12:38.318 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:12:38.318 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:12:38.318 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:12:38.318 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:12:38.318 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:12:38.318 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:12:38.318 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:12:38.318 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:12:38.318 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:12:38.318 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:12:38.318 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:12:38.319 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:12:38.319 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:12:38.319 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:12:38.319 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:12:38.319 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:12:38.319 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:12:38.319 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:12:38.319 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:12:38.319 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:12:38.319 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:12:38.319 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:12:38.319 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:12:38.319 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:12:38.319 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:12:38.320 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:12:38.320 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:12:38.320 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:12:38.320 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:12:38.320 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:12:38.320 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:12:38.320 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:12:38.320 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:12:38.320 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:12:38.320 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:12:38.320 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:12:38.320 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:12:38.320 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:12:38.321 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:12:38.321 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:12:38.321 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:12:38.321 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:12:38.321 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:12:38.321 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:12:38.321 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:12:38.321 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:12:38.321 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:12:38.321 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:12:38.321 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:12:38.321 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:12:38.321 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:12:38.321 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:12:38.322 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:12:38.322 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:12:38.322 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:12:38.322 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:12:38.322 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:12:38.322 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:12:38.322 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:12:38.322 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:12:38.322 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:12:38.322 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:12:38.322 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:12:38.322 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:12:38.322 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:12:38.323 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:12:38.323 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:12:38.323 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:12:38.323 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:12:38.323 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:12:38.323 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:12:38.323 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:12:38.323 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:12:38.323 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:12:38.323 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:12:38.323 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:12:38.323 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:12:38.323 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:12:38.323 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:12:38.324 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:12:38.324 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:12:38.324 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:12:38.324 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:12:38.324 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:12:38.324 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:12:38.324 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:12:38.324 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:12:38.324 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:12:38.324 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:12:38.324 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:12:38.324 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:12:38.324 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:12:38.325 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:12:38.325 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:12:38.325 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:12:38.325 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:12:38.325 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:12:38.325 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:12:38.325 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:12:38.325 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:12:38.325 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:12:38.325 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:12:38.325 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:12:38.325 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:12:38.325 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:12:38.326 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:12:38.326 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:12:38.326 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:12:38.326 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:12:38.326 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:12:38.326 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:12:38.326 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:12:38.326 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:12:38.326 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:12:38.326 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:12:38.326 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:12:38.326 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:12:38.326 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:12:38.327 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:12:38.327 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:12:38.327 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:12:38.327 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:12:38.327 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:12:38.327 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:12:38.327 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:12:38.327 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:12:38.327 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:12:38.327 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:12:38.327 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:12:38.327 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:12:38.328 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:12:38.328 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:12:38.328 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:12:38.328 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:12:38.328 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:12:38.328 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:12:38.328 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:12:38.328 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:12:38.328 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:12:38.328 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:12:38.328 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:12:38.328 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:12:38.328 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:12:38.329 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:12:38.329 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:12:38.329 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:12:38.329 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:12:38.329 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:12:38.329 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:12:38.329 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:12:38.329 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:12:38.329 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:12:38.329 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:12:38.329 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:12:38.329 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:12:38.329 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:12:38.329 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:12:38.330 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:12:38.330 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:12:38.330 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:12:38.330 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:12:38.330 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:12:38.330 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:12:38.330 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:12:38.330 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:12:38.330 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:12:38.330 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:12:38.330 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:12:38.330 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:12:38.330 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:12:38.331 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:12:38.331 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:12:38.331 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:12:38.331 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:12:38.331 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:12:38.331 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:12:38.334 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:12:38.334 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:12:38.334 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:12:38.334 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:12:38.334 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:12:38.334 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:12:38.334 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:12:38.334 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:12:38.334 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:12:38.334 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:12:38.334 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:12:38.335 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:12:38.335 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:12:38.335 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:12:38.335 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:12:38.335 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:12:38.335 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:12:38.335 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:12:38.335 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:12:38.335 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:12:38.335 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:12:38.335 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:12:38.335 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:12:38.335 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:12:38.336 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:12:38.336 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:12:38.336 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:12:38.336 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:12:38.336 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:12:38.336 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:12:38.336 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:12:38.336 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:12:38.336 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:12:38.336 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:12:38.336 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:12:38.336 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:12:38.336 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:12:38.337 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:12:38.337 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:12:38.337 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:12:38.337 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:12:38.337 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:12:38.337 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:12:38.337 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:12:38.337 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:12:38.337 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:12:38.337 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:12:38.337 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:12:38.337 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:12:38.337 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:12:38.337 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:12:38.338 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:12:38.338 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:12:38.338 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:12:38.338 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:12:38.338 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:12:38.338 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:12:38.338 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:12:38.338 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:12:38.338 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:12:38.338 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:12:38.338 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:12:38.338 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:12:38.339 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:12:38.339 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:12:38.339 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:12:38.339 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:12:38.339 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:12:38.339 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:12:38.339 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:12:38.339 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:12:38.339 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:12:38.339 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:12:38.339 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:12:38.339 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:12:38.339 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:12:38.339 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:12:38.340 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:12:38.340 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:12:38.340 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:12:38.340 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:12:38.340 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:12:38.340 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:12:38.340 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:12:38.340 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:12:38.340 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:12:38.340 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:12:38.340 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:12:38.340 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:12:38.340 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:12:38.340 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:12:38.340 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:12:38.341 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:12:38.341 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:12:38.341 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:12:38.341 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:12:38.341 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:12:38.341 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:12:38.341 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:12:38.341 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:12:38.341 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:12:38.341 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:12:38.341 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:12:38.341 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:12:38.341 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:12:38.342 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:12:38.342 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:12:38.342 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:12:38.342 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:12:38.342 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:12:38.342 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:12:38.342 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:12:38.342 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:12:38.342 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:12:38.342 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:12:38.342 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:12:38.342 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:12:38.342 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:12:38.343 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:12:38.343 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:12:38.343 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:12:38.343 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:12:38.343 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:12:38.343 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:12:38.343 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:12:38.343 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:12:38.343 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:12:38.343 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:12:38.343 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:12:38.343 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:12:38.343 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:12:38.344 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:12:38.344 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:12:38.344 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:12:38.344 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:12:38.344 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:12:38.344 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:12:38.344 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:12:38.344 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:12:38.344 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:12:38.344 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:12:38.344 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:12:38.344 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:12:38.344 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:12:38.345 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:12:38.345 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:12:38.345 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:12:38.345 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:12:38.345 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:12:38.345 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:12:38.345 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:12:38.345 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:12:38.345 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:12:38.345 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:12:38.345 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:12:38.345 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:12:38.345 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:12:38.346 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:12:38.346 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:12:38.346 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:12:38.350 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:12:38.350 DEBUG:teuthology.orchestra.run.smithi145:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:12:38.374 INFO:teuthology.orchestra.run.smithi145.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:12:38.374 INFO:teuthology.orchestra.run.smithi145.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:12:38.374 INFO:teuthology.orchestra.run.smithi145.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:12:38.374 INFO:teuthology.orchestra.run.smithi145.stdout:fi 2024-08-17T02:12:38.374 INFO:teuthology.orchestra.run.smithi145.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:12:38.374 INFO:teuthology.orchestra.run.smithi145.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:12:38.374 INFO:teuthology.orchestra.run.smithi145.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:12:38.375 INFO:teuthology.orchestra.run.smithi145.stdout: fi 2024-08-17T02:12:38.375 INFO:teuthology.orchestra.run.smithi145.stdout:done 2024-08-17T02:12:38.375 INFO:teuthology.orchestra.run.smithi145.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:12:38.375 INFO:teuthology.orchestra.run.smithi145.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:12:38.375 INFO:teuthology.orchestra.run.smithi145.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:12:38.375 INFO:teuthology.orchestra.run.smithi145.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:12:38.375 INFO:teuthology.orchestra.run.smithi145.stdout:fi 2024-08-17T02:12:38.375 INFO:teuthology.orchestra.run.smithi145.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:12:38.375 INFO:teuthology.orchestra.run.smithi145.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:12:38.375 INFO:teuthology.orchestra.run.smithi145.stdout:fi 2024-08-17T02:12:38.375 INFO:teuthology.orchestra.run.smithi145.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:12:38.375 INFO:teuthology.orchestra.run.smithi145.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:12:38.375 INFO:teuthology.orchestra.run.smithi145.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:12:38.376 INFO:teuthology.orchestra.run.smithi145.stdout:fi 2024-08-17T02:12:38.376 DEBUG:teuthology.orchestra.run.smithi145:> sudo rpm -qi grub2-tools 2024-08-17T02:12:38.459 INFO:teuthology.orchestra.run.smithi145.stdout:Name : grub2-tools 2024-08-17T02:12:38.459 INFO:teuthology.orchestra.run.smithi145.stdout:Epoch : 1 2024-08-17T02:12:38.459 INFO:teuthology.orchestra.run.smithi145.stdout:Version : 2.06 2024-08-17T02:12:38.459 INFO:teuthology.orchestra.run.smithi145.stdout:Release : 68.el9 2024-08-17T02:12:38.459 INFO:teuthology.orchestra.run.smithi145.stdout:Architecture: x86_64 2024-08-17T02:12:38.460 INFO:teuthology.orchestra.run.smithi145.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:12:38.460 INFO:teuthology.orchestra.run.smithi145.stdout:Group : Unspecified 2024-08-17T02:12:38.460 INFO:teuthology.orchestra.run.smithi145.stdout:Size : 8264254 2024-08-17T02:12:38.460 INFO:teuthology.orchestra.run.smithi145.stdout:License : GPLv3+ 2024-08-17T02:12:38.460 INFO:teuthology.orchestra.run.smithi145.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:12:38.460 INFO:teuthology.orchestra.run.smithi145.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:12:38.460 INFO:teuthology.orchestra.run.smithi145.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:12:38.460 INFO:teuthology.orchestra.run.smithi145.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:12:38.460 INFO:teuthology.orchestra.run.smithi145.stdout:Packager : builder@centos.org 2024-08-17T02:12:38.460 INFO:teuthology.orchestra.run.smithi145.stdout:Vendor : CentOS 2024-08-17T02:12:38.460 INFO:teuthology.orchestra.run.smithi145.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:12:38.460 INFO:teuthology.orchestra.run.smithi145.stdout:Summary : Support tools for GRUB. 2024-08-17T02:12:38.460 INFO:teuthology.orchestra.run.smithi145.stdout:Description : 2024-08-17T02:12:38.461 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:12:38.461 INFO:teuthology.orchestra.run.smithi145.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:12:38.461 INFO:teuthology.orchestra.run.smithi145.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:12:38.461 INFO:teuthology.orchestra.run.smithi145.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:12:38.461 INFO:teuthology.orchestra.run.smithi145.stdout:hardware devices. 2024-08-17T02:12:38.461 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:12:38.461 INFO:teuthology.orchestra.run.smithi145.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:12:38.462 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:12:38.462 INFO:teuthology.task.kernel:Updating grub on smithi145 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:12:38.462 DEBUG:teuthology.orchestra.run.smithi145:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:12:39.003 INFO:teuthology.orchestra.run.smithi145.stderr:Generating grub configuration file ... 2024-08-17T02:12:40.358 INFO:teuthology.orchestra.run.smithi145.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:12:40.409 INFO:teuthology.orchestra.run.smithi145.stderr:done 2024-08-17T02:12:40.412 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2024-08-17T02:12:40.432 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.ceUtOWVAzt 2024-08-17T02:12:40.432 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ceUtOWVAzt 2024-08-17T02:12:40.498 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.ceUtOWVAzt 2024-08-17T02:12:40.637 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.ceUtOWVAzt is 6KB 2024-08-17T02:12:40.685 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.ceUtOWVAzt 2024-08-17T02:12:40.699 DEBUG:teuthology.orchestra.run.smithi145:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:12:40.768 INFO:teuthology.orchestra.run.smithi145.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:12:40.769 INFO:teuthology.orchestra.run.smithi145.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:12:40.769 INFO:teuthology.orchestra.run.smithi145.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:12:40.769 INFO:teuthology.orchestra.run.smithi145.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:12:40.770 DEBUG:teuthology.orchestra.run.smithi145:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:12:40.900 DEBUG:teuthology.orchestra.run.smithi145:> sudo shutdown -r now 2024-08-17T02:12:55.484 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi002.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:12:55.485 DEBUG:teuthology.orchestra.run.smithi002:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:12:55.584 INFO:teuthology.orchestra.run.smithi002.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:12:55.584 INFO:teuthology.orchestra.run.smithi002.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:12:55.584 INFO:teuthology.orchestra.run.smithi002.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:12:55.585 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:12:55.585 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:12:55.585 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:12:55.585 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:12:55.585 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:12:55.585 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:12:55.585 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:12:55.585 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:12:55.585 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:12:55.585 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:12:55.585 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:12:55.585 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:12:55.585 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:12:55.585 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:12:55.586 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:12:55.586 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:12:55.586 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:12:55.586 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:12:55.586 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:12:55.586 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:12:55.586 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:12:55.586 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:12:55.586 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:12:55.586 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:12:55.586 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:12:55.586 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:12:55.587 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:12:55.587 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:12:55.587 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:12:55.587 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:12:55.587 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:12:55.587 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:12:55.587 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:12:55.587 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:12:55.587 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:12:55.587 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:12:55.587 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:12:55.587 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:12:55.588 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:12:55.588 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:12:55.588 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:12:55.588 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:12:55.588 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:12:55.588 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:12:55.588 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:12:55.588 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:12:55.588 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:12:55.588 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:12:55.588 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:12:55.588 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:12:55.588 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:12:55.588 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:12:55.589 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:12:55.589 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:12:55.589 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:12:55.589 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:12:55.589 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:12:55.589 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:12:55.589 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:12:55.589 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:12:55.589 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:12:55.589 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:12:55.589 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:12:55.589 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:12:55.589 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:12:55.589 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:12:55.590 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:12:55.590 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:12:55.590 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:12:55.590 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:12:55.590 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:12:55.590 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:12:55.590 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:12:55.590 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:12:55.590 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:12:55.590 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:12:55.590 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:12:55.590 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:12:55.590 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:12:55.591 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:12:55.591 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:12:55.591 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:12:55.591 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:12:55.591 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:12:55.591 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:12:55.591 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:12:55.591 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:12:55.591 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:12:55.591 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:12:55.591 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:12:55.591 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:12:55.592 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:12:55.592 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:12:55.592 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:12:55.592 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:12:55.592 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:12:55.592 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:12:55.592 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:12:55.592 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:12:55.592 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:12:55.592 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:12:55.592 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:12:55.592 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:12:55.592 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:12:55.592 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:12:55.593 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:12:55.593 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:12:55.593 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:12:55.593 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:12:55.593 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:12:55.593 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:12:55.593 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:12:55.593 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:12:55.593 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:12:55.593 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:12:55.593 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:12:55.593 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:12:55.593 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:12:55.593 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:12:55.594 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:12:55.594 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:12:55.594 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:12:55.594 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:12:55.594 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:12:55.594 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:12:55.594 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:12:55.594 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:12:55.594 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:12:55.594 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:12:55.594 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:12:55.594 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:12:55.594 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:12:55.595 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:12:55.595 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:12:55.595 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:12:55.595 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:12:55.595 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:12:55.595 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:12:55.595 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:12:55.595 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:12:55.595 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:12:55.595 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:12:55.595 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:12:55.595 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:12:55.595 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:12:55.596 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:12:55.596 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:12:55.596 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:12:55.596 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:12:55.596 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:12:55.596 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:12:55.596 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:12:55.596 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:12:55.596 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:12:55.596 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:12:55.596 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:12:55.596 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:12:55.596 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:12:55.597 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:12:55.597 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:12:55.597 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:12:55.597 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:12:55.597 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:12:55.597 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:12:55.597 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:12:55.597 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:12:55.597 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:12:55.597 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:12:55.597 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:12:55.597 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:12:55.597 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:12:55.597 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:12:55.598 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:12:55.598 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:12:55.598 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:12:55.598 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:12:55.598 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:12:55.598 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:12:55.598 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:12:55.598 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:12:55.598 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:12:55.598 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:12:55.598 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:12:55.598 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:12:55.599 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:12:55.599 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:12:55.599 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:12:55.599 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:12:55.599 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:12:55.599 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:12:55.599 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:12:55.599 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:12:55.599 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:12:55.599 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:12:55.599 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:12:55.599 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:12:55.600 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:12:55.600 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:12:55.600 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:12:55.600 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:12:55.600 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:12:55.600 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:12:55.600 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:12:55.600 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:12:55.600 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:12:55.600 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:12:55.600 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:12:55.600 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:12:55.600 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:12:55.600 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:12:55.600 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:12:55.601 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:12:55.601 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:12:55.601 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:12:55.601 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:12:55.601 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:12:55.601 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:12:55.601 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:12:55.601 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:12:55.601 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:12:55.601 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:12:55.601 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:12:55.601 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:12:55.601 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:12:55.601 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:12:55.602 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:12:55.602 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:12:55.602 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:12:55.602 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:12:55.602 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:12:55.602 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:12:55.602 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:12:55.602 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:12:55.602 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:12:55.602 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:12:55.602 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:12:55.602 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:12:55.603 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:12:55.603 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:12:55.603 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:12:55.603 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:12:55.603 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:12:55.603 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:12:55.603 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:12:55.603 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:12:55.603 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:12:55.603 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:12:55.603 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:12:55.603 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:12:55.603 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:12:55.603 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:12:55.603 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:12:55.604 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:12:55.604 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:12:55.604 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:12:55.604 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:12:55.604 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:12:55.604 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:12:55.604 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:12:55.604 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:12:55.604 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:12:55.604 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:12:55.604 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:12:55.604 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:12:55.604 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:12:55.604 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:12:55.605 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:12:55.605 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:12:55.605 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:12:55.605 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:12:55.605 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:12:55.605 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:12:55.605 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:12:55.605 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:12:55.605 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:12:55.605 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:12:55.605 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:12:55.605 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:12:55.605 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:12:55.605 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:12:55.606 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:12:55.606 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:12:55.606 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:12:55.606 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:12:55.606 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:12:55.606 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:12:55.606 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:12:55.606 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:12:55.606 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:12:55.606 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:12:55.606 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:12:55.606 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:12:55.607 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:12:55.607 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:12:55.607 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:12:55.607 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:12:55.607 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:12:55.607 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:12:55.607 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:12:55.607 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:12:55.607 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:12:55.607 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:12:55.607 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:12:55.607 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:12:55.607 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:12:55.608 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:12:55.608 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:12:55.608 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:12:55.608 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:12:55.608 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:12:55.608 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:12:55.608 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:12:55.608 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:12:55.608 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:12:55.608 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:12:55.608 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:12:55.608 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:12:55.608 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:12:55.609 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:12:55.609 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:12:55.609 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:12:55.609 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:12:55.609 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:12:55.609 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:12:55.609 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:12:55.609 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:12:55.609 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:12:55.609 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:12:55.609 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:12:55.609 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:12:55.609 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:12:55.609 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:12:55.610 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:12:55.610 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:12:55.610 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:12:55.610 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:12:55.610 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:12:55.610 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:12:55.610 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:12:55.610 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:12:55.610 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:12:55.610 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:12:55.610 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:12:55.610 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:12:55.610 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:12:55.611 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:12:55.611 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:12:55.611 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:12:55.611 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:12:55.611 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:12:55.611 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:12:55.611 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:12:55.611 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:12:55.611 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:12:55.611 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:12:55.611 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:12:55.611 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:12:55.611 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:12:55.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:12:55.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:12:55.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:12:55.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:12:55.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:12:55.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:12:55.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:12:55.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:12:55.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:12:55.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:12:55.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:12:55.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:12:55.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:12:55.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:12:55.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:12:55.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:12:55.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:12:55.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:12:55.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:12:55.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:12:55.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:12:55.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:12:55.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:12:55.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:12:55.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:12:55.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:12:55.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:12:55.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:12:55.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:12:55.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:12:55.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:12:55.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:12:55.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:12:55.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:12:55.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:12:55.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:12:55.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:12:55.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:12:55.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:12:55.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:12:55.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:12:55.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:12:55.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:12:55.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:12:55.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:12:55.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:12:55.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:12:55.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:12:55.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:12:55.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:12:55.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:12:55.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:12:55.616 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:12:55.616 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:12:55.616 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:12:55.616 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:12:55.616 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:12:55.616 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:12:55.616 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:12:55.616 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:12:55.616 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:12:55.616 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:12:55.616 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:12:55.616 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:12:55.616 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:12:55.616 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:12:55.617 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:12:55.617 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:12:55.617 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:12:55.617 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:12:55.617 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:12:55.617 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:12:55.617 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:12:55.617 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:12:55.617 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:12:55.617 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:12:55.617 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:12:55.617 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:12:55.617 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:12:55.618 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:12:55.618 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:12:55.618 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:12:55.618 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:12:55.618 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:12:55.618 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:12:55.618 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:12:55.618 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:12:55.618 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:12:55.618 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:12:55.618 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:12:55.618 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:12:55.618 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:12:55.619 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:12:55.619 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:12:55.619 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:12:55.619 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:12:55.619 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:12:55.619 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:12:55.619 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:12:55.619 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:12:55.619 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:12:55.619 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:12:55.619 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:12:55.619 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:12:55.619 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:12:55.619 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:12:55.619 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:12:55.620 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:12:55.620 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:12:55.620 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:12:55.620 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:12:55.620 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:12:55.620 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:12:55.620 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:12:55.620 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:12:55.620 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:12:55.620 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:12:55.620 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:12:55.620 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:12:55.620 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:12:55.620 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:12:55.621 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:12:55.621 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:12:55.621 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:12:55.621 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:12:55.621 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:12:55.621 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:12:55.621 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:12:55.621 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:12:55.621 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:12:55.621 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:12:55.621 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:12:55.621 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:12:55.621 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:12:55.621 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:12:55.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:12:55.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:12:55.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:12:55.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:12:55.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:12:55.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:12:55.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:12:55.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:12:55.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:12:55.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:12:55.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:12:55.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:12:55.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:12:55.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:12:55.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:12:55.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:12:55.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:12:55.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:12:55.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:12:55.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:12:55.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:12:55.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:12:55.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:12:55.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:12:55.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:12:55.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:12:55.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:12:55.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:12:55.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:12:55.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:12:55.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:12:55.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:12:55.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:12:55.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:12:55.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:12:55.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:12:55.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:12:55.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:12:55.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:12:55.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:12:55.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:12:55.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:12:55.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:12:55.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:12:55.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:12:55.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:12:55.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:12:55.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:12:55.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:12:55.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:12:55.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:12:55.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:12:55.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:12:55.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:12:55.626 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:12:55.626 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:12:55.626 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:12:55.626 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:12:55.626 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:12:55.626 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:12:55.626 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:12:55.626 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:12:55.626 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:12:55.626 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:12:55.626 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:12:55.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:12:55.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:12:55.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:12:55.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:12:55.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:12:55.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:12:55.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:12:55.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:12:55.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:12:55.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:12:55.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:12:55.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:12:55.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:12:55.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:12:55.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:12:55.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:12:55.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:12:55.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:12:55.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:12:55.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:12:55.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:12:55.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:12:55.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:12:55.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:12:55.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:12:55.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:12:55.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:12:55.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:12:55.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:12:55.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:12:55.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:12:55.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:12:55.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:12:55.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:12:55.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:12:55.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:12:55.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:12:55.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:12:55.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:12:55.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:12:55.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:12:55.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:12:55.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:12:55.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:12:55.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:12:55.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:12:55.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:12:55.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:12:55.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:12:55.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:12:55.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:12:55.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:12:55.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:12:55.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:12:55.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:12:55.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:12:55.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:12:55.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:12:55.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:12:55.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:12:55.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:12:55.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:12:55.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:12:55.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:12:55.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:12:55.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:12:55.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:12:55.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:12:55.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:12:55.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:12:55.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:12:55.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:12:55.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:12:55.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:12:55.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:12:55.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:12:55.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:12:55.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:12:55.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:12:55.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:12:55.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:12:55.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:12:55.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:12:55.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:12:55.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:12:55.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:12:55.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:12:55.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:12:55.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:12:55.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:12:55.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:12:55.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:12:55.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:12:55.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:12:55.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:12:55.634 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:12:55.634 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:12:55.634 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:12:55.634 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:12:55.634 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:12:55.634 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:12:55.634 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:12:55.634 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:12:55.634 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:12:55.634 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:12:55.634 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:12:55.634 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:12:55.634 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:12:55.634 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:12:55.635 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:12:55.635 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:12:55.635 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:12:55.635 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:12:55.635 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:12:55.635 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:12:55.635 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:12:55.635 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:12:55.635 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:12:55.635 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:12:55.635 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:12:55.635 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:12:55.635 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:12:55.636 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:12:55.636 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:12:55.636 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:12:55.636 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:12:55.636 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:12:55.636 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:12:55.636 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:12:55.636 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:12:55.636 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:12:55.636 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:12:55.636 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:12:55.636 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:12:55.637 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:12:55.637 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:12:55.637 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:12:55.637 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:12:55.637 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:12:55.637 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:12:55.637 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:12:55.637 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:12:55.637 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:12:55.637 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:12:55.637 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:12:55.637 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:12:55.637 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:12:55.637 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:12:55.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:12:55.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:12:55.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:12:55.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:12:55.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:12:55.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:12:55.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:12:55.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:12:55.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:12:55.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:12:55.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:12:55.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:12:55.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:12:55.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:12:55.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:12:55.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:12:55.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:12:55.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:12:55.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:12:55.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:12:55.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:12:55.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:12:55.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:12:55.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:12:55.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:12:55.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:12:55.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:12:55.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:12:55.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:12:55.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:12:55.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:12:55.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:12:55.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:12:55.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:12:55.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:12:55.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:12:55.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:12:55.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:12:55.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:12:55.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:12:55.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:12:55.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:12:55.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:12:55.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:12:55.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:12:55.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:12:55.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:12:55.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:12:55.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:12:55.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:12:55.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:12:55.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:12:55.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:12:55.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:12:55.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:12:55.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:12:55.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:12:55.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:12:55.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:12:55.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:12:55.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:12:55.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:12:55.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:12:55.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:12:55.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:12:55.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:12:55.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:12:55.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:12:55.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:12:55.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:12:55.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:12:55.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:12:55.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:12:55.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:12:55.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:12:55.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:12:55.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:12:55.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:12:55.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:12:55.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:12:55.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:12:55.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:12:55.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:12:55.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:12:55.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:12:55.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:12:55.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:12:55.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:12:55.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:12:55.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:12:55.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:12:55.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:12:55.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:12:55.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:12:55.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:12:55.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:12:55.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:12:55.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:12:55.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:12:55.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:12:55.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:12:55.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:12:55.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:12:55.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:12:55.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:12:55.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:12:55.646 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:12:55.646 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:12:55.646 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:12:55.646 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:12:55.646 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:12:55.646 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:12:55.646 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:12:55.646 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:12:55.646 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:12:55.646 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:12:55.646 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:12:55.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:12:55.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:12:55.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:12:55.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:12:55.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:12:55.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:12:55.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:12:55.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:12:55.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:12:55.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:12:55.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:12:55.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:12:55.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:12:55.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:12:55.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:12:55.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:12:55.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:12:55.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:12:55.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:12:55.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:12:55.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:12:55.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:12:55.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:12:55.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:12:55.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:12:55.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:12:55.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:12:55.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:12:55.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:12:55.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:12:55.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:12:55.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:12:55.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:12:55.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:12:55.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:12:55.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:12:55.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:12:55.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:12:55.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:12:55.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:12:55.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:12:55.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:12:55.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:12:55.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:12:55.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:12:55.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:12:55.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:12:55.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:12:55.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:12:55.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:12:55.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:12:55.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:12:55.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:12:55.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:12:55.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:12:55.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:12:55.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:12:55.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:12:55.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:12:55.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:12:55.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:12:55.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:12:55.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:12:55.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:12:55.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:12:55.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:12:55.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:12:55.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:12:55.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:12:55.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:12:55.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:12:55.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:12:55.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:12:55.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:12:55.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:12:55.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:12:55.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:12:55.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:12:55.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:12:55.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:12:55.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:12:55.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:12:55.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:12:55.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:12:55.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:12:55.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:12:55.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:12:55.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:12:55.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:12:55.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:12:55.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:12:55.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:12:55.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:12:55.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:12:55.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:12:55.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:12:55.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:12:55.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:12:55.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:12:55.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:12:55.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:12:55.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:12:55.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:12:55.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:12:55.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:12:55.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:12:55.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:12:55.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:12:55.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:12:55.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:12:55.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:12:55.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:12:55.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:12:55.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:12:55.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:12:55.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:12:55.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:12:55.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:12:55.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:12:55.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:12:55.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:12:55.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:12:55.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:12:55.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:12:55.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:12:55.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:12:55.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:12:55.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:12:55.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:12:55.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:12:55.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:12:55.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:12:55.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:12:55.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:12:55.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:12:55.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:12:55.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:12:55.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:12:55.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:12:55.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:12:55.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:12:55.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:12:55.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:12:55.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:12:55.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:12:55.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:12:55.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:12:55.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:12:55.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:12:55.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:12:55.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:12:55.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:12:55.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:12:55.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:12:55.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:12:55.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:12:55.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:12:55.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:12:55.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:12:55.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:12:55.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:12:55.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:12:55.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:12:55.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:12:55.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:12:55.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:12:55.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:12:55.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:12:55.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:12:55.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:12:55.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:12:55.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:12:55.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:12:55.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:12:55.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:12:55.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:12:55.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:12:55.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:12:55.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:12:55.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:12:55.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:12:55.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:12:55.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:12:55.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:12:55.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:12:55.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:12:55.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:12:55.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:12:55.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:12:55.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:12:55.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:12:55.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:12:55.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:12:55.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:12:55.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:12:55.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:12:55.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:12:55.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:12:55.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:12:55.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:12:55.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:12:55.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:12:55.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:12:55.662 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:12:55.662 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:12:55.662 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:12:55.662 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:12:55.662 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:12:55.662 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:12:55.662 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:12:55.662 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:12:55.662 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:12:55.662 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:12:55.662 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:12:55.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:12:55.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:12:55.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:12:55.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:12:55.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:12:55.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:12:55.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:12:55.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:12:55.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:12:55.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:12:55.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:12:55.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:12:55.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:12:55.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:12:55.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:12:55.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:12:55.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:12:55.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:12:55.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:12:55.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:12:55.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:12:55.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:12:55.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:12:55.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:12:55.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:12:55.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:12:55.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:12:55.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:12:55.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:12:55.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:12:55.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:12:55.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:12:55.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:12:55.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:12:55.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:12:55.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:12:55.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:12:55.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:12:55.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:12:55.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:12:55.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:12:55.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:12:55.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:12:55.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:12:55.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:12:55.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:12:55.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:12:55.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:12:55.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:12:55.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:12:55.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:12:55.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:12:55.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:12:55.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:12:55.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:12:55.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:12:55.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:12:55.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:12:55.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:12:55.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:12:55.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:12:55.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:12:55.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:12:55.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:12:55.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:12:55.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:12:55.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:12:55.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:12:55.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:12:55.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:12:55.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:12:55.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:12:55.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:12:55.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:12:55.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:12:55.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:12:55.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:12:55.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:12:55.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:12:55.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:12:55.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:12:55.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:12:55.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:12:55.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:12:55.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:12:55.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:12:55.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:12:55.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:12:55.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:12:55.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:12:55.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:12:55.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:12:55.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:12:55.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:12:55.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:12:55.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:12:55.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:12:55.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:12:55.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:12:55.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:12:55.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:12:55.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:12:55.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:12:55.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:12:55.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:12:55.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:12:55.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:12:55.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:12:55.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:12:55.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:12:55.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:12:55.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:12:55.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:12:55.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:12:55.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:12:55.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:12:55.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:12:55.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:12:55.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:12:55.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:12:55.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:12:55.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:12:55.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:12:55.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:12:55.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:12:55.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:12:55.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:12:55.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:12:55.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:12:55.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:12:55.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:12:55.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:12:55.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:12:55.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:12:55.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:12:55.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:12:55.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:12:55.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:12:55.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:12:55.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:12:55.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:12:55.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:12:55.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:12:55.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:12:55.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:12:55.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:12:55.674 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:12:55.674 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:12:55.674 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:12:55.674 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:12:55.674 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:12:55.674 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:12:55.674 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:12:55.674 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:12:55.674 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:12:55.674 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:12:55.674 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:12:55.674 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:12:55.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:12:55.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:12:55.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:12:55.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:12:55.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:12:55.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:12:55.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:12:55.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:12:55.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:12:55.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:12:55.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:12:55.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:12:55.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:12:55.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:12:55.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:12:55.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:12:55.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:12:55.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:12:55.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:12:55.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:12:55.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:12:55.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:12:55.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:12:55.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:12:55.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:12:55.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:12:55.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:12:55.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:12:55.677 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:12:55.677 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:12:55.677 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:12:55.677 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:12:55.677 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:12:55.677 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:12:55.677 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:12:55.677 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:12:55.677 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:12:55.677 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:12:55.677 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:12:55.677 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:12:55.677 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:12:55.678 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:12:55.678 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:12:55.678 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:12:55.678 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:12:55.678 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:12:55.678 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:12:55.678 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:12:55.678 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:12:55.678 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:12:55.678 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:12:55.678 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:12:55.678 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:12:55.678 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:12:55.679 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:12:55.679 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:12:55.679 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:12:55.679 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:12:55.679 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:12:55.679 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:12:55.679 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:12:55.679 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:12:55.679 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:12:55.679 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:12:55.679 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:12:55.679 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:12:55.679 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:12:55.679 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:12:55.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:12:55.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:12:55.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:12:55.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:12:55.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:12:55.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:12:55.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:12:55.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:12:55.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:12:55.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:12:55.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:12:55.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:12:55.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:12:55.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:12:55.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:12:55.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:12:55.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:12:55.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:12:55.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:12:55.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:12:55.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:12:55.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:12:55.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:12:55.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:12:55.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:12:55.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:12:55.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:12:55.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:12:55.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:12:55.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:12:55.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:12:55.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:12:55.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:12:55.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:12:55.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:12:55.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:12:55.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:12:55.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:12:55.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:12:55.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:12:55.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:12:55.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:12:55.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:12:55.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:12:55.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:12:55.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:12:55.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:12:55.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:12:55.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:12:55.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:12:55.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:12:55.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:12:55.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:12:55.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:12:55.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:12:55.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:12:55.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:12:55.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:12:55.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:12:55.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:12:55.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:12:55.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:12:55.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:12:55.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:12:55.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:12:55.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:12:55.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:12:55.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:12:55.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:12:55.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:12:55.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:12:55.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:12:55.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:12:55.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:12:55.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:12:55.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:12:55.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:12:55.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:12:55.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:12:55.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:12:55.686 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:12:55.686 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:12:55.686 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:12:55.686 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:12:55.686 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:12:55.686 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:12:55.686 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:12:55.686 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:12:55.686 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:12:55.686 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:12:55.686 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:12:55.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:12:55.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:12:55.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:12:55.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:12:55.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:12:55.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:12:55.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:12:55.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:12:55.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:12:55.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:12:55.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:12:55.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:12:55.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:12:55.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:12:55.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:12:55.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:12:55.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:12:55.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:12:55.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:12:55.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:12:55.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:12:55.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:12:55.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:12:55.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:12:55.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:12:55.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:12:55.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:12:55.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:12:55.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:12:55.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:12:55.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:12:55.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:12:55.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:12:55.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:12:55.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:12:55.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:12:55.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:12:55.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:12:55.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:12:55.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:12:55.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:12:55.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:12:55.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:12:55.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:12:55.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:12:55.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:12:55.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:12:55.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:12:55.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:12:55.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:12:55.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:12:55.691 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:12:55.691 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:12:55.691 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:12:55.691 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:12:55.691 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:12:55.691 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:12:55.691 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:12:55.691 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:12:55.691 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:12:55.691 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:12:55.691 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:12:55.691 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:12:55.691 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:12:55.692 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:12:55.692 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:12:55.692 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:12:55.692 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:12:55.692 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:12:55.692 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:12:55.692 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:12:55.692 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:12:55.692 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:12:55.692 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:12:55.692 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:12:55.692 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:12:55.692 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:12:55.693 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:12:55.693 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:12:55.693 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:12:55.693 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:12:55.693 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:12:55.693 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:12:55.693 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:12:55.693 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:12:55.693 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:12:55.693 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:12:55.693 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:12:55.693 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:12:55.694 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:12:55.694 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:12:55.694 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:12:55.694 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:12:55.694 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:12:55.694 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:12:55.694 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:12:55.694 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:12:55.694 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:12:55.694 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:12:55.694 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:12:55.694 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:12:55.694 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:12:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:12:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:12:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:12:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:12:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:12:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:12:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:12:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:12:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:12:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:12:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:12:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:12:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:12:55.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:12:55.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:12:55.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:12:55.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:12:55.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:12:55.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:12:55.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:12:55.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:12:55.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:12:55.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:12:55.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:12:55.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:12:55.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:12:55.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:12:55.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:12:55.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:12:55.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:12:55.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:12:55.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:12:55.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:12:55.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:12:55.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:12:55.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:12:55.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:12:55.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:12:55.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:12:55.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:12:55.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:12:55.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:12:55.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:12:55.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:12:55.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:12:55.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:12:55.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:12:55.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:12:55.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:12:55.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:12:55.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:12:55.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:12:55.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:12:55.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:12:55.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:12:55.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:12:55.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:12:55.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:12:55.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:12:55.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:12:55.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:12:55.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:12:55.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:12:55.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:12:55.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:12:55.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:12:55.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:12:55.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:12:55.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:12:55.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:12:55.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:12:55.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:12:55.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:12:55.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:12:55.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:12:55.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:12:55.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:12:55.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:12:55.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:12:55.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:12:55.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:12:55.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:12:55.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:12:55.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:12:55.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:12:55.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:12:55.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:12:55.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:12:55.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:12:55.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:12:55.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:12:55.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:12:55.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:12:55.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:12:55.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:12:55.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:12:55.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:12:55.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:12:55.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:12:55.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:12:55.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:12:55.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:12:55.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:12:55.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:12:55.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:12:55.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:12:55.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:12:55.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:12:55.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:12:55.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:12:55.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:12:55.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:12:55.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:12:55.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:12:55.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:12:55.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:12:55.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:12:55.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:12:55.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:12:55.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:12:55.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:12:55.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:12:55.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:12:55.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:12:55.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:12:55.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:12:55.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:12:55.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:12:55.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:12:55.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:12:55.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:12:55.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:12:55.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:12:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:12:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:12:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:12:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:12:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:12:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:12:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:12:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:12:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:12:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:12:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:12:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:12:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:12:55.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:12:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:12:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:12:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:12:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:12:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:12:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:12:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:12:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:12:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:12:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:12:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:12:55.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:12:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:12:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:12:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:12:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:12:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:12:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:12:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:12:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:12:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:12:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:12:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:12:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:12:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:12:55.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:12:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:12:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:12:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:12:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:12:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:12:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:12:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:12:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:12:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:12:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:12:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:12:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:12:55.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:12:55.709 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:12:55.709 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:12:55.709 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:12:55.709 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:12:55.709 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:12:55.709 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:12:55.709 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:12:55.709 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:12:55.709 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:12:55.709 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:12:55.709 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:12:55.709 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:12:55.709 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:12:55.709 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:12:55.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:12:55.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:12:55.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:12:55.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:12:55.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:12:55.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:12:55.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:12:55.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:12:55.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:12:55.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:12:55.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:12:55.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:12:55.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:12:55.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:12:55.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:12:55.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:12:55.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:12:55.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:12:55.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:12:55.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:12:55.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:12:55.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:12:55.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:12:55.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:12:55.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:12:55.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:12:55.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:12:55.712 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:12:55.712 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:12:55.712 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:12:55.712 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:12:55.712 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:12:55.712 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:12:55.712 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:12:55.712 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:12:55.712 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:12:55.712 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:12:55.712 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:12:55.712 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:12:55.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:12:55.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:12:55.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:12:55.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:12:55.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:12:55.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:12:55.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:12:55.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:12:55.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:12:55.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:12:55.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:12:55.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:12:55.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:12:55.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:12:55.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:12:55.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:12:55.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:12:55.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:12:55.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:12:55.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:12:55.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:12:55.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:12:55.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:12:55.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:12:55.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:12:55.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:12:55.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:12:55.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:12:55.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:12:55.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:12:55.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:12:55.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:12:55.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:12:55.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:12:55.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:12:55.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:12:55.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:12:55.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:12:55.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:12:55.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:12:55.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:12:55.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:12:55.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:12:55.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:12:55.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:12:55.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:12:55.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:12:55.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:12:55.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:12:55.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:12:55.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:12:55.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:12:55.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:12:55.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:12:55.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:12:55.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:12:55.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:12:55.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:12:55.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:12:55.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:12:55.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:12:55.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:12:55.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:12:55.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:12:55.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:12:55.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:12:55.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:12:55.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:12:55.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:12:55.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:12:55.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:12:55.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:12:55.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:12:55.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:12:55.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:12:55.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:12:55.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:12:55.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:12:55.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:12:55.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:12:55.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:12:55.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:12:55.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:12:55.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:12:55.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:12:55.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:12:55.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:12:55.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:12:55.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:12:55.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:12:55.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:12:55.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:12:55.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:12:55.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:12:55.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:12:55.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:12:55.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:12:55.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:12:55.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:12:55.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:12:55.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:12:55.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:12:55.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:12:55.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:12:55.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:12:55.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:12:55.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:12:55.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:12:55.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:12:55.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:12:55.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:12:55.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:12:55.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:12:55.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:12:55.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:12:55.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:12:55.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:12:55.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:12:55.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:12:55.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:12:55.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:12:55.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:12:55.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:12:55.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:12:55.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:12:55.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:12:55.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:12:55.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:12:55.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:12:55.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:12:55.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:12:55.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:12:55.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:12:55.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:12:55.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:12:55.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:12:55.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:12:55.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:12:55.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:12:55.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:12:55.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:12:55.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:12:55.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:12:55.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:12:55.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:12:55.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:12:55.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:12:55.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:12:55.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:12:55.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:12:55.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:12:55.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:12:55.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:12:55.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:12:55.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:12:55.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:12:55.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:12:55.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:12:55.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:12:55.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:12:55.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:12:55.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:12:55.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:12:55.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:12:55.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:12:55.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:12:55.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:12:55.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:12:55.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:12:55.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:12:55.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:12:55.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:12:55.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:12:55.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:12:55.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:12:55.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:12:55.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:12:55.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:12:55.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:12:55.726 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:12:55.726 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:12:55.726 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:12:55.726 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:12:55.726 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:12:55.726 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:12:55.726 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:12:55.726 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:12:55.726 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:12:55.726 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:12:55.726 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:12:55.726 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:12:55.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:12:55.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:12:55.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:12:55.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:12:55.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:12:55.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:12:55.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:12:55.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:12:55.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:12:55.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:12:55.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:12:55.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:12:55.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:12:55.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:12:55.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:12:55.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:12:55.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:12:55.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:12:55.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:12:55.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:12:55.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:12:55.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:12:55.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:12:55.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:12:55.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:12:55.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:12:55.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:12:55.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:12:55.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:12:55.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:12:55.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:12:55.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:12:55.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:12:55.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:12:55.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:12:55.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:12:55.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:12:55.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:12:55.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:12:55.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:12:55.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:12:55.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:12:55.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:12:55.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:12:55.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:12:55.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:12:55.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:12:55.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:12:55.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:12:55.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:12:55.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:12:55.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:12:55.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:12:55.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:12:55.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:12:55.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:12:55.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:12:55.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:12:55.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:12:55.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:12:55.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:12:55.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:12:55.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:12:55.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:12:55.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:12:55.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:12:55.735 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:12:55.735 DEBUG:teuthology.orchestra.run.smithi002:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:12:55.759 INFO:teuthology.orchestra.run.smithi002.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:12:55.759 INFO:teuthology.orchestra.run.smithi002.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:12:55.759 INFO:teuthology.orchestra.run.smithi002.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:12:55.759 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2024-08-17T02:12:55.759 INFO:teuthology.orchestra.run.smithi002.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:12:55.759 INFO:teuthology.orchestra.run.smithi002.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:12:55.759 INFO:teuthology.orchestra.run.smithi002.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:12:55.759 INFO:teuthology.orchestra.run.smithi002.stdout: fi 2024-08-17T02:12:55.760 INFO:teuthology.orchestra.run.smithi002.stdout:done 2024-08-17T02:12:55.760 INFO:teuthology.orchestra.run.smithi002.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:12:55.760 INFO:teuthology.orchestra.run.smithi002.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:12:55.760 INFO:teuthology.orchestra.run.smithi002.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:12:55.760 INFO:teuthology.orchestra.run.smithi002.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:12:55.760 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2024-08-17T02:12:55.760 INFO:teuthology.orchestra.run.smithi002.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:12:55.760 INFO:teuthology.orchestra.run.smithi002.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:12:55.760 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2024-08-17T02:12:55.760 INFO:teuthology.orchestra.run.smithi002.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:12:55.760 INFO:teuthology.orchestra.run.smithi002.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:12:55.760 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:12:55.760 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2024-08-17T02:12:55.761 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -qi grub2-tools 2024-08-17T02:12:55.845 INFO:teuthology.orchestra.run.smithi002.stdout:Name : grub2-tools 2024-08-17T02:12:55.845 INFO:teuthology.orchestra.run.smithi002.stdout:Epoch : 1 2024-08-17T02:12:55.845 INFO:teuthology.orchestra.run.smithi002.stdout:Version : 2.06 2024-08-17T02:12:55.845 INFO:teuthology.orchestra.run.smithi002.stdout:Release : 68.el9 2024-08-17T02:12:55.845 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: x86_64 2024-08-17T02:12:55.845 INFO:teuthology.orchestra.run.smithi002.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:12:55.846 INFO:teuthology.orchestra.run.smithi002.stdout:Group : Unspecified 2024-08-17T02:12:55.846 INFO:teuthology.orchestra.run.smithi002.stdout:Size : 8264254 2024-08-17T02:12:55.846 INFO:teuthology.orchestra.run.smithi002.stdout:License : GPLv3+ 2024-08-17T02:12:55.846 INFO:teuthology.orchestra.run.smithi002.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:12:55.846 INFO:teuthology.orchestra.run.smithi002.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:12:55.846 INFO:teuthology.orchestra.run.smithi002.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:12:55.846 INFO:teuthology.orchestra.run.smithi002.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:12:55.846 INFO:teuthology.orchestra.run.smithi002.stdout:Packager : builder@centos.org 2024-08-17T02:12:55.846 INFO:teuthology.orchestra.run.smithi002.stdout:Vendor : CentOS 2024-08-17T02:12:55.846 INFO:teuthology.orchestra.run.smithi002.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:12:55.846 INFO:teuthology.orchestra.run.smithi002.stdout:Summary : Support tools for GRUB. 2024-08-17T02:12:55.846 INFO:teuthology.orchestra.run.smithi002.stdout:Description : 2024-08-17T02:12:55.846 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:12:55.846 INFO:teuthology.orchestra.run.smithi002.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:12:55.847 INFO:teuthology.orchestra.run.smithi002.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:12:55.847 INFO:teuthology.orchestra.run.smithi002.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:12:55.847 INFO:teuthology.orchestra.run.smithi002.stdout:hardware devices. 2024-08-17T02:12:55.847 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:12:55.847 INFO:teuthology.orchestra.run.smithi002.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:12:55.848 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:12:55.848 INFO:teuthology.task.kernel:Updating grub on smithi002 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:12:55.848 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:12:56.372 INFO:teuthology.orchestra.run.smithi002.stderr:Generating grub configuration file ... 2024-08-17T02:12:57.768 INFO:teuthology.orchestra.run.smithi002.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:12:57.811 INFO:teuthology.orchestra.run.smithi002.stderr:done 2024-08-17T02:12:57.812 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-08-17T02:12:57.829 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.tbM5NTd9W4 2024-08-17T02:12:57.830 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.tbM5NTd9W4 2024-08-17T02:12:57.905 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.tbM5NTd9W4 2024-08-17T02:12:58.042 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.tbM5NTd9W4 is 6KB 2024-08-17T02:12:58.091 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.tbM5NTd9W4 2024-08-17T02:12:58.106 DEBUG:teuthology.orchestra.run.smithi002:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:12:58.168 INFO:teuthology.orchestra.run.smithi002.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:12:58.168 INFO:teuthology.orchestra.run.smithi002.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:12:58.168 INFO:teuthology.orchestra.run.smithi002.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:12:58.168 INFO:teuthology.orchestra.run.smithi002.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:12:58.169 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:12:58.293 DEBUG:teuthology.orchestra.run.smithi002:> sudo shutdown -r now 2024-08-17T02:13:10.914 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-08-17T02:13:10.915 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-08-17T02:13:10.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:13:28.314 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-08-17T02:13:28.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-08-17T02:13:28.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:13:29.438 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-08-17T02:13:38.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-08-17T02:13:38.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:13:41.502 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-08-17T02:13:46.847 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.2 2024-08-17T02:13:53.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-08-17T02:13:53.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:13:55.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-08-17T02:13:55.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:14:25.437 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-08-17T02:14:26.046 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-08-17T02:14:26.046 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:14:26.046 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2024-08-17T02:14:26.080 INFO:teuthology.orchestra.run.smithi145.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:26.081 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:26.081 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:14:26.081 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:14:27.082 DEBUG:teuthology.parallel:result is None 2024-08-17T02:14:55.853 DEBUG:teuthology.orchestra.remote:timed out 2024-08-17T02:15:07.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-08-17T02:15:07.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:08.147 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-08-17T02:15:08.660 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-08-17T02:15:08.660 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:15:08.660 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-08-17T02:15:08.697 INFO:teuthology.orchestra.run.smithi002.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:08.698 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:08.698 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:15:08.698 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:15:09.701 DEBUG:teuthology.parallel:result is None 2024-08-17T02:15:09.701 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-17T02:15:09.708 INFO:teuthology.task.internal:Creating test directory... 2024-08-17T02:15:09.708 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:15:09.713 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:15:09.754 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-17T02:15:09.761 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-17T02:15:09.771 INFO:teuthology.task.internal:Creating archive directory... 2024-08-17T02:15:09.771 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:15:09.791 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:15:09.851 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-17T02:15:09.857 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-17T02:15:09.857 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:15:09.861 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:15:09.956 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:15:09.988 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:15:09.999 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:15:10.027 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:15:10.030 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-17T02:15:10.037 INFO:teuthology.task.internal:Configuring sudo... 2024-08-17T02:15:10.037 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:15:10.041 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:15:10.096 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-17T02:15:10.106 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-17T02:15:10.106 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:15:10.110 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:15:10.145 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:15:10.244 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:15:10.327 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:15:10.391 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:15:10.462 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:15:10.462 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:15:10.516 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:15:10.574 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:15:10.654 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:15:10.715 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:15:10.788 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-08-17T02:15:10.788 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:15:10.842 DEBUG:teuthology.orchestra.run.smithi002:> sudo service rsyslog restart 2024-08-17T02:15:10.847 DEBUG:teuthology.orchestra.run.smithi145:> sudo service rsyslog restart 2024-08-17T02:15:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:15:10.969 INFO:teuthology.orchestra.run.smithi145.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:15:11.376 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-17T02:15:11.383 INFO:teuthology.task.internal:Starting timer... 2024-08-17T02:15:11.383 INFO:teuthology.run_tasks:Running task pcp... 2024-08-17T02:15:11.397 INFO:teuthology.run_tasks:Running task selinux... 2024-08-17T02:15:11.407 DEBUG:teuthology.orchestra.run.smithi002:> sudo service auditd rotate 2024-08-17T02:15:11.492 INFO:teuthology.orchestra.run.smithi002.stdout:Rotating logs: 2024-08-17T02:15:11.495 DEBUG:teuthology.orchestra.run.smithi145:> sudo service auditd rotate 2024-08-17T02:15:11.590 INFO:teuthology.orchestra.run.smithi145.stdout:Rotating logs: 2024-08-17T02:15:11.594 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-17T02:15:11.594 DEBUG:teuthology.orchestra.run.smithi002:> /usr/sbin/getenforce 2024-08-17T02:15:11.645 INFO:teuthology.orchestra.run.smithi002.stdout:Permissive 2024-08-17T02:15:11.646 DEBUG:teuthology.orchestra.run.smithi145:> /usr/sbin/getenforce 2024-08-17T02:15:11.684 INFO:teuthology.orchestra.run.smithi145.stdout:Permissive 2024-08-17T02:15:11.684 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi002.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi145.front.sepia.ceph.com': 'permissive'} 2024-08-17T02:15:11.685 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:15:11.742 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:15:11.742 DEBUG:teuthology.orchestra.run.smithi145:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:15:11.802 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:15:11.802 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-17T02:15:11.803 DEBUG:teuthology.orchestra.run.smithi002:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:15:11.859 DEBUG:teuthology.orchestra.run.smithi145:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:15:11.922 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-17T02:15:11.932 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-17T02:15:11.945 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-17T02:15:11.946 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi002.front.sepia.ceph.com,smithi145.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-17T02:20:51.507 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi002.front.sepia.ceph.com'), Remote(name='ubuntu@smithi145.front.sepia.ceph.com')] 2024-08-17T02:20:51.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-08-17T02:20:51.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:20:51.601 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-08-17T02:20:51.709 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-08-17T02:20:51.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-08-17T02:20:51.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:20:51.799 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-08-17T02:20:51.917 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-08-17T02:20:51.917 INFO:teuthology.run_tasks:Running task clock... 2024-08-17T02:20:51.928 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-17T02:20:51.928 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:20:51.929 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:20:51.934 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:20:51.934 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:20:51.995 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:20:52.017 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:20:52.025 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:20:52.047 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:20:52.077 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: ntpd: command not found 2024-08-17T02:20:52.098 INFO:teuthology.orchestra.run.smithi145.stderr:sudo: ntpd: command not found 2024-08-17T02:20:52.101 INFO:teuthology.orchestra.run.smithi002.stdout:506 Cannot talk to daemon 2024-08-17T02:20:52.122 INFO:teuthology.orchestra.run.smithi145.stdout:506 Cannot talk to daemon 2024-08-17T02:20:52.130 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:20:52.151 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:20:52.159 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:20:52.180 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:20:52.251 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:20:52.258 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:20:52.258 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-08-17T02:20:52.258 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:20:52.258 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:20:52.258 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:20:52.258 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:20:52.272 INFO:teuthology.orchestra.run.smithi145.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:20:52.279 INFO:teuthology.orchestra.run.smithi145.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:20:52.279 INFO:teuthology.orchestra.run.smithi145.stdout:=============================================================================== 2024-08-17T02:20:52.279 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:20:52.279 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:20:52.279 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:20:52.279 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:20:52.280 INFO:teuthology.run_tasks:Running task install... 2024-08-17T02:20:52.289 DEBUG:teuthology.task.install:project ceph 2024-08-17T02:20:52.289 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}} 2024-08-17T02:20:52.290 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'} 2024-08-17T02:20:52.290 INFO:teuthology.task.install:Using flavor: default 2024-08-17T02:20:52.295 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-17T02:20:52.296 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-08-17T02:20:52.296 DEBUG:teuthology.orchestra.run.smithi002:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:20:52.297 DEBUG:teuthology.orchestra.run.smithi145:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:20:53.001 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:23 ago on Sat 17 Aug 2024 02:19:29 AM UTC. 2024-08-17T02:20:53.018 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:16 ago on Sat 17 Aug 2024 02:19:36 AM UTC. 2024-08-17T02:20:53.091 INFO:teuthology.orchestra.run.smithi145.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:20:53.108 INFO:teuthology.orchestra.run.smithi002.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:20:53.133 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-08-17T02:20:53.134 INFO:teuthology.orchestra.run.smithi145.stdout:Nothing to do. 2024-08-17T02:20:53.134 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-08-17T02:20:53.153 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-08-17T02:20:53.154 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-08-17T02:20:53.154 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-08-17T02:20:53.210 DEBUG:teuthology.orchestra.run.smithi145:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:20:53.228 DEBUG:teuthology.orchestra.run.smithi002:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:20:53.464 INFO:teuthology.orchestra.run.smithi145.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:20:53.464 INFO:teuthology.orchestra.run.smithi145.stderr:of the main distribution, and quality may vary. 2024-08-17T02:20:53.464 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-08-17T02:20:53.464 INFO:teuthology.orchestra.run.smithi145.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:20:53.464 INFO:teuthology.orchestra.run.smithi145.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:20:53.465 INFO:teuthology.orchestra.run.smithi145.stderr:, 2024-08-17T02:20:53.465 INFO:teuthology.orchestra.run.smithi145.stderr:and packages are not held to any quality or security level. 2024-08-17T02:20:53.465 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-08-17T02:20:53.465 INFO:teuthology.orchestra.run.smithi145.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:20:53.465 INFO:teuthology.orchestra.run.smithi145.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:20:53.486 INFO:teuthology.orchestra.run.smithi002.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:20:53.486 INFO:teuthology.orchestra.run.smithi002.stderr:of the main distribution, and quality may vary. 2024-08-17T02:20:53.487 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-08-17T02:20:53.487 INFO:teuthology.orchestra.run.smithi002.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:20:53.487 INFO:teuthology.orchestra.run.smithi002.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:20:53.487 INFO:teuthology.orchestra.run.smithi002.stderr:, 2024-08-17T02:20:53.487 INFO:teuthology.orchestra.run.smithi002.stderr:and packages are not held to any quality or security level. 2024-08-17T02:20:53.487 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-08-17T02:20:53.487 INFO:teuthology.orchestra.run.smithi002.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:20:53.487 INFO:teuthology.orchestra.run.smithi002.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:20:53.560 INFO:teuthology.orchestra.run.smithi145.stdout:Repository successfully enabled. 2024-08-17T02:20:53.569 INFO:teuthology.orchestra.run.smithi002.stdout:Repository successfully enabled. 2024-08-17T02:20:53.607 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:20:53.607 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:20:53.615 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:20:53.615 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:20:53.753 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:20:53.753 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:20:53.760 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:20:53.761 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:20:53.866 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:20:53.869 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-08-17T02:20:53.869 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:20:53.874 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:20:53.875 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:20:53.875 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:20:53.924 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:20:53.925 DEBUG:teuthology.orchestra.run.smithi145:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:20:53.932 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:20:53.933 DEBUG:teuthology.orchestra.run.smithi002:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:20:54.022 DEBUG:teuthology.orchestra.run.smithi145:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:20:54.029 DEBUG:teuthology.orchestra.run.smithi002:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:20:54.101 DEBUG:teuthology.orchestra.run.smithi145:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:20:54.108 DEBUG:teuthology.orchestra.run.smithi002:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:20:54.156 INFO:teuthology.orchestra.run.smithi145.stdout:check_obsoletes = 1 2024-08-17T02:20:54.159 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum clean all 2024-08-17T02:20:54.163 INFO:teuthology.orchestra.run.smithi002.stdout:check_obsoletes = 1 2024-08-17T02:20:54.166 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum clean all 2024-08-17T02:20:54.433 INFO:teuthology.orchestra.run.smithi145.stdout:45 files removed 2024-08-17T02:20:54.445 INFO:teuthology.orchestra.run.smithi002.stdout:45 files removed 2024-08-17T02:20:54.466 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:20:54.478 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:20:55.174 INFO:teuthology.orchestra.run.smithi145.stdout:ceph packages for x86_64 231 kB/s | 77 kB 00:00 2024-08-17T02:20:55.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph packages for x86_64 232 kB/s | 77 kB 00:00 2024-08-17T02:20:55.524 INFO:teuthology.orchestra.run.smithi145.stdout:ceph noarch packages 35 kB/s | 11 kB 00:00 2024-08-17T02:20:55.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph noarch packages 34 kB/s | 11 kB 00:00 2024-08-17T02:20:55.866 INFO:teuthology.orchestra.run.smithi145.stdout:ceph source packages 5.8 kB/s | 1.8 kB 00:00 2024-08-17T02:20:55.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph source packages 6.2 kB/s | 1.8 kB 00:00 2024-08-17T02:20:56.101 INFO:teuthology.orchestra.run.smithi145.stdout:Copr repo for el9 owned by ceph 38 kB/s | 7.6 kB 00:00 2024-08-17T02:20:56.102 INFO:teuthology.orchestra.run.smithi002.stdout:Copr repo for el9 owned by ceph 40 kB/s | 7.6 kB 00:00 2024-08-17T02:20:56.951 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.2 MB 00:00 2024-08-17T02:20:57.919 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.2 MB 00:01 2024-08-17T02:20:58.902 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-08-17T02:21:00.012 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-08-17T02:21:03.719 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 6.6 MB 00:00 2024-08-17T02:21:05.279 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 18 kB 00:00 2024-08-17T02:21:06.183 INFO:teuthology.orchestra.run.smithi145.stdout:Extra Packages for Enterprise Linux 29 MB/s | 22 MB 00:00 2024-08-17T02:21:06.804 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.6 MB 00:02 2024-08-17T02:21:08.622 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 18 kB 00:00 2024-08-17T02:21:09.584 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 27 MB/s | 22 MB 00:00 2024-08-17T02:21:12.430 INFO:teuthology.orchestra.run.smithi145.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-08-17T02:21:14.958 INFO:teuthology.orchestra.run.smithi145.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:21:14.959 INFO:teuthology.orchestra.run.smithi145.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:21:14.970 INFO:teuthology.orchestra.run.smithi145.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:21:14.970 INFO:teuthology.orchestra.run.smithi145.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:21:14.971 INFO:teuthology.orchestra.run.smithi145.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:21:14.972 INFO:teuthology.orchestra.run.smithi145.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:21:14.973 INFO:teuthology.orchestra.run.smithi145.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:21:14.976 INFO:teuthology.orchestra.run.smithi145.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:21:14.977 INFO:teuthology.orchestra.run.smithi145.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:21:15.036 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-08-17T02:21:15.055 INFO:teuthology.orchestra.run.smithi145.stdout:======================================================================================= 2024-08-17T02:21:15.055 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-08-17T02:21:15.055 INFO:teuthology.orchestra.run.smithi145.stdout:======================================================================================= 2024-08-17T02:21:15.055 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-08-17T02:21:15.055 INFO:teuthology.orchestra.run.smithi145.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:21:15.056 INFO:teuthology.orchestra.run.smithi145.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:21:15.056 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:21:15.056 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:21:15.056 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:21:15.056 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:21:15.056 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:21:15.056 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:21:15.056 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:21:15.056 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:21:15.056 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:21:15.056 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:21:15.057 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:21:15.057 INFO:teuthology.orchestra.run.smithi145.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:21:15.057 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:21:15.057 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:21:15.057 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:21:15.057 INFO:teuthology.orchestra.run.smithi145.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:21:15.057 INFO:teuthology.orchestra.run.smithi145.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:21:15.057 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:21:15.057 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:21:15.057 INFO:teuthology.orchestra.run.smithi145.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:21:15.057 INFO:teuthology.orchestra.run.smithi145.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:21:15.057 INFO:teuthology.orchestra.run.smithi145.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:21:15.058 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:21:15.058 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:21:15.058 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:21:15.058 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:21:15.058 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:21:15.058 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:21:15.058 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:21:15.058 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:21:15.058 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:21:15.058 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrading: 2024-08-17T02:21:15.058 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:21:15.059 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:21:15.059 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:21:15.059 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:21:15.059 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:21:15.059 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:21:15.059 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:21:15.059 INFO:teuthology.orchestra.run.smithi145.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:21:15.059 INFO:teuthology.orchestra.run.smithi145.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:21:15.059 INFO:teuthology.orchestra.run.smithi145.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:21:15.059 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:21:15.059 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:21:15.059 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-08-17T02:21:15.060 INFO:teuthology.orchestra.run.smithi145.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:21:15.060 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:21:15.060 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:21:15.060 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:21:15.060 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:21:15.060 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:21:15.060 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:21:15.060 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:21:15.061 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:21:15.061 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:21:15.061 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:21:15.061 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:21:15.061 INFO:teuthology.orchestra.run.smithi145.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:21:15.061 INFO:teuthology.orchestra.run.smithi145.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:21:15.061 INFO:teuthology.orchestra.run.smithi145.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:21:15.061 INFO:teuthology.orchestra.run.smithi145.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:21:15.061 INFO:teuthology.orchestra.run.smithi145.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:21:15.061 INFO:teuthology.orchestra.run.smithi145.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:21:15.061 INFO:teuthology.orchestra.run.smithi145.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:21:15.061 INFO:teuthology.orchestra.run.smithi145.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:21:15.062 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:21:15.062 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:21:15.062 INFO:teuthology.orchestra.run.smithi145.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:21:15.062 INFO:teuthology.orchestra.run.smithi145.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:21:15.062 INFO:teuthology.orchestra.run.smithi145.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:21:15.062 INFO:teuthology.orchestra.run.smithi145.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:21:15.062 INFO:teuthology.orchestra.run.smithi145.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:21:15.062 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:21:15.062 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:21:15.062 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:21:15.062 INFO:teuthology.orchestra.run.smithi145.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:21:15.062 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:21:15.063 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:21:15.063 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:21:15.063 INFO:teuthology.orchestra.run.smithi145.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:21:15.063 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:21:15.063 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:21:15.063 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:21:15.063 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:21:15.063 INFO:teuthology.orchestra.run.smithi145.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:21:15.063 INFO:teuthology.orchestra.run.smithi145.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:21:15.063 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:21:15.063 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:21:15.063 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:21:15.063 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:21:15.064 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:21:15.064 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:21:15.064 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:21:15.064 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:21:15.064 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:21:15.064 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:21:15.064 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:21:15.064 INFO:teuthology.orchestra.run.smithi145.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:21:15.064 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:21:15.064 INFO:teuthology.orchestra.run.smithi145.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:21:15.064 INFO:teuthology.orchestra.run.smithi145.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:21:15.064 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:21:15.064 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:21:15.065 INFO:teuthology.orchestra.run.smithi145.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:21:15.065 INFO:teuthology.orchestra.run.smithi145.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:21:15.065 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:21:15.065 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:21:15.065 INFO:teuthology.orchestra.run.smithi145.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:21:15.065 INFO:teuthology.orchestra.run.smithi145.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:21:15.065 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:21:15.065 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:21:15.065 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:21:15.065 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:21:15.065 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:21:15.065 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:21:15.065 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:21:15.066 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:21:15.066 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:21:15.066 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:21:15.066 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:21:15.066 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:21:15.066 INFO:teuthology.orchestra.run.smithi145.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:21:15.066 INFO:teuthology.orchestra.run.smithi145.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:21:15.066 INFO:teuthology.orchestra.run.smithi145.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:21:15.066 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:21:15.066 INFO:teuthology.orchestra.run.smithi145.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:21:15.066 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:21:15.066 INFO:teuthology.orchestra.run.smithi145.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:21:15.067 INFO:teuthology.orchestra.run.smithi145.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:21:15.067 INFO:teuthology.orchestra.run.smithi145.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:21:15.067 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:21:15.067 INFO:teuthology.orchestra.run.smithi145.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:21:15.067 INFO:teuthology.orchestra.run.smithi145.stdout:Installing weak dependencies: 2024-08-17T02:21:15.067 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:21:15.067 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:21:15.067 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-08-17T02:21:15.067 INFO:teuthology.orchestra.run.smithi145.stdout:======================================================================================= 2024-08-17T02:21:15.067 INFO:teuthology.orchestra.run.smithi145.stdout:Install 121 Packages 2024-08-17T02:21:15.067 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrade 12 Packages 2024-08-17T02:21:15.067 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:21:15.068 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 206 M 2024-08-17T02:21:15.068 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-08-17T02:21:15.664 INFO:teuthology.orchestra.run.smithi145.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 32 kB/s | 6.5 kB 00:00 2024-08-17T02:21:15.865 INFO:teuthology.orchestra.run.smithi145.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 4.0 MB/s | 813 kB 00:00 2024-08-17T02:21:15.948 INFO:teuthology.orchestra.run.smithi145.stdout:(3/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 10 MB/s | 5.0 MB 00:00 2024-08-17T02:21:15.999 INFO:teuthology.orchestra.run.smithi145.stdout:(4/133): ceph-immutable-object-cache-17.2.7-137 1.0 MB/s | 137 kB 00:00 2024-08-17T02:21:16.065 INFO:teuthology.orchestra.run.smithi145.stdout:(5/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 18 MB/s | 2.1 MB 00:00 2024-08-17T02:21:16.174 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-08-17T02:21:16.191 INFO:teuthology.orchestra.run.smithi145.stdout:(6/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 7.3 MB/s | 1.4 MB 00:00 2024-08-17T02:21:16.266 INFO:teuthology.orchestra.run.smithi145.stdout:(7/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 20 MB/s | 3.9 MB 00:00 2024-08-17T02:21:16.883 INFO:teuthology.orchestra.run.smithi145.stdout:(8/133): ceph-common-17.2.7-1375.g2577e813.el9. 16 MB/s | 22 MB 00:01 2024-08-17T02:21:16.950 INFO:teuthology.orchestra.run.smithi145.stdout:(9/133): ceph-selinux-17.2.7-1375.g2577e813.el9 377 kB/s | 25 kB 00:00 2024-08-17T02:21:17.134 INFO:teuthology.orchestra.run.smithi145.stdout:(10/133): ceph-radosgw-17.2.7-1375.g2577e813.el 16 MB/s | 14 MB 00:00 2024-08-17T02:21:17.184 INFO:teuthology.orchestra.run.smithi145.stdout:(11/133): cephfs-mirror-17.2.7-1375.g2577e813.e 4.2 MB/s | 215 kB 00:00 2024-08-17T02:21:17.242 INFO:teuthology.orchestra.run.smithi145.stdout:(12/133): libcephfs-devel-17.2.7-1375.g2577e813 428 kB/s | 25 kB 00:00 2024-08-17T02:21:17.318 INFO:teuthology.orchestra.run.smithi145.stdout:(13/133): libcephfs2-17.2.7-1375.g2577e813.el9. 8.3 MB/s | 636 kB 00:00 2024-08-17T02:21:17.385 INFO:teuthology.orchestra.run.smithi145.stdout:(14/133): libcephsqlite-17.2.7-1375.g2577e813.e 2.4 MB/s | 163 kB 00:00 2024-08-17T02:21:17.443 INFO:teuthology.orchestra.run.smithi145.stdout:(15/133): librados-devel-17.2.7-1375.g2577e813. 2.1 MB/s | 126 kB 00:00 2024-08-17T02:21:17.510 INFO:teuthology.orchestra.run.smithi145.stdout:(16/133): libradosstriper1-17.2.7-1375.g2577e81 6.7 MB/s | 458 kB 00:00 2024-08-17T02:21:17.794 INFO:teuthology.orchestra.run.smithi145.stdout:(17/133): librgw2-17.2.7-1375.g2577e813.el9.x86 17 MB/s | 4.9 MB 00:00 2024-08-17T02:21:17.988 INFO:teuthology.orchestra.run.smithi145.stdout:(18/133): ceph-osd-17.2.7-1375.g2577e813.el9.x8 8.5 MB/s | 15 MB 00:01 2024-08-17T02:21:18.019 INFO:teuthology.orchestra.run.smithi145.stdout:(19/133): python3-ceph-argparse-17.2.7-1375.g25 200 kB/s | 45 kB 00:00 2024-08-17T02:21:18.036 INFO:teuthology.orchestra.run.smithi145.stdout:(20/133): python3-ceph-common-17.2.7-1375.g2577 2.5 MB/s | 120 kB 00:00 2024-08-17T02:21:18.078 INFO:teuthology.orchestra.run.smithi145.stdout:(21/133): python3-cephfs-17.2.7-1375.g2577e813. 3.0 MB/s | 182 kB 00:00 2024-08-17T02:21:18.112 INFO:teuthology.orchestra.run.smithi145.stdout:(22/133): python3-rados-17.2.7-1375.g2577e813.e 4.8 MB/s | 369 kB 00:00 2024-08-17T02:21:18.154 INFO:teuthology.orchestra.run.smithi145.stdout:(23/133): python3-rbd-17.2.7-1375.g2577e813.el9 4.5 MB/s | 344 kB 00:00 2024-08-17T02:21:18.179 INFO:teuthology.orchestra.run.smithi145.stdout:(24/133): python3-rgw-17.2.7-1375.g2577e813.el9 1.7 MB/s | 116 kB 00:00 2024-08-17T02:21:18.205 INFO:teuthology.orchestra.run.smithi145.stdout:(25/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 1.6 MB/s | 82 kB 00:00 2024-08-17T02:21:18.255 INFO:teuthology.orchestra.run.smithi145.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 3.2 MB/s | 165 kB 00:00 2024-08-17T02:21:18.322 INFO:teuthology.orchestra.run.smithi145.stdout:(27/133): ceph-grafana-dashboards-17.2.7-1375.g 367 kB/s | 24 kB 00:00 2024-08-17T02:21:18.389 INFO:teuthology.orchestra.run.smithi145.stdout:(28/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 1.8 MB/s | 124 kB 00:00 2024-08-17T02:21:18.447 INFO:teuthology.orchestra.run.smithi145.stdout:(29/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 11 MB/s | 2.9 MB 00:00 2024-08-17T02:21:18.821 INFO:teuthology.orchestra.run.smithi002.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:21:18.821 INFO:teuthology.orchestra.run.smithi002.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:21:18.833 INFO:teuthology.orchestra.run.smithi002.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:21:18.834 INFO:teuthology.orchestra.run.smithi002.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:21:18.835 INFO:teuthology.orchestra.run.smithi002.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:21:18.836 INFO:teuthology.orchestra.run.smithi002.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:21:18.837 INFO:teuthology.orchestra.run.smithi002.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:21:18.840 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:21:18.841 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:21:18.906 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-08-17T02:21:18.924 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-08-17T02:21:18.925 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-08-17T02:21:18.925 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-08-17T02:21:18.925 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-08-17T02:21:18.925 INFO:teuthology.orchestra.run.smithi002.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:21:18.925 INFO:teuthology.orchestra.run.smithi002.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:21:18.925 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:21:18.925 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:21:18.925 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:21:18.925 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:21:18.926 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:21:18.926 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:21:18.926 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:21:18.926 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:21:18.926 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:21:18.926 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:21:18.926 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:21:18.926 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:21:18.926 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:21:18.926 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:21:18.927 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:21:18.927 INFO:teuthology.orchestra.run.smithi002.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:21:18.927 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:21:18.927 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:21:18.927 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:21:18.927 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:21:18.927 INFO:teuthology.orchestra.run.smithi002.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:21:18.927 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:21:18.927 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:21:18.927 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:21:18.927 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:21:18.928 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:21:18.928 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:21:18.928 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:21:18.928 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:21:18.928 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:21:18.928 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:21:18.928 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2024-08-17T02:21:18.928 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:21:18.928 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:21:18.928 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:21:18.929 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:21:18.929 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:21:18.929 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:21:18.929 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:21:18.929 INFO:teuthology.orchestra.run.smithi002.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:21:18.929 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:21:18.929 INFO:teuthology.orchestra.run.smithi002.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:21:18.929 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:21:18.931 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:21:18.931 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-08-17T02:21:18.931 INFO:teuthology.orchestra.run.smithi002.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:21:18.931 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:21:18.931 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:21:18.931 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:21:18.931 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:21:18.931 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:21:18.932 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:21:18.932 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:21:18.932 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:21:18.932 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:21:18.933 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:21:18.933 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:21:18.933 INFO:teuthology.orchestra.run.smithi002.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:21:18.933 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:21:18.933 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:21:18.933 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:21:18.933 INFO:teuthology.orchestra.run.smithi002.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:21:18.933 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:21:18.934 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:21:18.934 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:21:18.934 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:21:18.934 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:21:18.934 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:21:18.934 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:21:18.934 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:21:18.935 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:21:18.935 INFO:teuthology.orchestra.run.smithi002.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:21:18.935 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:21:18.935 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:21:18.935 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:21:18.935 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:21:18.936 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:21:18.936 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:21:18.936 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:21:18.937 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:21:18.937 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:21:18.937 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:21:18.938 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:21:18.938 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:21:18.938 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:21:18.938 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:21:18.938 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:21:18.938 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:21:18.939 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:21:18.939 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:21:18.939 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:21:18.939 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:21:18.940 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:21:18.940 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:21:18.940 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:21:18.940 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:21:18.940 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:21:18.940 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:21:18.941 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:21:18.941 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:21:18.941 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:21:18.941 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:21:18.941 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:21:18.941 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:21:18.942 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:21:18.942 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:21:18.942 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:21:18.942 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:21:18.942 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:21:18.943 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:21:18.943 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:21:18.943 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:21:18.943 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:21:18.944 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:21:18.944 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:21:18.944 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:21:18.944 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:21:18.944 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:21:18.944 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:21:18.945 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:21:18.945 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:21:18.945 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:21:18.945 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:21:18.945 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:21:18.945 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:21:18.946 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:21:18.946 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:21:18.946 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:21:18.946 INFO:teuthology.orchestra.run.smithi002.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:21:18.947 INFO:teuthology.orchestra.run.smithi002.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:21:18.948 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:21:18.948 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:21:18.948 INFO:teuthology.orchestra.run.smithi002.stdout:Installing weak dependencies: 2024-08-17T02:21:18.948 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:21:18.948 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:21:18.948 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-08-17T02:21:18.948 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-08-17T02:21:18.948 INFO:teuthology.orchestra.run.smithi002.stdout:Install 121 Packages 2024-08-17T02:21:18.948 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 12 Packages 2024-08-17T02:21:18.948 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:21:18.949 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 206 M 2024-08-17T02:21:18.949 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-08-17T02:21:19.207 INFO:teuthology.orchestra.run.smithi145.stdout:(30/133): ceph-test-17.2.7-1375.g2577e813.el9.x 21 MB/s | 48 MB 00:02 2024-08-17T02:21:19.273 INFO:teuthology.orchestra.run.smithi145.stdout:(31/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 3.8 MB/s | 3.4 MB 00:00 2024-08-17T02:21:19.299 INFO:teuthology.orchestra.run.smithi145.stdout:(32/133): ceph-mgr-modules-core-17.2.7-1375.g25 2.6 MB/s | 240 kB 00:00 2024-08-17T02:21:19.324 INFO:teuthology.orchestra.run.smithi145.stdout:(33/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 951 kB/s | 47 kB 00:00 2024-08-17T02:21:19.344 INFO:teuthology.orchestra.run.smithi002.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 31 kB/s | 6.5 kB 00:00 2024-08-17T02:21:19.349 INFO:teuthology.orchestra.run.smithi145.stdout:(34/133): ceph-prometheus-alerts-17.2.7-1375.g2 292 kB/s | 15 kB 00:00 2024-08-17T02:21:19.400 INFO:teuthology.orchestra.run.smithi145.stdout:(35/133): ceph-volume-17.2.7-1375.g2577e813.el9 3.5 MB/s | 269 kB 00:00 2024-08-17T02:21:19.425 INFO:teuthology.orchestra.run.smithi145.stdout:(36/133): cephadm-17.2.7-1375.g2577e813.el9.noa 1.1 MB/s | 83 kB 00:00 2024-08-17T02:21:19.525 INFO:teuthology.orchestra.run.smithi145.stdout:(37/133): ceph-mgr-diskprediction-local-17.2.7- 6.9 MB/s | 7.4 MB 00:01 2024-08-17T02:21:19.551 INFO:teuthology.orchestra.run.smithi145.stdout:(38/133): cephfs-top-17.2.7-1375.g2577e813.el9. 121 kB/s | 18 kB 00:00 2024-08-17T02:21:19.651 INFO:teuthology.orchestra.run.smithi002.stdout:(2/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 9.6 MB/s | 5.0 MB 00:00 2024-08-17T02:21:19.709 INFO:teuthology.orchestra.run.smithi002.stdout:(3/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 2.2 MB/s | 813 kB 00:00 2024-08-17T02:21:19.726 INFO:teuthology.orchestra.run.smithi002.stdout:(4/133): ceph-immutable-object-cache-17.2.7-137 1.8 MB/s | 137 kB 00:00 2024-08-17T02:21:19.802 INFO:teuthology.orchestra.run.smithi002.stdout:(5/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 19 MB/s | 1.4 MB 00:00 2024-08-17T02:21:20.135 INFO:teuthology.orchestra.run.smithi002.stdout:(6/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 4.9 MB/s | 2.1 MB 00:00 2024-08-17T02:21:20.175 INFO:teuthology.orchestra.run.smithi145.stdout:(39/133): fuse-2.9.9-16.el9.x86_64.rpm 106 kB/s | 80 kB 00:00 2024-08-17T02:21:20.342 INFO:teuthology.orchestra.run.smithi145.stdout:(40/133): libquadmath-11.4.1-3.el9.x86_64.rpm 247 kB/s | 195 kB 00:00 2024-08-17T02:21:20.368 INFO:teuthology.orchestra.run.smithi002.stdout:(7/133): ceph-common-17.2.7-1375.g2577e813.el9. 18 MB/s | 22 MB 00:01 2024-08-17T02:21:20.436 INFO:teuthology.orchestra.run.smithi002.stdout:(8/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 6.2 MB/s | 3.9 MB 00:00 2024-08-17T02:21:20.484 INFO:teuthology.orchestra.run.smithi145.stdout:(41/133): libgfortran-11.4.1-3.el9.x86_64.rpm 837 kB/s | 803 kB 00:00 2024-08-17T02:21:20.485 INFO:teuthology.orchestra.run.smithi002.stdout:(9/133): ceph-selinux-17.2.7-1375.g2577e813.el9 508 kB/s | 25 kB 00:00 2024-08-17T02:21:21.001 INFO:teuthology.orchestra.run.smithi145.stdout:(42/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 307 kB/s | 253 kB 00:00 2024-08-17T02:21:21.086 INFO:teuthology.orchestra.run.smithi002.stdout:(10/133): ceph-radosgw-17.2.7-1375.g2577e813.el 20 MB/s | 14 MB 00:00 2024-08-17T02:21:21.136 INFO:teuthology.orchestra.run.smithi002.stdout:(11/133): cephfs-mirror-17.2.7-1375.g2577e813.e 4.2 MB/s | 215 kB 00:00 2024-08-17T02:21:21.168 INFO:teuthology.orchestra.run.smithi145.stdout:(43/133): python3-ply-3.11-14.el9.noarch.rpm 156 kB/s | 106 kB 00:00 2024-08-17T02:21:21.203 INFO:teuthology.orchestra.run.smithi002.stdout:(12/133): libcephfs-devel-17.2.7-1375.g2577e813 375 kB/s | 25 kB 00:00 2024-08-17T02:21:21.287 INFO:teuthology.orchestra.run.smithi002.stdout:(13/133): libcephfs2-17.2.7-1375.g2577e813.el9. 7.5 MB/s | 636 kB 00:00 2024-08-17T02:21:21.330 INFO:teuthology.orchestra.run.smithi145.stdout:(44/133): python3-cryptography-36.0.1-4.el9.x86 1.2 MB/s | 1.2 MB 00:00 2024-08-17T02:21:21.362 INFO:teuthology.orchestra.run.smithi002.stdout:(14/133): libcephsqlite-17.2.7-1375.g2577e813.e 2.1 MB/s | 163 kB 00:00 2024-08-17T02:21:21.429 INFO:teuthology.orchestra.run.smithi002.stdout:(15/133): librados-devel-17.2.7-1375.g2577e813. 1.9 MB/s | 126 kB 00:00 2024-08-17T02:21:21.495 INFO:teuthology.orchestra.run.smithi002.stdout:(16/133): libradosstriper1-17.2.7-1375.g2577e81 6.7 MB/s | 458 kB 00:00 2024-08-17T02:21:21.777 INFO:teuthology.orchestra.run.smithi145.stdout:(45/133): python3-pycparser-2.20-6.el9.noarch.r 174 kB/s | 135 kB 00:00 2024-08-17T02:21:21.787 INFO:teuthology.orchestra.run.smithi002.stdout:(17/133): librgw2-17.2.7-1375.g2577e813.el9.x86 17 MB/s | 4.9 MB 00:00 2024-08-17T02:21:21.838 INFO:teuthology.orchestra.run.smithi002.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 907 kB/s | 45 kB 00:00 2024-08-17T02:21:21.905 INFO:teuthology.orchestra.run.smithi002.stdout:(19/133): python3-ceph-common-17.2.7-1375.g2577 1.8 MB/s | 120 kB 00:00 2024-08-17T02:21:21.910 INFO:teuthology.orchestra.run.smithi145.stdout:(46/133): python3-requests-2.25.1-8.el9.noarch. 168 kB/s | 125 kB 00:00 2024-08-17T02:21:22.044 INFO:teuthology.orchestra.run.smithi145.stdout:(47/133): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-08-17T02:21:22.086 INFO:teuthology.orchestra.run.smithi145.stdout:(48/133): elfutils-libelf-devel-0.191-4.el9.x86 522 kB/s | 22 kB 00:00 2024-08-17T02:21:22.111 INFO:teuthology.orchestra.run.smithi145.stdout:(49/133): python3-urllib3-1.26.5-6.el9.noarch.r 274 kB/s | 215 kB 00:00 2024-08-17T02:21:22.145 INFO:teuthology.orchestra.run.smithi145.stdout:(50/133): flex-2.6.4-9.el9.x86_64.rpm 5.4 MB/s | 313 kB 00:00 2024-08-17T02:21:22.195 INFO:teuthology.orchestra.run.smithi145.stdout:(51/133): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-08-17T02:21:22.229 INFO:teuthology.orchestra.run.smithi145.stdout:(52/133): flexiblas-3.0.4-8.el9.x86_64.rpm 279 kB/s | 33 kB 00:00 2024-08-17T02:21:22.246 INFO:teuthology.orchestra.run.smithi145.stdout:(53/133): flexiblas-openblas-openmp-3.0.4-8.el9 361 kB/s | 18 kB 00:00 2024-08-17T02:21:22.280 INFO:teuthology.orchestra.run.smithi145.stdout:(54/133): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-08-17T02:21:22.305 INFO:teuthology.orchestra.run.smithi145.stdout:(55/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-08-17T02:21:22.355 INFO:teuthology.orchestra.run.smithi145.stdout:(56/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-08-17T02:21:22.380 INFO:teuthology.orchestra.run.smithi145.stdout:(57/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 452 kB/s | 45 kB 00:00 2024-08-17T02:21:22.413 INFO:teuthology.orchestra.run.smithi002.stdout:(20/133): ceph-test-17.2.7-1375.g2577e813.el9.x 25 MB/s | 48 MB 00:01 2024-08-17T02:21:22.414 INFO:teuthology.orchestra.run.smithi145.stdout:(58/133): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-08-17T02:21:22.438 INFO:teuthology.orchestra.run.smithi002.stdout:(21/133): python3-cephfs-17.2.7-1375.g2577e813. 341 kB/s | 182 kB 00:00 2024-08-17T02:21:22.439 INFO:teuthology.orchestra.run.smithi145.stdout:(59/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 434 kB/s | 25 kB 00:00 2024-08-17T02:21:22.472 INFO:teuthology.orchestra.run.smithi002.stdout:(22/133): python3-rados-17.2.7-1375.g2577e813.e 6.2 MB/s | 369 kB 00:00 2024-08-17T02:21:22.481 INFO:teuthology.orchestra.run.smithi145.stdout:(60/133): libtool-2.4.6-46.el9.x86_64.rpm 4.5 MB/s | 581 kB 00:00 2024-08-17T02:21:22.498 INFO:teuthology.orchestra.run.smithi145.stdout:(61/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 567 kB/s | 47 kB 00:00 2024-08-17T02:21:22.506 INFO:teuthology.orchestra.run.smithi002.stdout:(23/133): python3-rbd-17.2.7-1375.g2577e813.el9 5.0 MB/s | 344 kB 00:00 2024-08-17T02:21:22.523 INFO:teuthology.orchestra.run.smithi145.stdout:(62/133): openblas-0.3.21-2.el9.x86_64.rpm 846 kB/s | 35 kB 00:00 2024-08-17T02:21:22.532 INFO:teuthology.orchestra.run.smithi002.stdout:(24/133): python3-rgw-17.2.7-1375.g2577e813.el9 1.9 MB/s | 116 kB 00:00 2024-08-17T02:21:22.548 INFO:teuthology.orchestra.run.smithi145.stdout:(63/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-08-17T02:21:22.558 INFO:teuthology.orchestra.run.smithi002.stdout:(25/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 1.6 MB/s | 82 kB 00:00 2024-08-17T02:21:22.632 INFO:teuthology.orchestra.run.smithi002.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 2.2 MB/s | 165 kB 00:00 2024-08-17T02:21:22.682 INFO:teuthology.orchestra.run.smithi145.stdout:(64/133): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2024-08-17T02:21:22.699 INFO:teuthology.orchestra.run.smithi002.stdout:(27/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 18 MB/s | 2.9 MB 00:00 2024-08-17T02:21:22.724 INFO:teuthology.orchestra.run.smithi002.stdout:(28/133): ceph-grafana-dashboards-17.2.7-1375.g 266 kB/s | 24 kB 00:00 2024-08-17T02:21:22.750 INFO:teuthology.orchestra.run.smithi002.stdout:(29/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 2.4 MB/s | 124 kB 00:00 2024-08-17T02:21:22.757 INFO:teuthology.orchestra.run.smithi145.stdout:(65/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-08-17T02:21:22.784 INFO:teuthology.orchestra.run.smithi145.stdout:(66/133): python3-devel-3.9.18-3.el9.x86_64.rpm 2.4 MB/s | 244 kB 00:00 2024-08-17T02:21:22.816 INFO:teuthology.orchestra.run.smithi145.stdout:(67/133): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-08-17T02:21:22.842 INFO:teuthology.orchestra.run.smithi145.stdout:(68/133): python3-jsonpatch-1.21-16.el9.noarch. 436 kB/s | 26 kB 00:00 2024-08-17T02:21:22.867 INFO:teuthology.orchestra.run.smithi145.stdout:(69/133): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-08-17T02:21:22.900 INFO:teuthology.orchestra.run.smithi145.stdout:(70/133): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-08-17T02:21:22.926 INFO:teuthology.orchestra.run.smithi145.stdout:(71/133): python3-markupsafe-1.1.1-12.el9.x86_6 593 kB/s | 35 kB 00:00 2024-08-17T02:21:23.008 INFO:teuthology.orchestra.run.smithi002.stdout:(30/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 12 MB/s | 3.4 MB 00:00 2024-08-17T02:21:23.009 INFO:teuthology.orchestra.run.smithi145.stdout:(72/133): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-08-17T02:21:23.035 INFO:teuthology.orchestra.run.smithi145.stdout:(73/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-08-17T02:21:23.076 INFO:teuthology.orchestra.run.smithi145.stdout:(74/133): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-08-17T02:21:23.094 INFO:teuthology.orchestra.run.smithi145.stdout:(75/133): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-08-17T02:21:23.127 INFO:teuthology.orchestra.run.smithi145.stdout:(76/133): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-08-17T02:21:23.152 INFO:teuthology.orchestra.run.smithi145.stdout:(77/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-08-17T02:21:23.183 INFO:teuthology.orchestra.run.smithi002.stdout:(31/133): ceph-osd-17.2.7-1375.g2577e813.el9.x8 5.0 MB/s | 15 MB 00:03 2024-08-17T02:21:23.194 INFO:teuthology.orchestra.run.smithi145.stdout:(78/133): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-08-17T02:21:23.217 INFO:teuthology.orchestra.run.smithi002.stdout:(32/133): ceph-mgr-modules-core-17.2.7-1375.g25 1.1 MB/s | 240 kB 00:00 2024-08-17T02:21:23.242 INFO:teuthology.orchestra.run.smithi002.stdout:(33/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 818 kB/s | 47 kB 00:00 2024-08-17T02:21:23.262 INFO:teuthology.orchestra.run.smithi145.stdout:(79/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-08-17T02:21:23.276 INFO:teuthology.orchestra.run.smithi002.stdout:(34/133): ceph-prometheus-alerts-17.2.7-1375.g2 251 kB/s | 15 kB 00:00 2024-08-17T02:21:23.287 INFO:teuthology.orchestra.run.smithi145.stdout:(80/133): python3-pytz-2021.1-5.el9.noarch.rpm 381 kB/s | 51 kB 00:00 2024-08-17T02:21:23.309 INFO:teuthology.orchestra.run.smithi002.stdout:(35/133): ceph-volume-17.2.7-1375.g2577e813.el9 3.9 MB/s | 269 kB 00:00 2024-08-17T02:21:23.321 INFO:teuthology.orchestra.run.smithi145.stdout:(81/133): python3-requests-oauthlib-1.3.0-12.el 427 kB/s | 54 kB 00:00 2024-08-17T02:21:23.346 INFO:teuthology.orchestra.run.smithi145.stdout:(82/133): python3-toml-0.10.2-6.el9.noarch.rpm 709 kB/s | 42 kB 00:00 2024-08-17T02:21:23.374 INFO:teuthology.orchestra.run.smithi002.stdout:(36/133): cephadm-17.2.7-1375.g2577e813.el9.noa 840 kB/s | 83 kB 00:00 2024-08-17T02:21:23.379 INFO:teuthology.orchestra.run.smithi145.stdout:(83/133): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-08-17T02:21:23.401 INFO:teuthology.orchestra.run.smithi002.stdout:(37/133): cephfs-top-17.2.7-1375.g2577e813.el9. 198 kB/s | 18 kB 00:00 2024-08-17T02:21:23.413 INFO:teuthology.orchestra.run.smithi145.stdout:(84/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 1.4 MB/s | 96 kB 00:00 2024-08-17T02:21:23.439 INFO:teuthology.orchestra.run.smithi145.stdout:(85/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-08-17T02:21:23.493 INFO:teuthology.orchestra.run.smithi002.stdout:(38/133): ceph-mgr-diskprediction-local-17.2.7- 10 MB/s | 7.4 MB 00:00 2024-08-17T02:21:23.497 INFO:teuthology.orchestra.run.smithi145.stdout:(86/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 537 kB/s | 45 kB 00:00 2024-08-17T02:21:23.555 INFO:teuthology.orchestra.run.smithi145.stdout:(87/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.6 MB/s | 309 kB 00:00 2024-08-17T02:21:23.581 INFO:teuthology.orchestra.run.smithi145.stdout:(88/133): libunwind-1.6.2-1.el9.x86_64.rpm 2.9 MB/s | 67 kB 00:00 2024-08-17T02:21:23.606 INFO:teuthology.orchestra.run.smithi145.stdout:(89/133): liboath-2.6.7-2.el9.x86_64.rpm 456 kB/s | 49 kB 00:00 2024-08-17T02:21:23.632 INFO:teuthology.orchestra.run.smithi145.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-08-17T02:21:23.635 INFO:teuthology.orchestra.run.smithi002.stdout:(39/133): fuse-2.9.9-16.el9.x86_64.rpm 306 kB/s | 80 kB 00:00 2024-08-17T02:21:23.657 INFO:teuthology.orchestra.run.smithi145.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 1.3 MB/s | 32 kB 00:00 2024-08-17T02:21:23.682 INFO:teuthology.orchestra.run.smithi145.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 567 kB/s | 14 kB 00:00 2024-08-17T02:21:23.694 INFO:teuthology.orchestra.run.smithi002.stdout:(40/133): libquadmath-11.4.1-3.el9.x86_64.rpm 976 kB/s | 195 kB 00:00 2024-08-17T02:21:23.708 INFO:teuthology.orchestra.run.smithi145.stdout:(93/133): python3-cheroot-8.6.0-4.el9.noarch.rp 6.7 MB/s | 172 kB 00:00 2024-08-17T02:21:23.733 INFO:teuthology.orchestra.run.smithi145.stdout:(94/133): python3-asyncssh-2.13.2-5.el9.noarch. 3.5 MB/s | 548 kB 00:00 2024-08-17T02:21:23.761 INFO:teuthology.orchestra.run.smithi002.stdout:(41/133): libgfortran-11.4.1-3.el9.x86_64.rpm 2.2 MB/s | 803 kB 00:00 2024-08-17T02:21:23.766 INFO:teuthology.orchestra.run.smithi145.stdout:(95/133): python3-google-auth-2.33.0-1.el9.noar 6.5 MB/s | 220 kB 00:00 2024-08-17T02:21:23.786 INFO:teuthology.orchestra.run.smithi002.stdout:(42/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2024-08-17T02:21:23.791 INFO:teuthology.orchestra.run.smithi145.stdout:(96/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 424 kB/s | 11 kB 00:00 2024-08-17T02:21:23.817 INFO:teuthology.orchestra.run.smithi145.stdout:(97/133): python3-cherrypy-18.6.1-2.el9.noarch. 3.2 MB/s | 358 kB 00:00 2024-08-17T02:21:23.820 INFO:teuthology.orchestra.run.smithi002.stdout:(43/133): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-08-17T02:21:23.842 INFO:teuthology.orchestra.run.smithi145.stdout:(98/133): python3-jaraco-classes-3.2.1-5.el9.no 352 kB/s | 18 kB 00:00 2024-08-17T02:21:23.854 INFO:teuthology.orchestra.run.smithi002.stdout:(44/133): python3-cryptography-36.0.1-4.el9.x86 7.7 MB/s | 1.2 MB 00:00 2024-08-17T02:21:23.867 INFO:teuthology.orchestra.run.smithi145.stdout:(99/133): python3-jaraco-collections-3.0.0-8.el 461 kB/s | 23 kB 00:00 2024-08-17T02:21:23.879 INFO:teuthology.orchestra.run.smithi002.stdout:(45/133): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-08-17T02:21:23.884 INFO:teuthology.orchestra.run.smithi145.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 467 kB/s | 19 kB 00:00 2024-08-17T02:21:23.904 INFO:teuthology.orchestra.run.smithi002.stdout:(46/133): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-08-17T02:21:23.926 INFO:teuthology.orchestra.run.smithi145.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 335 kB/s | 20 kB 00:00 2024-08-17T02:21:23.929 INFO:teuthology.orchestra.run.smithi002.stdout:(47/133): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-08-17T02:21:23.944 INFO:teuthology.orchestra.run.smithi145.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 154 kB/s | 9.0 kB 00:00 2024-08-17T02:21:23.960 INFO:teuthology.orchestra.run.smithi145.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 1.2 MB/s | 41 kB 00:00 2024-08-17T02:21:23.977 INFO:teuthology.orchestra.run.smithi145.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 2.8 MB/s | 46 kB 00:00 2024-08-17T02:21:24.003 INFO:teuthology.orchestra.run.smithi145.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-17T02:21:24.013 INFO:teuthology.orchestra.run.smithi002.stdout:(48/133): elfutils-libelf-devel-0.191-4.el9.x86 261 kB/s | 22 kB 00:00 2024-08-17T02:21:24.020 INFO:teuthology.orchestra.run.smithi145.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-08-17T02:21:24.053 INFO:teuthology.orchestra.run.smithi145.stdout:(107/133): python3-pecan-1.4.2-3.el9.noarch.rpm 7.9 MB/s | 272 kB 00:00 2024-08-17T02:21:24.078 INFO:teuthology.orchestra.run.smithi145.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 664 kB/s | 16 kB 00:00 2024-08-17T02:21:24.113 INFO:teuthology.orchestra.run.smithi145.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.6 MB/s | 90 kB 00:00 2024-08-17T02:21:24.146 INFO:teuthology.orchestra.run.smithi145.stdout:(110/133): python3-kubernetes-26.1.0-2.el9.noar 5.0 MB/s | 1.0 MB 00:00 2024-08-17T02:21:24.155 INFO:teuthology.orchestra.run.smithi002.stdout:(49/133): flex-2.6.4-9.el9.x86_64.rpm 2.2 MB/s | 313 kB 00:00 2024-08-17T02:21:24.171 INFO:teuthology.orchestra.run.smithi145.stdout:(111/133): python3-repoze-lru-0.7-16.el9.noarch 526 kB/s | 31 kB 00:00 2024-08-17T02:21:24.199 INFO:teuthology.orchestra.run.smithi145.stdout:(112/133): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-17T02:21:24.205 INFO:teuthology.orchestra.run.smithi002.stdout:(50/133): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2024-08-17T02:21:24.222 INFO:teuthology.orchestra.run.smithi145.stdout:(113/133): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-08-17T02:21:24.230 INFO:teuthology.orchestra.run.smithi002.stdout:(51/133): flexiblas-3.0.4-8.el9.x86_64.rpm 435 kB/s | 33 kB 00:00 2024-08-17T02:21:24.256 INFO:teuthology.orchestra.run.smithi145.stdout:(114/133): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-08-17T02:21:24.281 INFO:teuthology.orchestra.run.smithi145.stdout:(115/133): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-08-17T02:21:24.281 INFO:teuthology.orchestra.run.smithi002.stdout:(52/133): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-08-17T02:21:24.306 INFO:teuthology.orchestra.run.smithi145.stdout:(116/133): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-17T02:21:24.323 INFO:teuthology.orchestra.run.smithi002.stdout:(53/133): bison-3.7.4-5.el9.x86_64.rpm 2.2 MB/s | 943 kB 00:00 2024-08-17T02:21:24.331 INFO:teuthology.orchestra.run.smithi145.stdout:(117/133): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-08-17T02:21:24.348 INFO:teuthology.orchestra.run.smithi002.stdout:(54/133): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-08-17T02:21:24.365 INFO:teuthology.orchestra.run.smithi145.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 600 kB/s | 20 kB 00:00 2024-08-17T02:21:24.398 INFO:teuthology.orchestra.run.smithi002.stdout:(55/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 909 kB/s | 45 kB 00:00 2024-08-17T02:21:24.399 INFO:teuthology.orchestra.run.smithi145.stdout:(119/133): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-08-17T02:21:24.452 INFO:teuthology.orchestra.run.smithi002.stdout:(56/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-08-17T02:21:24.457 INFO:teuthology.orchestra.run.smithi145.stdout:(120/133): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-08-17T02:21:24.599 INFO:teuthology.orchestra.run.smithi002.stdout:(57/133): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-08-17T02:21:24.641 INFO:teuthology.orchestra.run.smithi002.stdout:(58/133): libtool-2.4.6-46.el9.x86_64.rpm 3.0 MB/s | 581 kB 00:00 2024-08-17T02:21:24.649 INFO:teuthology.orchestra.run.smithi145.stdout:(121/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-08-17T02:21:24.666 INFO:teuthology.orchestra.run.smithi002.stdout:(59/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 381 kB/s | 25 kB 00:00 2024-08-17T02:21:24.691 INFO:teuthology.orchestra.run.smithi002.stdout:(60/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 953 kB/s | 47 kB 00:00 2024-08-17T02:21:24.742 INFO:teuthology.orchestra.run.smithi002.stdout:(61/133): openblas-0.3.21-2.el9.x86_64.rpm 705 kB/s | 35 kB 00:00 2024-08-17T02:21:24.800 INFO:teuthology.orchestra.run.smithi002.stdout:(62/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-08-17T02:21:25.208 INFO:teuthology.orchestra.run.smithi145.stdout:(122/133): librados2-17.2.7-1375.g2577e813.el9. 3.8 MB/s | 3.1 MB 00:00 2024-08-17T02:21:25.208 INFO:teuthology.orchestra.run.smithi002.stdout:(63/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.0 MB/s | 3.0 MB 00:01 2024-08-17T02:21:25.258 INFO:teuthology.orchestra.run.smithi145.stdout:(123/133): librbd1-17.2.7-1375.g2577e813.el9.x8 3.7 MB/s | 2.9 MB 00:00 2024-08-17T02:21:25.733 INFO:teuthology.orchestra.run.smithi145.stdout:(124/133): NetworkManager-1.48.2-2.el9.x86_64.r 2.1 MB/s | 2.3 MB 00:01 2024-08-17T02:21:25.751 INFO:teuthology.orchestra.run.smithi002.stdout:(64/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 4.7 MB/s | 4.4 MB 00:00 2024-08-17T02:21:25.834 INFO:teuthology.orchestra.run.smithi002.stdout:(65/133): python3-devel-3.9.18-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2024-08-17T02:21:25.858 INFO:teuthology.orchestra.run.smithi145.stdout:(125/133): NetworkManager-team-1.48.2-2.el9.x86 68 kB/s | 41 kB 00:00 2024-08-17T02:21:25.918 INFO:teuthology.orchestra.run.smithi002.stdout:(66/133): openblas-openmp-0.3.21-2.el9.x86_64.r 4.0 MB/s | 4.7 MB 00:01 2024-08-17T02:21:25.968 INFO:teuthology.orchestra.run.smithi002.stdout:(67/133): python3-jinja2-2.11.3-6.el9.noarch.rp 1.8 MB/s | 248 kB 00:00 2024-08-17T02:21:25.993 INFO:teuthology.orchestra.run.smithi002.stdout:(68/133): python3-jsonpatch-1.21-16.el9.noarch. 342 kB/s | 26 kB 00:00 2024-08-17T02:21:26.043 INFO:teuthology.orchestra.run.smithi002.stdout:(69/133): python3-jsonpointer-2.0-4.el9.noarch. 255 kB/s | 19 kB 00:00 2024-08-17T02:21:26.111 INFO:teuthology.orchestra.run.smithi002.stdout:(70/133): python3-markupsafe-1.1.1-12.el9.x86_6 520 kB/s | 35 kB 00:00 2024-08-17T02:21:26.136 INFO:teuthology.orchestra.run.smithi002.stdout:(71/133): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-08-17T02:21:26.192 INFO:teuthology.orchestra.run.smithi145.stdout:(126/133): NetworkManager-libnm-1.48.2-2.el9.x8 1.8 MB/s | 1.8 MB 00:00 2024-08-17T02:21:26.219 INFO:teuthology.orchestra.run.smithi002.stdout:(72/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-08-17T02:21:26.303 INFO:teuthology.orchestra.run.smithi002.stdout:(73/133): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-08-17T02:21:26.345 INFO:teuthology.orchestra.run.smithi002.stdout:(74/133): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-08-17T02:21:26.395 INFO:teuthology.orchestra.run.smithi002.stdout:(75/133): python3-prettytable-0.7.2-27.el9.noar 850 kB/s | 42 kB 00:00 2024-08-17T02:21:26.454 INFO:teuthology.orchestra.run.smithi002.stdout:(76/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-08-17T02:21:26.460 INFO:teuthology.orchestra.run.smithi145.stdout:(127/133): elfutils-debuginfod-client-0.191-4.e 61 kB/s | 37 kB 00:00 2024-08-17T02:21:26.543 INFO:teuthology.orchestra.run.smithi145.stdout:(128/133): NetworkManager-tui-1.48.2-2.el9.x86_ 306 kB/s | 247 kB 00:00 2024-08-17T02:21:26.562 INFO:teuthology.orchestra.run.smithi002.stdout:(77/133): python3-babel-2.9.1-2.el9.noarch.rpm 4.4 MB/s | 6.0 MB 00:01 2024-08-17T02:21:26.588 INFO:teuthology.orchestra.run.smithi002.stdout:(78/133): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-08-17T02:21:26.629 INFO:teuthology.orchestra.run.smithi002.stdout:(79/133): python3-pytz-2021.1-5.el9.noarch.rpm 765 kB/s | 51 kB 00:00 2024-08-17T02:21:26.646 INFO:teuthology.orchestra.run.smithi002.stdout:(80/133): python3-requests-oauthlib-1.3.0-12.el 920 kB/s | 54 kB 00:00 2024-08-17T02:21:26.688 INFO:teuthology.orchestra.run.smithi002.stdout:(81/133): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-08-17T02:21:26.780 INFO:teuthology.orchestra.run.smithi002.stdout:(82/133): socat-1.7.4.1-6.el9.x86_64.rpm 3.2 MB/s | 304 kB 00:00 2024-08-17T02:21:26.839 INFO:teuthology.orchestra.run.smithi002.stdout:(83/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-08-17T02:21:26.897 INFO:teuthology.orchestra.run.smithi002.stdout:(84/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-08-17T02:21:26.951 INFO:teuthology.orchestra.run.smithi145.stdout:(129/133): elfutils-libelf-0.191-4.el9.x86_64.r 273 kB/s | 207 kB 00:00 2024-08-17T02:21:26.973 INFO:teuthology.orchestra.run.smithi002.stdout:(85/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.9 MB/s | 5.1 MB 00:00 2024-08-17T02:21:26.998 INFO:teuthology.orchestra.run.smithi002.stdout:(86/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 447 kB/s | 45 kB 00:00 2024-08-17T02:21:27.099 INFO:teuthology.orchestra.run.smithi002.stdout:(87/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.4 MB/s | 309 kB 00:00 2024-08-17T02:21:27.124 INFO:teuthology.orchestra.run.smithi002.stdout:(88/133): liboath-2.6.7-2.el9.x86_64.rpm 388 kB/s | 49 kB 00:00 2024-08-17T02:21:27.149 INFO:teuthology.orchestra.run.smithi002.stdout:(89/133): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-08-17T02:21:27.174 INFO:teuthology.orchestra.run.smithi002.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-08-17T02:21:27.200 INFO:teuthology.orchestra.run.smithi002.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 1.3 MB/s | 32 kB 00:00 2024-08-17T02:21:27.225 INFO:teuthology.orchestra.run.smithi002.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 569 kB/s | 14 kB 00:00 2024-08-17T02:21:27.259 INFO:teuthology.orchestra.run.smithi002.stdout:(93/133): python3-cheroot-8.6.0-4.el9.noarch.rp 5.1 MB/s | 172 kB 00:00 2024-08-17T02:21:27.284 INFO:teuthology.orchestra.run.smithi002.stdout:(94/133): python3-asyncssh-2.13.2-5.el9.noarch. 3.4 MB/s | 548 kB 00:00 2024-08-17T02:21:27.301 INFO:teuthology.orchestra.run.smithi145.stdout:(130/133): elfutils-libs-0.191-4.el9.x86_64.rpm 308 kB/s | 260 kB 00:00 2024-08-17T02:21:27.318 INFO:teuthology.orchestra.run.smithi002.stdout:(95/133): python3-google-auth-2.33.0-1.el9.noar 6.5 MB/s | 220 kB 00:00 2024-08-17T02:21:27.343 INFO:teuthology.orchestra.run.smithi002.stdout:(96/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 429 kB/s | 11 kB 00:00 2024-08-17T02:21:27.368 INFO:teuthology.orchestra.run.smithi002.stdout:(97/133): python3-cherrypy-18.6.1-2.el9.noarch. 3.2 MB/s | 358 kB 00:00 2024-08-17T02:21:27.393 INFO:teuthology.orchestra.run.smithi002.stdout:(98/133): python3-jaraco-classes-3.2.1-5.el9.no 351 kB/s | 18 kB 00:00 2024-08-17T02:21:27.419 INFO:teuthology.orchestra.run.smithi002.stdout:(99/133): python3-jaraco-collections-3.0.0-8.el 464 kB/s | 23 kB 00:00 2024-08-17T02:21:27.444 INFO:teuthology.orchestra.run.smithi002.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-08-17T02:21:27.469 INFO:teuthology.orchestra.run.smithi002.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-08-17T02:21:27.495 INFO:teuthology.orchestra.run.smithi002.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 180 kB/s | 9.0 kB 00:00 2024-08-17T02:21:27.520 INFO:teuthology.orchestra.run.smithi002.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 820 kB/s | 41 kB 00:00 2024-08-17T02:21:27.543 INFO:teuthology.orchestra.run.smithi145.stdout:(131/133): openssl-3.2.2-2.el9.x86_64.rpm 1.4 MB/s | 1.4 MB 00:01 2024-08-17T02:21:27.545 INFO:teuthology.orchestra.run.smithi002.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-17T02:21:27.570 INFO:teuthology.orchestra.run.smithi002.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-17T02:21:27.596 INFO:teuthology.orchestra.run.smithi002.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-17T02:21:27.630 INFO:teuthology.orchestra.run.smithi002.stdout:(107/133): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-17T02:21:27.655 INFO:teuthology.orchestra.run.smithi002.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-08-17T02:21:27.680 INFO:teuthology.orchestra.run.smithi002.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-17T02:21:27.722 INFO:teuthology.orchestra.run.smithi002.stdout:(110/133): python3-repoze-lru-0.7-16.el9.noarch 744 kB/s | 31 kB 00:00 2024-08-17T02:21:27.756 INFO:teuthology.orchestra.run.smithi002.stdout:(111/133): python3-kubernetes-26.1.0-2.el9.noar 3.9 MB/s | 1.0 MB 00:00 2024-08-17T02:21:27.781 INFO:teuthology.orchestra.run.smithi002.stdout:(112/133): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-17T02:21:27.807 INFO:teuthology.orchestra.run.smithi002.stdout:(113/133): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-08-17T02:21:27.832 INFO:teuthology.orchestra.run.smithi002.stdout:(114/133): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-08-17T02:21:27.865 INFO:teuthology.orchestra.run.smithi002.stdout:(115/133): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-08-17T02:21:27.895 INFO:teuthology.orchestra.run.smithi002.stdout:(116/133): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-17T02:21:27.924 INFO:teuthology.orchestra.run.smithi002.stdout:(117/133): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-08-17T02:21:27.950 INFO:teuthology.orchestra.run.smithi002.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 805 kB/s | 20 kB 00:00 2024-08-17T02:21:27.977 INFO:teuthology.orchestra.run.smithi145.stdout:(132/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 2.3 MB/s | 2.4 MB 00:01 2024-08-17T02:21:27.983 INFO:teuthology.orchestra.run.smithi002.stdout:(119/133): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-08-17T02:21:28.042 INFO:teuthology.orchestra.run.smithi002.stdout:(120/133): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-08-17T02:21:28.277 INFO:teuthology.orchestra.run.smithi145.stdout:(133/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 1.1 MB/s | 1.1 MB 00:00 2024-08-17T02:21:28.283 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:21:28.283 INFO:teuthology.orchestra.run.smithi145.stdout:Total 16 MB/s | 206 MB 00:13 2024-08-17T02:21:28.284 INFO:teuthology.orchestra.run.smithi002.stdout:(121/133): librbd1-17.2.7-1375.g2577e813.el9.x8 12 MB/s | 2.9 MB 00:00 2024-08-17T02:21:28.468 INFO:teuthology.orchestra.run.smithi002.stdout:(122/133): librados2-17.2.7-1375.g2577e813.el9. 6.4 MB/s | 3.1 MB 00:00 2024-08-17T02:21:28.643 INFO:teuthology.orchestra.run.smithi002.stdout:(123/133): NetworkManager-1.48.2-2.el9.x86_64.r 6.4 MB/s | 2.3 MB 00:00 2024-08-17T02:21:28.701 INFO:teuthology.orchestra.run.smithi002.stdout:(124/133): NetworkManager-team-1.48.2-2.el9.x86 701 kB/s | 41 kB 00:00 2024-08-17T02:21:28.829 INFO:teuthology.orchestra.run.smithi002.stdout:(125/133): NetworkManager-libnm-1.48.2-2.el9.x8 5.0 MB/s | 1.8 MB 00:00 2024-08-17T02:21:28.852 INFO:teuthology.orchestra.run.smithi002.stdout:(126/133): NetworkManager-tui-1.48.2-2.el9.x86_ 1.6 MB/s | 247 kB 00:00 2024-08-17T02:21:28.886 INFO:teuthology.orchestra.run.smithi002.stdout:(127/133): elfutils-debuginfod-client-0.191-4.e 655 kB/s | 37 kB 00:00 2024-08-17T02:21:28.911 INFO:teuthology.orchestra.run.smithi002.stdout:(128/133): elfutils-libelf-0.191-4.el9.x86_64.r 3.5 MB/s | 207 kB 00:00 2024-08-17T02:21:28.945 INFO:teuthology.orchestra.run.smithi002.stdout:(129/133): elfutils-libs-0.191-4.el9.x86_64.rpm 4.3 MB/s | 260 kB 00:00 2024-08-17T02:21:28.987 INFO:teuthology.orchestra.run.smithi002.stdout:(130/133): openssl-3.2.2-2.el9.x86_64.rpm 18 MB/s | 1.4 MB 00:00 2024-08-17T02:21:29.062 INFO:teuthology.orchestra.run.smithi002.stdout:(131/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 20 MB/s | 2.4 MB 00:00 2024-08-17T02:21:29.104 INFO:teuthology.orchestra.run.smithi002.stdout:(132/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 9.3 MB/s | 1.1 MB 00:00 2024-08-17T02:21:29.854 INFO:teuthology.orchestra.run.smithi002.stdout:(133/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.0 MB/s | 16 MB 00:03 2024-08-17T02:21:29.859 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:21:29.860 INFO:teuthology.orchestra.run.smithi002.stdout:Total 19 MB/s | 206 MB 00:10 2024-08-17T02:21:29.988 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-08-17T02:21:30.197 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-08-17T02:21:30.197 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-08-17T02:21:31.594 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-08-17T02:21:31.825 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-08-17T02:21:31.825 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-08-17T02:21:32.268 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-08-17T02:21:32.268 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-08-17T02:21:34.137 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-08-17T02:21:34.137 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-08-17T02:21:38.008 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-08-17T02:21:38.099 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:21:38.141 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:21:38.208 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:21:38.251 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:21:38.283 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:21:38.369 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:21:38.697 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:21:38.800 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:21:38.928 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:21:38.968 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:21:39.091 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:21:39.562 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:21:39.586 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:21:39.683 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:21:39.770 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:21:39.807 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:21:39.910 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:21:39.938 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:21:40.062 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:21:40.083 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-08-17T02:21:40.176 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:21:40.227 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:21:40.293 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:21:40.335 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:21:40.336 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:21:40.368 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:21:40.432 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:21:40.561 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:21:40.631 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:21:40.743 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:21:40.773 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:21:40.873 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:21:40.885 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:21:41.023 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:21:41.061 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:21:41.173 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:21:41.252 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:21:41.295 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:21:41.340 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:21:41.422 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:21:41.467 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:21:41.500 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:21:41.588 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:21:41.660 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:21:41.671 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:21:41.695 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:21:41.704 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:21:41.751 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:21:41.815 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:21:41.829 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:21:41.866 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:21:41.911 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:21:41.933 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:21:41.964 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:21:41.996 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:21:42.094 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:21:42.124 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:21:42.165 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:21:42.234 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:21:42.278 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:21:42.557 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:21:42.772 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:21:42.849 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:21:42.899 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:21:42.955 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:21:42.995 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:21:43.035 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:21:43.061 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:21:43.081 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:21:43.141 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:21:43.188 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:21:43.241 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:21:43.284 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:21:43.340 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:21:43.406 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:21:43.425 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:21:43.446 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:21:43.473 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:21:43.491 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:21:43.577 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:21:43.624 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:21:43.657 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:21:43.748 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:21:43.820 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:21:43.858 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:21:43.863 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:21:43.910 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:21:43.911 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:21:43.971 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:21:44.000 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:21:44.021 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:21:44.033 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:21:44.079 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:21:44.175 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:21:44.221 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:21:44.271 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:21:44.314 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:21:44.349 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:21:44.410 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:21:44.432 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:21:44.471 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:21:44.514 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:21:44.545 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:21:44.581 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:21:44.628 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:21:44.665 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:21:44.700 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:21:44.733 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:21:44.776 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:21:44.809 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:21:44.844 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:21:44.895 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:21:45.016 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:21:45.092 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:21:45.094 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:21:45.196 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:21:45.235 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:21:45.296 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:21:45.341 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:21:45.419 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:21:45.433 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:21:45.470 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:21:45.536 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:21:45.618 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:21:45.663 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:21:45.875 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:21:45.934 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:21:45.986 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:21:45.992 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:21:46.036 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:21:46.052 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:21:46.086 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:21:46.204 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:21:46.213 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:21:46.252 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:21:46.268 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:21:46.311 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:21:46.458 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:21:46.477 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:21:46.501 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:21:46.508 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:21:46.551 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:21:46.583 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:21:46.594 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:21:46.612 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:21:46.650 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:21:46.686 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:21:46.721 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:21:46.755 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:21:46.798 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:21:46.831 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:21:46.866 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:21:46.917 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:21:47.042 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:21:47.114 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:21:47.408 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:21:47.547 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:21:48.051 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:21:48.106 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:21:48.140 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:21:48.261 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:21:48.298 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:21:48.535 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:21:48.570 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:21:48.668 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:21:49.148 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:21:49.255 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:21:49.291 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:21:49.324 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:21:49.503 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:21:49.643 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:21:49.653 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:21:49.678 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:21:49.793 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:21:49.846 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:21:51.328 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:21:51.424 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:21:51.462 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:21:51.493 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:21:51.827 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:21:51.863 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:21:51.980 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:21:52.006 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:21:52.403 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:21:52.443 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:21:53.036 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:21:53.080 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:21:53.219 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:21:53.219 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:21:53.219 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:21:53.219 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:21:53.581 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:21:54.710 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:21:54.753 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:21:55.394 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:21:55.439 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:21:55.599 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:21:55.599 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:21:55.600 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:21:55.600 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:21:55.632 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:22:05.484 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:22:05.484 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /sys 2024-08-17T02:22:05.484 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /proc 2024-08-17T02:22:05.484 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /mnt 2024-08-17T02:22:05.484 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /var/tmp 2024-08-17T02:22:05.484 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /home 2024-08-17T02:22:05.485 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /root 2024-08-17T02:22:05.485 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /tmp 2024-08-17T02:22:05.485 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:05.684 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:22:05.718 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:22:05.719 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:05.719 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:22:05.719 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:07.204 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:22:07.262 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:22:07.262 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:07.262 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:22:07.262 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:22:07.262 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:22:07.263 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:07.488 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:22:07.538 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:22:07.539 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:07.539 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:22:07.539 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:22:07.539 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:22:07.539 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:07.947 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:22:07.998 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:22:07.998 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:07.998 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:22:07.998 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:22:07.998 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:22:07.998 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:08.122 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:22:08.182 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:22:08.263 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:22:08.264 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /sys 2024-08-17T02:22:08.264 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /proc 2024-08-17T02:22:08.264 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /mnt 2024-08-17T02:22:08.264 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /var/tmp 2024-08-17T02:22:08.264 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /home 2024-08-17T02:22:08.264 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /root 2024-08-17T02:22:08.264 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /tmp 2024-08-17T02:22:08.264 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:08.265 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:22:08.465 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:22:08.490 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:22:08.501 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:22:08.501 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:08.501 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:22:08.501 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:08.550 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:22:08.636 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:22:08.745 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:22:08.912 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:22:08.963 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:22:08.997 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:22:09.033 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:22:09.073 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:22:09.099 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:22:09.560 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:22:09.590 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:22:09.620 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:22:09.681 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:22:09.712 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:22:10.050 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:22:10.109 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:22:10.110 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:10.110 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:22:10.110 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:22:10.110 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:22:10.110 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:10.356 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:22:10.407 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:22:10.407 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:10.407 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:22:10.407 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:22:10.407 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:22:10.407 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:10.831 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:22:10.858 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:22:10.883 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:22:10.883 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:10.884 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:22:10.884 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:22:10.884 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:22:10.884 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:10.914 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:22:11.015 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:22:11.077 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:22:11.150 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:22:11.386 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:22:11.444 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:22:11.532 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:22:11.644 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:22:11.821 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:22:11.874 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:22:11.899 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:22:11.935 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:22:11.983 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:22:12.006 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:22:12.008 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:22:12.031 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:22:12.168 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:22:12.335 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:22:12.366 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:22:12.419 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:22:12.419 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:12.419 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:22:12.419 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:22:12.419 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:22:12.419 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:12.475 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:22:12.503 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:22:12.538 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:22:12.566 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:22:12.596 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:22:12.601 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:22:12.660 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:22:12.660 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:22:12.688 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:22:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:22:13.949 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:22:13.970 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:22:14.003 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:22:14.117 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:22:14.117 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:14.117 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:22:14.117 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:22:14.117 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:22:14.117 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:14.171 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:22:14.221 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:22:14.221 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:14.222 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:22:14.222 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:14.280 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:22:14.330 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:22:14.331 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:14.331 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:22:14.331 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:22:14.331 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:22:14.331 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:14.647 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:22:14.698 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:22:14.699 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:14.699 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:22:14.699 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:22:14.699 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:22:14.699 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:15.101 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:22:15.124 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:22:15.266 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:22:15.444 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:22:15.476 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:22:15.528 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:22:15.528 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:15.528 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:22:15.528 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:22:15.529 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:22:15.529 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:15.602 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:22:15.628 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:22:15.732 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:22:15.796 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:22:17.205 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:22:17.237 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:22:17.351 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:22:17.352 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:17.352 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:22:17.352 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:22:17.352 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:22:17.352 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:17.397 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:22:17.447 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:22:17.447 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:17.447 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:22:17.447 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:17.514 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:22:17.567 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:22:17.567 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:17.567 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:22:17.567 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:22:17.567 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:22:17.567 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:17.898 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:22:17.950 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:22:17.951 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:17.951 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:22:17.951 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:22:17.951 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:22:17.951 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:19.376 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:22:19.417 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:22:19.462 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:22:19.499 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:22:19.551 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:22:19.584 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:22:19.624 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:22:19.655 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:22:19.703 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:22:20.989 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:22:21.233 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:22:21.306 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:22:21.354 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:22:21.456 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:22:21.493 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:22:21.543 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:22:21.568 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:22:21.598 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:22:21.599 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:22:21.722 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:22:21.754 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:22:21.754 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:22:21.864 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:22:21.888 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:22:21.911 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:22:21.911 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:22:22.149 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:22:22.149 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:22:22.259 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:22:22.299 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:22:22.327 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:22:22.400 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:22:22.637 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:22:22.637 INFO:teuthology.orchestra.run.smithi145.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:22:22.637 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:22.952 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:22:22.995 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:22:23.040 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:22:23.075 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:22:23.109 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:22:23.144 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:22:23.178 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:22:23.232 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:22:23.279 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:22:24.690 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:22:24.943 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:22:24.991 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:22:25.039 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:22:25.146 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:22:25.186 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:22:25.219 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:22:25.244 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:22:25.274 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:22:25.275 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:22:25.386 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:22:25.422 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:22:25.422 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:22:25.532 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:22:25.556 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:22:25.573 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:22:25.573 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:22:25.825 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:22:25.826 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:22:25.927 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:22:25.967 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:22:25.994 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:22:26.070 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:22:26.272 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:22:26.272 INFO:teuthology.orchestra.run.smithi002.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:22:26.272 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:28.161 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:22:28.161 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:22:28.161 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:22:28.161 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:22:28.162 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:22:28.162 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:22:28.162 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:22:28.162 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:22:28.162 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:22:28.162 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:22:28.162 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:22:28.162 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:22:28.162 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:22:28.162 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:22:28.162 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:22:28.162 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:22:28.163 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:22:28.163 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:22:28.163 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:22:28.163 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:22:28.163 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:22:28.163 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:22:28.163 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:22:28.163 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:22:28.163 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:22:28.163 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:22:28.163 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:22:28.164 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:22:28.164 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:22:28.164 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:22:28.164 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:22:28.164 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:22:28.164 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:22:28.164 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:22:28.164 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:22:28.164 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:22:28.164 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:22:28.164 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:22:28.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:22:28.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:22:28.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:22:28.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:22:28.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:22:28.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:22:28.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:22:28.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:22:28.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:22:28.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:22:28.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:22:28.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:22:28.166 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:22:28.166 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:22:28.166 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:22:28.166 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:22:28.166 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:22:28.166 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:22:28.166 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:22:28.166 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:22:28.166 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:22:28.166 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:22:28.166 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:22:28.166 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:22:28.167 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:22:28.167 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:22:28.167 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:22:28.167 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:22:28.167 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:22:28.167 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:22:28.167 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:22:28.167 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:22:28.167 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:22:28.167 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:22:28.167 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:22:28.167 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:22:28.168 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:22:28.168 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:22:28.168 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:22:28.168 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:22:28.168 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:22:28.168 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:22:28.168 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:22:28.168 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:22:28.168 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:22:28.168 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:22:28.168 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:22:28.168 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:22:28.169 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:22:28.169 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:22:28.169 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:22:28.169 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:22:28.169 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:22:28.169 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:22:28.169 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:22:28.169 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:22:28.169 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:22:28.169 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:22:28.169 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:22:28.169 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:22:28.169 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:22:28.170 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:22:28.170 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:22:28.170 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:22:28.170 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:22:28.170 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:22:28.170 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:22:28.170 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:22:28.170 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:22:28.170 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:22:28.170 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:22:28.170 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:22:28.170 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:22:28.171 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:22:28.171 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:22:28.171 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:22:28.171 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:22:28.171 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:22:28.171 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:22:28.171 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:22:28.171 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:22:28.171 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:22:28.171 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:22:28.171 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:22:28.171 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:22:28.172 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:22:28.172 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:22:28.172 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:22:28.172 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:22:28.172 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:22:28.172 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:22:28.172 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:22:28.172 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:22:28.172 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:22:28.172 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:22:28.172 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:22:28.172 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:22:28.172 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:22:28.173 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:22:28.173 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:22:28.173 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:22:28.173 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:22:28.173 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:22:28.173 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:22:28.173 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:22:28.173 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:22:30.065 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:22:30.065 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:30.066 INFO:teuthology.orchestra.run.smithi145.stdout:Upgraded: 2024-08-17T02:22:30.066 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:22:30.066 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:22:30.066 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:22:30.066 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:22:30.066 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:22:30.066 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:22:30.066 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:22:30.066 INFO:teuthology.orchestra.run.smithi145.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.066 INFO:teuthology.orchestra.run.smithi145.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.066 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:22:30.066 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:22:30.067 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:22:30.067 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-08-17T02:22:30.067 INFO:teuthology.orchestra.run.smithi145.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:22:30.067 INFO:teuthology.orchestra.run.smithi145.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:22:30.067 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.067 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.067 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.067 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.067 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:30.067 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.067 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.067 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.067 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:30.068 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:30.068 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:30.068 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:30.068 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:30.068 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.068 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.068 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:30.068 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.068 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.068 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.068 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:30.068 INFO:teuthology.orchestra.run.smithi145.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:30.069 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.069 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:30.069 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:22:30.069 INFO:teuthology.orchestra.run.smithi145.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:22:30.069 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:22:30.069 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:22:30.069 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:22:30.069 INFO:teuthology.orchestra.run.smithi145.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:22:30.069 INFO:teuthology.orchestra.run.smithi145.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:22:30.069 INFO:teuthology.orchestra.run.smithi145.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:22:30.069 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.069 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.069 INFO:teuthology.orchestra.run.smithi145.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.070 INFO:teuthology.orchestra.run.smithi145.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:22:30.070 INFO:teuthology.orchestra.run.smithi145.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:22:30.070 INFO:teuthology.orchestra.run.smithi145.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:22:30.070 INFO:teuthology.orchestra.run.smithi145.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:22:30.070 INFO:teuthology.orchestra.run.smithi145.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:22:30.070 INFO:teuthology.orchestra.run.smithi145.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.070 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.070 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:22:30.070 INFO:teuthology.orchestra.run.smithi145.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.070 INFO:teuthology.orchestra.run.smithi145.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:22:30.070 INFO:teuthology.orchestra.run.smithi145.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:22:30.070 INFO:teuthology.orchestra.run.smithi145.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:22:30.071 INFO:teuthology.orchestra.run.smithi145.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:22:30.071 INFO:teuthology.orchestra.run.smithi145.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:22:30.071 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:22:30.071 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:22:30.071 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:22:30.071 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:22:30.071 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:22:30.071 INFO:teuthology.orchestra.run.smithi145.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:22:30.072 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:22:30.072 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.072 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.072 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.072 INFO:teuthology.orchestra.run.smithi145.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:22:30.072 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:22:30.072 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:22:30.072 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:22:30.072 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:22:30.073 INFO:teuthology.orchestra.run.smithi145.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:22:30.073 INFO:teuthology.orchestra.run.smithi145.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:22:30.073 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:22:30.073 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:22:30.073 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:22:30.073 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:22:30.073 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:22:30.073 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:22:30.073 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:22:30.073 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:22:30.073 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:22:30.073 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:22:30.073 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:22:30.074 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:22:30.074 INFO:teuthology.orchestra.run.smithi145.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:22:30.074 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:22:30.074 INFO:teuthology.orchestra.run.smithi145.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:22:30.074 INFO:teuthology.orchestra.run.smithi145.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:22:30.074 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:22:30.074 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:22:30.074 INFO:teuthology.orchestra.run.smithi145.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:22:30.074 INFO:teuthology.orchestra.run.smithi145.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:22:30.074 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:22:30.074 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:22:30.074 INFO:teuthology.orchestra.run.smithi145.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:22:30.075 INFO:teuthology.orchestra.run.smithi145.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:22:30.075 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:22:30.075 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:22:30.075 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:22:30.075 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:22:30.075 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:22:30.075 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.075 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.075 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:22:30.075 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:22:30.075 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:22:30.075 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.075 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:22:30.075 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:22:30.076 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:22:30.076 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:22:30.076 INFO:teuthology.orchestra.run.smithi145.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:22:30.076 INFO:teuthology.orchestra.run.smithi145.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:22:30.076 INFO:teuthology.orchestra.run.smithi145.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:22:30.076 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:22:30.076 INFO:teuthology.orchestra.run.smithi145.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:22:30.076 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:22:30.076 INFO:teuthology.orchestra.run.smithi145.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:22:30.076 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.076 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.076 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:30.076 INFO:teuthology.orchestra.run.smithi145.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:22:30.077 INFO:teuthology.orchestra.run.smithi145.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:22:30.077 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:22:30.077 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:22:30.077 INFO:teuthology.orchestra.run.smithi145.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:22:30.077 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:30.077 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-08-17T02:22:30.628 DEBUG:teuthology.parallel:result is None 2024-08-17T02:22:31.461 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:22:31.462 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:22:31.462 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:22:31.462 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:22:31.462 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:22:31.462 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:22:31.462 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:22:31.462 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:22:31.462 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:22:31.462 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:22:31.462 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:22:31.462 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:22:31.463 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:22:31.463 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:22:31.463 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:22:31.463 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:22:31.463 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:22:31.463 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:22:31.463 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:22:31.463 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:22:31.463 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:22:31.463 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:22:31.463 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:22:31.463 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:22:31.463 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:22:31.464 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:22:31.464 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:22:31.464 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:22:31.464 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:22:31.464 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:22:31.464 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:22:31.464 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:22:31.464 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:22:31.464 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:22:31.464 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:22:31.464 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:22:31.464 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:22:31.464 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:22:31.464 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:22:31.465 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:22:31.465 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:22:31.465 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:22:31.465 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:22:31.465 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:22:31.465 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:22:31.465 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:22:31.465 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:22:31.465 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:22:31.465 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:22:31.465 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:22:31.465 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:22:31.466 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:22:31.466 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:22:31.466 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:22:31.466 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:22:31.466 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:22:31.466 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:22:31.466 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:22:31.466 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:22:31.466 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:22:31.467 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:22:31.467 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:22:31.467 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:22:31.467 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:22:31.467 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:22:31.467 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:22:31.468 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:22:31.468 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:22:31.468 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:22:31.468 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:22:31.468 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:22:31.468 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:22:31.468 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:22:31.468 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:22:31.468 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:22:31.468 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:22:31.468 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:22:31.468 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:22:31.469 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:22:31.469 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:22:31.469 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:22:31.469 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:22:31.469 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:22:31.469 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:22:31.469 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:22:31.469 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:22:31.469 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:22:31.469 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:22:31.469 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:22:31.469 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:22:31.470 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:22:31.470 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:22:31.470 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:22:31.470 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:22:31.470 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:22:31.470 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:22:31.470 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:22:31.470 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:22:31.470 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:22:31.470 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:22:31.470 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:22:31.471 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:22:31.471 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:22:31.471 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:22:31.471 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:22:31.471 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:22:31.471 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:22:31.471 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:22:31.471 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:22:31.471 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:22:31.471 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:22:31.471 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:22:31.471 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:22:31.471 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:22:31.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:22:31.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:22:31.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:22:31.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:22:31.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:22:31.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:22:31.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:22:31.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:22:31.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:22:31.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:22:31.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:22:31.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:22:31.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:22:31.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:22:31.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:22:31.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:22:31.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:22:31.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:22:31.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:22:31.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:22:31.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:22:31.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:22:31.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:22:31.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:22:31.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:22:31.474 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:22:31.474 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:22:31.474 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:22:31.474 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:22:31.474 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:22:33.378 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:22:33.379 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:33.379 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2024-08-17T02:22:33.379 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:22:33.379 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:22:33.379 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:22:33.379 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:22:33.379 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:22:33.379 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:22:33.379 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:22:33.379 INFO:teuthology.orchestra.run.smithi002.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.380 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.380 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:22:33.380 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:22:33.380 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:22:33.380 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-08-17T02:22:33.380 INFO:teuthology.orchestra.run.smithi002.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:22:33.380 INFO:teuthology.orchestra.run.smithi002.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:22:33.380 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.380 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.380 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.380 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.380 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:33.380 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.381 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.381 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.381 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:33.381 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:33.381 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:33.381 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:33.381 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:33.381 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.381 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.381 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:33.381 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.381 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.382 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.382 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:33.382 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:33.382 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.382 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:33.382 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:22:33.382 INFO:teuthology.orchestra.run.smithi002.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:22:33.382 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:22:33.382 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:22:33.382 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:22:33.382 INFO:teuthology.orchestra.run.smithi002.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:22:33.383 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:22:33.383 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:22:33.383 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.383 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.383 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.383 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:22:33.383 INFO:teuthology.orchestra.run.smithi002.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:22:33.383 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:22:33.383 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:22:33.383 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:22:33.383 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.384 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.384 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:22:33.384 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.384 INFO:teuthology.orchestra.run.smithi002.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:22:33.384 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:22:33.384 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:22:33.384 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:22:33.384 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:22:33.384 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:22:33.384 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:22:33.384 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:22:33.385 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:22:33.385 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:22:33.385 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:22:33.385 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:22:33.385 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.385 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.385 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.385 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:22:33.385 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:22:33.385 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:22:33.385 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:22:33.385 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:22:33.385 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:22:33.386 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:22:33.386 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:22:33.386 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:22:33.386 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:22:33.386 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:22:33.386 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:22:33.386 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:22:33.386 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:22:33.386 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:22:33.386 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:22:33.386 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:22:33.386 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:22:33.386 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:22:33.387 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:22:33.387 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:22:33.387 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:22:33.387 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:22:33.387 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:22:33.387 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:22:33.387 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:22:33.387 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:22:33.387 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:22:33.387 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:22:33.387 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:22:33.387 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:22:33.388 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:22:33.388 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:22:33.388 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:22:33.388 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:22:33.388 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:22:33.388 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.388 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.388 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:22:33.388 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:22:33.388 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:22:33.388 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.388 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:22:33.389 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:22:33.389 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:22:33.389 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:22:33.389 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:22:33.389 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:22:33.389 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:22:33.389 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:22:33.389 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:22:33.389 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:22:33.389 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:22:33.389 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.389 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.389 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:33.389 INFO:teuthology.orchestra.run.smithi002.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:22:33.390 INFO:teuthology.orchestra.run.smithi002.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:22:33.390 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:22:33.390 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:22:33.390 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:22:33.390 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:33.390 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-08-17T02:22:34.101 DEBUG:teuthology.parallel:result is None 2024-08-17T02:22:34.102 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:22:34.238 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:22:34.283 INFO:teuthology.orchestra.run.smithi002.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:22:34.284 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:22:34.284 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:22:34.286 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:22:34.423 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:22:34.473 INFO:teuthology.orchestra.run.smithi145.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:22:34.473 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:22:34.473 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:22:34.475 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-17T02:22:34.475 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:22:34.475 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:22:34.534 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-08-17T02:22:34.534 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:22:34.596 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-17T02:22:34.596 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:22:34.596 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:22:34.654 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:22:34.753 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-08-17T02:22:34.753 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:22:34.812 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:22:34.908 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-17T02:22:34.908 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:22:34.908 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:22:34.966 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:22:35.066 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-08-17T02:22:35.066 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:22:35.121 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:22:35.216 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-17T02:22:35.216 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:22:35.216 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:22:35.274 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:22:35.370 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-08-17T02:22:35.370 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:22:35.426 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:22:35.521 INFO:teuthology.run_tasks:Running task ceph... 2024-08-17T02:22:35.603 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-17T02:22:35.603 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 777 /var/log/ceph 2024-08-17T02:22:35.607 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 777 /var/log/ceph 2024-08-17T02:22:35.662 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-17T02:22:35.662 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:22:35.666 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:22:35.720 INFO:tasks.ceph:Creating extra log directories... 2024-08-17T02:22:35.721 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:22:35.724 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:22:35.785 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-17T02:22:35.786 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-17T02:22:35.786 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-17T02:22:35.786 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:22:35.786 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:22:35.823 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:22:35.997 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:22:36.056 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-08-17T02:22:36.056 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:22:36.091 DEBUG:teuthology.orchestra.run.smithi145:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:22:36.256 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:22:36.317 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-17T02:22:36.317 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-17T02:22:36.317 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858261', 'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7858261', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 25, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5995, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'targets': {'smithi002.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHfI/U+AJOLfOkJH5H2FqzROc71NQDaHWDYazChVZxyltxpwBRcERg7tAKA5vvxpSjH3zLSFFZJkXP/j9DS5qwQ=', 'smithi145.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAlgxbOa7uZs1KZGiZhLpLmblf0AG1KfQcGpguw9Dw/fha+ecBaGXuT2CocZNeScZY+JUT6t6rpSmbyVDTJrdtY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-17_01:02:08', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-17T02:22:36.318 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:22:36.322 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:22:36.358 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:22:36.399 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:22:36.454 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:22:36.454 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:22:36.489 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:22:36.489 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_1 2024-08-17T02:22:36.565 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:22:36.566 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:22:36.566 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-08-17T02:22:36.566 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:22:36.566 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:22:36.566 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-08-17 02:22:26.635680742 +0000 2024-08-17T02:22:36.566 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-08-17 02:20:04.583498309 +0000 2024-08-17T02:22:36.566 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-08-17 02:20:04.583498309 +0000 2024-08-17T02:22:36.566 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-08-17 02:20:04.583498309 +0000 2024-08-17T02:22:36.566 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:22:36.658 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-08-17T02:22:36.659 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-08-17T02:22:36.659 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000244619 s, 2.1 MB/s 2024-08-17T02:22:36.661 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:22:36.698 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_2 2024-08-17T02:22:36.774 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:22:36.774 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:22:36.774 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-08-17T02:22:36.774 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:22:36.774 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:22:36.774 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-08-17 02:22:26.635680742 +0000 2024-08-17T02:22:36.775 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-08-17 02:20:05.036488376 +0000 2024-08-17T02:22:36.775 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-08-17 02:20:05.036488376 +0000 2024-08-17T02:22:36.775 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-08-17 02:20:05.036488376 +0000 2024-08-17T02:22:36.775 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:22:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-08-17T02:22:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-08-17T02:22:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000162921 s, 3.1 MB/s 2024-08-17T02:22:36.869 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:22:36.906 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_3 2024-08-17T02:22:36.981 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:22:36.981 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:22:36.981 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-08-17T02:22:36.981 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:22:36.981 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:22:36.981 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-08-17 02:22:26.636680720 +0000 2024-08-17T02:22:36.981 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-08-17 02:20:05.500478200 +0000 2024-08-17T02:22:36.982 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-08-17 02:20:05.500478200 +0000 2024-08-17T02:22:36.982 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-08-17 02:20:05.500478200 +0000 2024-08-17T02:22:36.982 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:22:37.074 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-08-17T02:22:37.075 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-08-17T02:22:37.075 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000178157 s, 2.9 MB/s 2024-08-17T02:22:37.077 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:22:37.113 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_4 2024-08-17T02:22:37.188 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:22:37.189 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:22:37.189 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-08-17T02:22:37.189 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:22:37.189 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:22:37.189 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-08-17 02:22:26.637680697 +0000 2024-08-17T02:22:37.189 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-08-17 02:20:05.976467754 +0000 2024-08-17T02:22:37.189 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-08-17 02:20:05.976467754 +0000 2024-08-17T02:22:37.189 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-08-17 02:20:05.976467754 +0000 2024-08-17T02:22:37.189 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:22:37.282 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-08-17T02:22:37.282 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-08-17T02:22:37.282 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000182668 s, 2.8 MB/s 2024-08-17T02:22:37.285 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:22:37.321 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:22:37.321 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-08-17T02:22:37.321 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:22:37.358 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:22:37.359 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_1 2024-08-17T02:22:37.435 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:22:37.435 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:22:37.435 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 6h/6d Inode: 639 Links: 1 2024-08-17T02:22:37.435 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:22:37.435 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:22:37.435 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-08-17 02:22:22.989987594 +0000 2024-08-17T02:22:37.435 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-08-17 02:19:58.691025844 +0000 2024-08-17T02:22:37.435 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-08-17 02:19:58.691025844 +0000 2024-08-17T02:22:37.435 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-08-17 02:19:58.691025844 +0000 2024-08-17T02:22:37.436 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:22:37.529 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-08-17T02:22:37.529 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-08-17T02:22:37.529 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000294777 s, 1.7 MB/s 2024-08-17T02:22:37.532 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:22:37.569 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_2 2024-08-17T02:22:37.644 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:22:37.645 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:22:37.645 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 6h/6d Inode: 657 Links: 1 2024-08-17T02:22:37.645 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:22:37.645 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:22:37.645 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-08-17 02:22:22.990987572 +0000 2024-08-17T02:22:37.645 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-08-17 02:19:59.173015167 +0000 2024-08-17T02:22:37.645 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-08-17 02:19:59.173015167 +0000 2024-08-17T02:22:37.645 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-08-17 02:19:59.173015167 +0000 2024-08-17T02:22:37.645 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:22:37.738 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-08-17T02:22:37.738 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-08-17T02:22:37.738 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000289526 s, 1.8 MB/s 2024-08-17T02:22:37.740 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:22:37.777 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_3 2024-08-17T02:22:37.852 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:22:37.852 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:22:37.852 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 6h/6d Inode: 677 Links: 1 2024-08-17T02:22:37.852 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:22:37.853 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:22:37.853 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-08-17 02:22:22.990987572 +0000 2024-08-17T02:22:37.853 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-08-17 02:19:59.665004267 +0000 2024-08-17T02:22:37.853 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-08-17 02:19:59.665004267 +0000 2024-08-17T02:22:37.853 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-08-17 02:19:59.665004267 +0000 2024-08-17T02:22:37.853 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:22:37.944 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-08-17T02:22:37.944 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-08-17T02:22:37.944 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000265889 s, 1.9 MB/s 2024-08-17T02:22:37.947 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:22:37.983 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_4 2024-08-17T02:22:38.058 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:22:38.058 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:22:38.058 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 6h/6d Inode: 696 Links: 1 2024-08-17T02:22:38.058 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:22:38.058 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:22:38.058 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-08-17 02:22:22.991987550 +0000 2024-08-17T02:22:38.058 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-08-17 02:20:00.127994011 +0000 2024-08-17T02:22:38.058 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-08-17 02:20:00.127994011 +0000 2024-08-17T02:22:38.059 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-08-17 02:20:00.127994011 +0000 2024-08-17T02:22:38.059 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:22:38.150 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-08-17T02:22:38.150 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-08-17T02:22:38.150 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000308736 s, 1.7 MB/s 2024-08-17T02:22:38.153 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:22:38.189 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:22:38.189 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi145.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:22:38.189 INFO:tasks.ceph:Generating config... 2024-08-17T02:22:38.190 INFO:tasks.ceph:[client] client mount timeout = 600 2024-08-17T02:22:38.190 INFO:tasks.ceph:[client] debug client = 20 2024-08-17T02:22:38.191 INFO:tasks.ceph:[client] debug ms = 1 2024-08-17T02:22:38.191 INFO:tasks.ceph:[client] pid file = 2024-08-17T02:22:38.191 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-08-17T02:22:38.191 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-08-17T02:22:38.191 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-08-17T02:22:38.191 INFO:tasks.ceph:[mds] debug mds = 20 2024-08-17T02:22:38.191 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-08-17T02:22:38.191 INFO:tasks.ceph:[mds] debug ms = 1 2024-08-17T02:22:38.191 INFO:tasks.ceph:[mds] mds debug frag = True 2024-08-17T02:22:38.192 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-08-17T02:22:38.192 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-08-17T02:22:38.192 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-08-17T02:22:38.192 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-08-17T02:22:38.192 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-08-17T02:22:38.192 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-08-17T02:22:38.192 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-17T02:22:38.192 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-08-17T02:22:38.192 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-17T02:22:38.192 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-17T02:22:38.192 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-17T02:22:38.192 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-17T02:22:38.192 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-17T02:22:38.192 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-08-17T02:22:38.193 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-17T02:22:38.193 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-17T02:22:38.193 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-17T02:22:38.193 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-17T02:22:38.193 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-17T02:22:38.193 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-17T02:22:38.193 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-17T02:22:38.193 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-17T02:22:38.193 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-17T02:22:38.193 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-17T02:22:38.193 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-17T02:22:38.193 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-17T02:22:38.193 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-17T02:22:38.194 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-17T02:22:38.194 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-17T02:22:38.194 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-08-17T02:22:38.194 INFO:tasks.ceph:Setting up mon.a... 2024-08-17T02:22:38.194 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-17T02:22:38.287 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.keyring 2024-08-17T02:22:38.293 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-17T02:22:38.375 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:22:38.431 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.2'), ('mon.b', '172.21.15.145'), ('mon.c', '[v2:172.21.15.145:3301,v1:172.21.15.145:6790]')] 2024-08-17T02:22:38.431 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.2,172.21.15.145,[v2:172.21.15.145:3301,v1:172.21.15.145:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-08-17T02:22:38.432 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:22:38.432 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:22:38.467 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.2 --add b 172.21.15.145 --addv c '[v2:172.21.15.145:3301,v1:172.21.15.145:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:22:38.579 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:22:38.579 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: generated fsid 66491975-1283-4d8c-92e2-26a46f113139 2024-08-17T02:22:38.579 INFO:teuthology.orchestra.run.smithi002.stdout:setting min_mon_release = octopus 2024-08-17T02:22:38.579 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 0 2024-08-17T02:22:38.579 INFO:teuthology.orchestra.run.smithi002.stdout:fsid 66491975-1283-4d8c-92e2-26a46f113139 2024-08-17T02:22:38.579 INFO:teuthology.orchestra.run.smithi002.stdout:last_changed 2024-08-17T02:22:38.579547+0000 2024-08-17T02:22:38.580 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-08-17T02:22:38.579547+0000 2024-08-17T02:22:38.580 INFO:teuthology.orchestra.run.smithi002.stdout:min_mon_release 15 (octopus) 2024-08-17T02:22:38.580 INFO:teuthology.orchestra.run.smithi002.stdout:election_strategy: 1 2024-08-17T02:22:38.580 INFO:teuthology.orchestra.run.smithi002.stdout:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-08-17T02:22:38.580 INFO:teuthology.orchestra.run.smithi002.stdout:1: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.b 2024-08-17T02:22:38.580 INFO:teuthology.orchestra.run.smithi002.stdout:2: [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] mon.c 2024-08-17T02:22:38.580 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-17T02:22:38.581 DEBUG:teuthology.orchestra.run.smithi002:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:22:38.616 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 66491975-1283-4d8c-92e2-26a46f113139... 2024-08-17T02:22:38.617 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:22:38.663 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:22:38.754 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2024-08-17T02:22:38.755 INFO:teuthology.orchestra.run.smithi002.stdout: chdir = "" 2024-08-17T02:22:38.755 INFO:teuthology.orchestra.run.smithi002.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:22:38.755 INFO:teuthology.orchestra.run.smithi002.stdout: auth supported = cephx 2024-08-17T02:22:38.755 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.755 INFO:teuthology.orchestra.run.smithi002.stdout: filestore xattr use omap = true 2024-08-17T02:22:38.755 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.755 INFO:teuthology.orchestra.run.smithi002.stdout: mon clock drift allowed = 1.000 2024-08-17T02:22:38.755 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.755 INFO:teuthology.orchestra.run.smithi002.stdout: osd crush chooseleaf type = 0 2024-08-17T02:22:38.755 INFO:teuthology.orchestra.run.smithi002.stdout: auth debug = true 2024-08-17T02:22:38.755 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.755 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on old message = true 2024-08-17T02:22:38.755 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on bug = true 2024-08-17T02:22:38.756 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.756 INFO:teuthology.orchestra.run.smithi002.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:22:38.756 INFO:teuthology.orchestra.run.smithi002.stdout: mon pg warn max object skew = 0 2024-08-17T02:22:38.756 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.756 INFO:teuthology.orchestra.run.smithi002.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:22:38.756 INFO:teuthology.orchestra.run.smithi002.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:22:38.756 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.756 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default size = 2 2024-08-17T02:22:38.756 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.756 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow primary affinity = true 2024-08-17T02:22:38.756 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow pg remap = true 2024-08-17T02:22:38.756 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:22:38.756 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:22:38.757 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on no sortbitwise = false 2024-08-17T02:22:38.757 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:22:38.757 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on too few osds = false 2024-08-17T02:22:38.757 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:22:38.757 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:22:38.757 INFO:teuthology.orchestra.run.smithi002.stdout: mon_allow_pool_size_one = true 2024-08-17T02:22:38.757 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.757 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:22:38.757 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.757 INFO:teuthology.orchestra.run.smithi002.stdout: osd default data pool replay window = 5 2024-08-17T02:22:38.757 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.757 INFO:teuthology.orchestra.run.smithi002.stdout: mon allow pool delete = true 2024-08-17T02:22:38.757 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.758 INFO:teuthology.orchestra.run.smithi002.stdout: mon cluster log file level = debug 2024-08-17T02:22:38.758 INFO:teuthology.orchestra.run.smithi002.stdout: debug asserts on shutdown = true 2024-08-17T02:22:38.758 INFO:teuthology.orchestra.run.smithi002.stdout: mon health detail to clog = false 2024-08-17T02:22:38.758 INFO:teuthology.orchestra.run.smithi002.stdout: mon host = "172.21.15.2,172.21.15.145,[v2:172.21.15.145:3301,v1:172.21.15.145:6790]" 2024-08-17T02:22:38.758 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on skipped message = False 2024-08-17T02:22:38.758 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = 66491975-1283-4d8c-92e2-26a46f113139 2024-08-17T02:22:38.758 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.758 INFO:teuthology.orchestra.run.smithi002.stdout:[osd] 2024-08-17T02:22:38.758 INFO:teuthology.orchestra.run.smithi002.stdout: osd journal size = 100 2024-08-17T02:22:38.758 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.758 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub load threshold = 5.0 2024-08-17T02:22:38.758 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub max interval = 600 2024-08-17T02:22:38.758 INFO:teuthology.orchestra.run.smithi002.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:22:38.759 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.759 INFO:teuthology.orchestra.run.smithi002.stdout: osd recover clone overlap = true 2024-08-17T02:22:38.759 INFO:teuthology.orchestra.run.smithi002.stdout: osd recovery max chunk = 1048576 2024-08-17T02:22:38.759 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.759 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug shutdown = true 2024-08-17T02:22:38.759 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug op order = true 2024-08-17T02:22:38.759 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug verify stray on activate = true 2024-08-17T02:22:38.759 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.759 INFO:teuthology.orchestra.run.smithi002.stdout: osd open classes on start = true 2024-08-17T02:22:38.759 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug pg log writeout = true 2024-08-17T02:22:38.759 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.759 INFO:teuthology.orchestra.run.smithi002.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:22:38.760 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.760 INFO:teuthology.orchestra.run.smithi002.stdout: osd map max advance = 10 2024-08-17T02:22:38.760 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.760 INFO:teuthology.orchestra.run.smithi002.stdout: journal zero on create = true 2024-08-17T02:22:38.760 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.760 INFO:teuthology.orchestra.run.smithi002.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:22:38.760 INFO:teuthology.orchestra.run.smithi002.stdout: filestore apply finisher threads = 3 2024-08-17T02:22:38.760 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.760 INFO:teuthology.orchestra.run.smithi002.stdout: bdev debug aio = true 2024-08-17T02:22:38.760 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug misdirected ops = true 2024-08-17T02:22:38.760 INFO:teuthology.orchestra.run.smithi002.stdout: bdev async discard = True 2024-08-17T02:22:38.760 INFO:teuthology.orchestra.run.smithi002.stdout: bdev enable discard = True 2024-08-17T02:22:38.760 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore allocator = bitmap 2024-08-17T02:22:38.761 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore block size = 96636764160 2024-08-17T02:22:38.761 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore fsck on mount = True 2024-08-17T02:22:38.761 INFO:teuthology.orchestra.run.smithi002.stdout: debug bluefs = 1/20 2024-08-17T02:22:38.761 INFO:teuthology.orchestra.run.smithi002.stdout: debug bluestore = 1/20 2024-08-17T02:22:38.761 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-08-17T02:22:38.761 INFO:teuthology.orchestra.run.smithi002.stdout: debug osd = 20 2024-08-17T02:22:38.761 INFO:teuthology.orchestra.run.smithi002.stdout: debug rocksdb = 4/10 2024-08-17T02:22:38.761 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:22:38.761 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd full ratio = 0.9 2024-08-17T02:22:38.761 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:22:38.761 INFO:teuthology.orchestra.run.smithi002.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:22:38.761 INFO:teuthology.orchestra.run.smithi002.stdout: osd objectstore = bluestore 2024-08-17T02:22:38.762 INFO:teuthology.orchestra.run.smithi002.stdout: osd op complaint time = 180 2024-08-17T02:22:38.762 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.762 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr] 2024-08-17T02:22:38.762 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-08-17T02:22:38.762 INFO:teuthology.orchestra.run.smithi002.stdout: debug mgr = 20 2024-08-17T02:22:38.762 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2024-08-17T02:22:38.762 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2024-08-17T02:22:38.762 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:22:38.762 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:22:38.762 INFO:teuthology.orchestra.run.smithi002.stdout: mgr/telemetry/nag = false 2024-08-17T02:22:38.762 INFO:teuthology.orchestra.run.smithi002.stdout: debug client = 20 2024-08-17T02:22:38.762 INFO:teuthology.orchestra.run.smithi002.stdout: debug finisher = 20 2024-08-17T02:22:38.762 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.763 INFO:teuthology.orchestra.run.smithi002.stdout:[mon] 2024-08-17T02:22:38.763 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-08-17T02:22:38.763 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2024-08-17T02:22:38.763 INFO:teuthology.orchestra.run.smithi002.stdout: debug paxos = 20 2024-08-17T02:22:38.763 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2024-08-17T02:22:38.763 INFO:teuthology.orchestra.run.smithi002.stdout: mon data avail warn = 5 2024-08-17T02:22:38.763 INFO:teuthology.orchestra.run.smithi002.stdout: mon mgr mkfs grace = 240 2024-08-17T02:22:38.763 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:22:38.763 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd reporter subtree level = osd 2024-08-17T02:22:38.763 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd prime pg temp = true 2024-08-17T02:22:38.763 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:22:38.763 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.763 INFO:teuthology.orchestra.run.smithi002.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:22:38.764 INFO:teuthology.orchestra.run.smithi002.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:22:38.764 INFO:teuthology.orchestra.run.smithi002.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:22:38.764 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.764 INFO:teuthology.orchestra.run.smithi002.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:22:38.764 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:22:38.764 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:22:38.764 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.764 INFO:teuthology.orchestra.run.smithi002.stdout: # 1m isn't quite enough 2024-08-17T02:22:38.764 INFO:teuthology.orchestra.run.smithi002.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:22:38.764 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.764 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:22:38.764 INFO:teuthology.orchestra.run.smithi002.stdout: mon op complaint time = 120 2024-08-17T02:22:38.764 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:22:38.764 INFO:teuthology.orchestra.run.smithi002.stdout:[client] 2024-08-17T02:22:38.765 INFO:teuthology.orchestra.run.smithi002.stdout: rgw cache enabled = true 2024-08-17T02:22:38.765 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable ops log = true 2024-08-17T02:22:38.765 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable usage log = true 2024-08-17T02:22:38.765 INFO:teuthology.orchestra.run.smithi002.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:22:38.765 INFO:teuthology.orchestra.run.smithi002.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:22:38.765 INFO:teuthology.orchestra.run.smithi002.stdout: client mount timeout = 600 2024-08-17T02:22:38.765 INFO:teuthology.orchestra.run.smithi002.stdout: debug client = 20 2024-08-17T02:22:38.765 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-08-17T02:22:38.765 INFO:teuthology.orchestra.run.smithi002.stdout: pid file = "" 2024-08-17T02:22:38.765 INFO:teuthology.orchestra.run.smithi002.stdout: rados mon op timeout = 900 2024-08-17T02:22:38.765 INFO:teuthology.orchestra.run.smithi002.stdout: rados osd op timeout = 900 2024-08-17T02:22:38.765 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.a] 2024-08-17T02:22:38.765 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.b] 2024-08-17T02:22:38.766 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.c] 2024-08-17T02:22:38.766 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a] 2024-08-17T02:22:38.766 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.c] 2024-08-17T02:22:38.766 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b] 2024-08-17T02:22:38.766 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.d] 2024-08-17T02:22:38.766 INFO:teuthology.orchestra.run.smithi002.stdout:[mds] 2024-08-17T02:22:38.766 INFO:teuthology.orchestra.run.smithi002.stdout: debug mds = 20 2024-08-17T02:22:38.766 INFO:teuthology.orchestra.run.smithi002.stdout: debug mds balancer = 20 2024-08-17T02:22:38.766 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-08-17T02:22:38.766 INFO:teuthology.orchestra.run.smithi002.stdout: mds debug frag = True 2024-08-17T02:22:38.766 INFO:teuthology.orchestra.run.smithi002.stdout: mds debug scatterstat = True 2024-08-17T02:22:38.766 INFO:teuthology.orchestra.run.smithi002.stdout: mds op complaint time = 180 2024-08-17T02:22:38.766 INFO:teuthology.orchestra.run.smithi002.stdout: mds verify scatter = True 2024-08-17T02:22:38.767 INFO:teuthology.orchestra.run.smithi002.stdout: osd op complaint time = 180 2024-08-17T02:22:38.767 INFO:teuthology.orchestra.run.smithi002.stdout: rados mon op timeout = 900 2024-08-17T02:22:38.767 INFO:teuthology.orchestra.run.smithi002.stdout: rados osd op timeout = 900 2024-08-17T02:22:38.767 INFO:teuthology.orchestra.run.smithi145.stdout:[global] 2024-08-17T02:22:38.767 INFO:teuthology.orchestra.run.smithi145.stdout: chdir = "" 2024-08-17T02:22:38.767 INFO:teuthology.orchestra.run.smithi145.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:22:38.767 INFO:teuthology.orchestra.run.smithi145.stdout: auth supported = cephx 2024-08-17T02:22:38.768 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.768 INFO:teuthology.orchestra.run.smithi145.stdout: filestore xattr use omap = true 2024-08-17T02:22:38.768 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.768 INFO:teuthology.orchestra.run.smithi145.stdout: mon clock drift allowed = 1.000 2024-08-17T02:22:38.768 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.768 INFO:teuthology.orchestra.run.smithi145.stdout: osd crush chooseleaf type = 0 2024-08-17T02:22:38.768 INFO:teuthology.orchestra.run.smithi145.stdout: auth debug = true 2024-08-17T02:22:38.768 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.768 INFO:teuthology.orchestra.run.smithi145.stdout: ms die on old message = true 2024-08-17T02:22:38.768 INFO:teuthology.orchestra.run.smithi145.stdout: ms die on bug = true 2024-08-17T02:22:38.768 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.768 INFO:teuthology.orchestra.run.smithi145.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:22:38.769 INFO:teuthology.orchestra.run.smithi145.stdout: mon pg warn max object skew = 0 2024-08-17T02:22:38.769 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.769 INFO:teuthology.orchestra.run.smithi145.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:22:38.769 INFO:teuthology.orchestra.run.smithi145.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:22:38.769 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.769 INFO:teuthology.orchestra.run.smithi145.stdout: osd pool default size = 2 2024-08-17T02:22:38.769 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.769 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd allow primary affinity = true 2024-08-17T02:22:38.769 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd allow pg remap = true 2024-08-17T02:22:38.769 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:22:38.769 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:22:38.769 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on no sortbitwise = false 2024-08-17T02:22:38.769 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:22:38.770 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on too few osds = false 2024-08-17T02:22:38.770 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:22:38.770 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:22:38.770 INFO:teuthology.orchestra.run.smithi145.stdout: mon_allow_pool_size_one = true 2024-08-17T02:22:38.770 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.770 INFO:teuthology.orchestra.run.smithi145.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:22:38.770 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.770 INFO:teuthology.orchestra.run.smithi145.stdout: osd default data pool replay window = 5 2024-08-17T02:22:38.770 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.770 INFO:teuthology.orchestra.run.smithi145.stdout: mon allow pool delete = true 2024-08-17T02:22:38.770 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.770 INFO:teuthology.orchestra.run.smithi145.stdout: mon cluster log file level = debug 2024-08-17T02:22:38.770 INFO:teuthology.orchestra.run.smithi145.stdout: debug asserts on shutdown = true 2024-08-17T02:22:38.771 INFO:teuthology.orchestra.run.smithi145.stdout: mon health detail to clog = false 2024-08-17T02:22:38.771 INFO:teuthology.orchestra.run.smithi145.stdout: mon host = "172.21.15.2,172.21.15.145,[v2:172.21.15.145:3301,v1:172.21.15.145:6790]" 2024-08-17T02:22:38.771 INFO:teuthology.orchestra.run.smithi145.stdout: ms die on skipped message = False 2024-08-17T02:22:38.771 INFO:teuthology.orchestra.run.smithi145.stdout: fsid = 66491975-1283-4d8c-92e2-26a46f113139 2024-08-17T02:22:38.771 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.771 INFO:teuthology.orchestra.run.smithi145.stdout:[osd] 2024-08-17T02:22:38.771 INFO:teuthology.orchestra.run.smithi145.stdout: osd journal size = 100 2024-08-17T02:22:38.771 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.771 INFO:teuthology.orchestra.run.smithi145.stdout: osd scrub load threshold = 5.0 2024-08-17T02:22:38.771 INFO:teuthology.orchestra.run.smithi145.stdout: osd scrub max interval = 600 2024-08-17T02:22:38.771 INFO:teuthology.orchestra.run.smithi145.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:22:38.772 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.772 INFO:teuthology.orchestra.run.smithi145.stdout: osd recover clone overlap = true 2024-08-17T02:22:38.772 INFO:teuthology.orchestra.run.smithi145.stdout: osd recovery max chunk = 1048576 2024-08-17T02:22:38.772 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.772 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug shutdown = true 2024-08-17T02:22:38.772 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug op order = true 2024-08-17T02:22:38.772 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug verify stray on activate = true 2024-08-17T02:22:38.772 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.772 INFO:teuthology.orchestra.run.smithi145.stdout: osd open classes on start = true 2024-08-17T02:22:38.772 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug pg log writeout = true 2024-08-17T02:22:38.772 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.772 INFO:teuthology.orchestra.run.smithi145.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:22:38.773 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.773 INFO:teuthology.orchestra.run.smithi145.stdout: osd map max advance = 10 2024-08-17T02:22:38.773 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.773 INFO:teuthology.orchestra.run.smithi145.stdout: journal zero on create = true 2024-08-17T02:22:38.773 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.773 INFO:teuthology.orchestra.run.smithi145.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:22:38.773 INFO:teuthology.orchestra.run.smithi145.stdout: filestore apply finisher threads = 3 2024-08-17T02:22:38.773 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.773 INFO:teuthology.orchestra.run.smithi145.stdout: bdev debug aio = true 2024-08-17T02:22:38.773 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug misdirected ops = true 2024-08-17T02:22:38.773 INFO:teuthology.orchestra.run.smithi145.stdout: bdev async discard = True 2024-08-17T02:22:38.773 INFO:teuthology.orchestra.run.smithi145.stdout: bdev enable discard = True 2024-08-17T02:22:38.773 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore allocator = bitmap 2024-08-17T02:22:38.774 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore block size = 96636764160 2024-08-17T02:22:38.774 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore fsck on mount = True 2024-08-17T02:22:38.774 INFO:teuthology.orchestra.run.smithi145.stdout: debug bluefs = 1/20 2024-08-17T02:22:38.774 INFO:teuthology.orchestra.run.smithi145.stdout: debug bluestore = 1/20 2024-08-17T02:22:38.774 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-08-17T02:22:38.774 INFO:teuthology.orchestra.run.smithi145.stdout: debug osd = 20 2024-08-17T02:22:38.774 INFO:teuthology.orchestra.run.smithi145.stdout: debug rocksdb = 4/10 2024-08-17T02:22:38.774 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:22:38.774 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd full ratio = 0.9 2024-08-17T02:22:38.774 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:22:38.774 INFO:teuthology.orchestra.run.smithi145.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:22:38.774 INFO:teuthology.orchestra.run.smithi145.stdout: osd objectstore = bluestore 2024-08-17T02:22:38.774 INFO:teuthology.orchestra.run.smithi145.stdout: osd op complaint time = 180 2024-08-17T02:22:38.775 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.775 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr] 2024-08-17T02:22:38.775 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-08-17T02:22:38.775 INFO:teuthology.orchestra.run.smithi145.stdout: debug mgr = 20 2024-08-17T02:22:38.775 INFO:teuthology.orchestra.run.smithi145.stdout: debug mon = 20 2024-08-17T02:22:38.775 INFO:teuthology.orchestra.run.smithi145.stdout: debug auth = 20 2024-08-17T02:22:38.775 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:22:38.775 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:22:38.775 INFO:teuthology.orchestra.run.smithi145.stdout: mgr/telemetry/nag = false 2024-08-17T02:22:38.776 INFO:teuthology.orchestra.run.smithi145.stdout: debug client = 20 2024-08-17T02:22:38.776 INFO:teuthology.orchestra.run.smithi145.stdout: debug finisher = 20 2024-08-17T02:22:38.776 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.776 INFO:teuthology.orchestra.run.smithi145.stdout:[mon] 2024-08-17T02:22:38.776 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-08-17T02:22:38.776 INFO:teuthology.orchestra.run.smithi145.stdout: debug mon = 20 2024-08-17T02:22:38.776 INFO:teuthology.orchestra.run.smithi145.stdout: debug paxos = 20 2024-08-17T02:22:38.776 INFO:teuthology.orchestra.run.smithi145.stdout: debug auth = 20 2024-08-17T02:22:38.776 INFO:teuthology.orchestra.run.smithi145.stdout: mon data avail warn = 5 2024-08-17T02:22:38.776 INFO:teuthology.orchestra.run.smithi145.stdout: mon mgr mkfs grace = 240 2024-08-17T02:22:38.776 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:22:38.776 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd reporter subtree level = osd 2024-08-17T02:22:38.776 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd prime pg temp = true 2024-08-17T02:22:38.777 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:22:38.777 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.777 INFO:teuthology.orchestra.run.smithi145.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:22:38.777 INFO:teuthology.orchestra.run.smithi145.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:22:38.777 INFO:teuthology.orchestra.run.smithi145.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:22:38.777 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.777 INFO:teuthology.orchestra.run.smithi145.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:22:38.777 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:22:38.777 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:22:38.777 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.777 INFO:teuthology.orchestra.run.smithi145.stdout: # 1m isn't quite enough 2024-08-17T02:22:38.777 INFO:teuthology.orchestra.run.smithi145.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:22:38.777 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.778 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:22:38.778 INFO:teuthology.orchestra.run.smithi145.stdout: mon op complaint time = 120 2024-08-17T02:22:38.778 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-08-17T02:22:38.778 INFO:teuthology.orchestra.run.smithi145.stdout:[client] 2024-08-17T02:22:38.778 INFO:teuthology.orchestra.run.smithi145.stdout: rgw cache enabled = true 2024-08-17T02:22:38.778 INFO:teuthology.orchestra.run.smithi145.stdout: rgw enable ops log = true 2024-08-17T02:22:38.778 INFO:teuthology.orchestra.run.smithi145.stdout: rgw enable usage log = true 2024-08-17T02:22:38.778 INFO:teuthology.orchestra.run.smithi145.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:22:38.778 INFO:teuthology.orchestra.run.smithi145.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:22:38.778 INFO:teuthology.orchestra.run.smithi145.stdout: client mount timeout = 600 2024-08-17T02:22:38.778 INFO:teuthology.orchestra.run.smithi145.stdout: debug client = 20 2024-08-17T02:22:38.778 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-08-17T02:22:38.778 INFO:teuthology.orchestra.run.smithi145.stdout: pid file = "" 2024-08-17T02:22:38.778 INFO:teuthology.orchestra.run.smithi145.stdout: rados mon op timeout = 900 2024-08-17T02:22:38.779 INFO:teuthology.orchestra.run.smithi145.stdout: rados osd op timeout = 900 2024-08-17T02:22:38.779 INFO:teuthology.orchestra.run.smithi145.stdout:[mon.a] 2024-08-17T02:22:38.779 INFO:teuthology.orchestra.run.smithi145.stdout:[mon.b] 2024-08-17T02:22:38.779 INFO:teuthology.orchestra.run.smithi145.stdout:[mon.c] 2024-08-17T02:22:38.779 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.a] 2024-08-17T02:22:38.779 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.c] 2024-08-17T02:22:38.779 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.b] 2024-08-17T02:22:38.779 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.d] 2024-08-17T02:22:38.779 INFO:teuthology.orchestra.run.smithi145.stdout:[mds] 2024-08-17T02:22:38.779 INFO:teuthology.orchestra.run.smithi145.stdout: debug mds = 20 2024-08-17T02:22:38.779 INFO:teuthology.orchestra.run.smithi145.stdout: debug mds balancer = 20 2024-08-17T02:22:38.779 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-08-17T02:22:38.779 INFO:teuthology.orchestra.run.smithi145.stdout: mds debug frag = True 2024-08-17T02:22:38.779 INFO:teuthology.orchestra.run.smithi145.stdout: mds debug scatterstat = True 2024-08-17T02:22:38.780 INFO:teuthology.orchestra.run.smithi145.stdout: mds op complaint time = 180 2024-08-17T02:22:38.780 INFO:teuthology.orchestra.run.smithi145.stdout: mds verify scatter = True 2024-08-17T02:22:38.780 INFO:teuthology.orchestra.run.smithi145.stdout: osd op complaint time = 180 2024-08-17T02:22:38.780 INFO:teuthology.orchestra.run.smithi145.stdout: rados mon op timeout = 900 2024-08-17T02:22:38.780 INFO:teuthology.orchestra.run.smithi145.stdout: rados osd op timeout = 900 2024-08-17T02:22:38.787 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-17T02:22:38.787 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-17T02:22:38.878 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-17T02:22:38.878 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:22:38.878 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-17T02:22:38.913 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:22:38.913 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-17T02:22:38.987 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:22:38.987 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:22:38.988 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:22:38.988 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:22:39.106 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:22:39.106 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:22:39.181 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi145.front.sepia.ceph.com 2024-08-17T02:22:39.181 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-08-17T02:22:39.181 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:22:39.181 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:22:39.258 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-08-17T02:22:39.258 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:22:39.333 INFO:tasks.ceph:Setting up mon nodes... 2024-08-17T02:22:39.333 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-17T02:22:39.334 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:22:39.433 INFO:teuthology.orchestra.run.smithi002.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:22:39.438 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:22:39.543 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:22:39.549 INFO:tasks.ceph:Setting up mds nodes... 2024-08-17T02:22:39.549 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:22:39.648 INFO:teuthology.orchestra.run.smithi002.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:22:39.653 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-17T02:22:39.708 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:22:39.807 INFO:teuthology.orchestra.run.smithi002.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:22:39.811 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-17T02:22:39.868 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:22:39.966 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:22:39.970 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-17T02:22:40.025 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:22:40.122 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:22:40.126 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-17T02:22:40.181 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-17T02:22:40.182 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-17T02:22:40.258 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-17T02:22:40.285 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-08-17T02:22:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-08-17T02:22:40.387 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-17T02:22:40.462 INFO:teuthology.orchestra.run.smithi145.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-17T02:22:40.488 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-08-17T02:22:40.562 INFO:teuthology.orchestra.run.smithi145.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-08-17T02:22:40.589 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-17T02:22:40.589 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi145.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:22:40.589 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-17T02:22:40.645 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:22:40.645 INFO:tasks.ceph:role: osd.0 2024-08-17T02:22:40.645 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:22:40.646 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:22:40.701 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:22:40.701 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:22:40.701 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:22:40.701 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:22:40.701 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:22:40.701 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:22:40.701 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:22:40.701 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:22:40.702 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:22:40.702 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:22:40.734 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2024-08-17T02:22:40.738 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2024-08-17T02:22:40.738 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-17T02:22:40.818 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-17T02:22:40.881 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-17T02:22:40.938 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:22:40.938 INFO:tasks.ceph:role: osd.1 2024-08-17T02:22:40.938 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:22:40.939 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:22:40.995 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:22:40.995 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:22:40.995 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:22:40.995 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:22:40.995 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:22:40.995 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:22:40.996 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:22:40.996 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:22:40.996 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:22:40.996 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:22:41.028 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2024-08-17T02:22:41.032 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2024-08-17T02:22:41.032 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-17T02:22:41.112 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-17T02:22:41.174 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-17T02:22:41.232 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:22:41.232 INFO:tasks.ceph:role: osd.2 2024-08-17T02:22:41.232 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:22:41.232 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:22:41.288 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:22:41.289 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:22:41.289 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:22:41.289 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:22:41.289 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:22:41.289 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:22:41.289 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:22:41.289 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:22:41.289 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:22:41.289 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:22:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2024-08-17T02:22:41.326 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2024-08-17T02:22:41.326 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-17T02:22:41.410 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-17T02:22:41.480 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-17T02:22:41.537 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:22:41.537 INFO:tasks.ceph:role: osd.3 2024-08-17T02:22:41.537 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:22:41.537 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:22:41.594 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:22:41.594 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:22:41.594 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:22:41.594 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:22:41.594 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:22:41.594 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:22:41.594 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:22:41.594 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:22:41.594 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:22:41.594 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:22:41.628 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2024-08-17T02:22:41.633 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2024-08-17T02:22:41.700 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-17T02:22:41.782 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-17T02:22:41.845 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:22:41.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:41.947+0000 7fa26be322c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-17T02:22:41.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:41.948+0000 7fa26be322c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-17T02:22:41.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:41.948+0000 7fa26be322c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:22:41.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:41.948+0000 7fa26be322c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:22:41.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:41.948+0000 7fa26be322c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:22:41.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:41.951+0000 7fa26be322c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-17T02:22:42.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:42.499+0000 7fa26be322c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:43.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:43.273+0000 7fa26be322c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:44.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:44.039+0000 7fa26be322c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:44.873 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-17T02:22:44.934 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:22:45.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:45.021+0000 7f2f2fe172c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-17T02:22:45.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:45.021+0000 7f2f2fe172c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-17T02:22:45.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:45.021+0000 7f2f2fe172c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:22:45.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:45.021+0000 7f2f2fe172c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:22:45.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:45.021+0000 7f2f2fe172c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:22:45.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:45.023+0000 7f2f2fe172c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-17T02:22:45.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:45.570+0000 7f2f2fe172c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:46.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:46.329+0000 7f2f2fe172c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:47.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:47.102+0000 7f2f2fe172c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:47.934 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-17T02:22:47.996 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:22:48.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:48.083+0000 7f7bb5c0e2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-17T02:22:48.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:48.083+0000 7f7bb5c0e2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-17T02:22:48.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:48.083+0000 7f7bb5c0e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:22:48.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:48.083+0000 7f7bb5c0e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:22:48.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:48.083+0000 7f7bb5c0e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:22:48.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:48.084+0000 7f7bb5c0e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-17T02:22:48.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:48.628+0000 7f7bb5c0e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:49.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:49.396+0000 7f7bb5c0e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:50.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:50.168+0000 7f7bb5c0e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:50.984 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-17T02:22:51.045 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:22:51.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:51.132+0000 7f3d5611f2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-17T02:22:51.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:51.132+0000 7f3d5611f2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-17T02:22:51.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:51.132+0000 7f3d5611f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:22:51.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:51.132+0000 7f3d5611f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:22:51.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:51.132+0000 7f3d5611f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:22:51.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:51.134+0000 7f3d5611f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-17T02:22:51.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:51.689+0000 7f3d5611f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:52.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:52.475+0000 7f3d5611f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:53.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:22:53.239+0000 7f3d5611f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:54.069 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-17T02:22:54.129 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-17T02:22:54.191 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:22:54.191 INFO:tasks.ceph:role: osd.4 2024-08-17T02:22:54.191 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi145.front.sepia.ceph.com 2024-08-17T02:22:54.192 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:22:54.257 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:22:54.257 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:22:54.257 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:22:54.257 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:22:54.257 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:22:54.258 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:22:54.258 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:22:54.258 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:22:54.258 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:22:54.258 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:22:54.653 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2024-08-17T02:22:54.658 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2024-08-17T02:22:54.658 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-17T02:22:54.805 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-17T02:22:54.872 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-17T02:22:54.929 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:22:54.930 INFO:tasks.ceph:role: osd.5 2024-08-17T02:22:54.930 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi145.front.sepia.ceph.com 2024-08-17T02:22:54.930 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:22:54.997 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:22:54.998 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:22:54.998 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:22:54.998 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:22:54.998 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:22:54.998 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:22:54.998 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:22:54.998 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:22:54.998 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:22:54.998 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:22:55.354 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2024-08-17T02:22:55.361 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2024-08-17T02:22:55.361 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-17T02:22:55.448 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-17T02:22:55.509 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-17T02:22:55.564 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:22:55.564 INFO:tasks.ceph:role: osd.6 2024-08-17T02:22:55.564 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi145.front.sepia.ceph.com 2024-08-17T02:22:55.564 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:22:55.627 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:22:55.627 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:22:55.627 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:22:55.627 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:22:55.627 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:22:55.627 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:22:55.627 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:22:55.627 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:22:55.627 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:22:55.627 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:22:56.010 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2024-08-17T02:22:56.014 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2024-08-17T02:22:56.015 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-17T02:22:56.116 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-17T02:22:56.177 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-17T02:22:56.233 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:22:56.233 INFO:tasks.ceph:role: osd.7 2024-08-17T02:22:56.233 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi145.front.sepia.ceph.com 2024-08-17T02:22:56.234 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:22:56.297 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:22:56.297 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:22:56.297 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:22:56.297 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:22:56.297 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:22:56.297 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:22:56.297 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:22:56.298 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:22:56.298 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:22:56.298 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:22:56.715 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2024-08-17T02:22:56.719 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2024-08-17T02:22:56.719 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-17T02:22:56.849 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-17T02:22:56.912 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:22:57.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:22:57.008+0000 7f767e5212c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-17T02:22:57.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:22:57.012+0000 7f767e5212c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-17T02:22:57.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:22:57.012+0000 7f767e5212c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:22:57.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:22:57.012+0000 7f767e5212c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:22:57.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:22:57.012+0000 7f767e5212c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:22:57.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:22:57.019+0000 7f767e5212c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-17T02:22:57.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:22:57.564+0000 7f767e5212c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:58.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:22:58.333+0000 7f767e5212c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:59.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:22:59.101+0000 7f767e5212c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:59.928 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-17T02:22:59.986 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:00.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:00.070+0000 7fd11951f2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-17T02:23:00.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:00.071+0000 7fd11951f2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-17T02:23:00.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:00.071+0000 7fd11951f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:23:00.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:00.071+0000 7fd11951f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:23:00.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:00.071+0000 7fd11951f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:23:00.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:00.073+0000 7fd11951f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-17T02:23:00.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:00.633+0000 7fd11951f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:01.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:01.402+0000 7fd11951f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:02.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:02.176+0000 7fd11951f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:02.997 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-17T02:23:03.057 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:03.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:03.140+0000 7fa3c4a672c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-17T02:23:03.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:03.141+0000 7fa3c4a672c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-17T02:23:03.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:03.141+0000 7fa3c4a672c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:23:03.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:03.141+0000 7fa3c4a672c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:23:03.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:03.141+0000 7fa3c4a672c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:23:03.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:03.143+0000 7fa3c4a672c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-17T02:23:03.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:03.688+0000 7fa3c4a672c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:04.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:04.462+0000 7fa3c4a672c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:05.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:05.233+0000 7fa3c4a672c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:06.088 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-17T02:23:06.144 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:06.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:06.227+0000 7f0c842102c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-17T02:23:06.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:06.227+0000 7f0c842102c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-17T02:23:06.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:06.227+0000 7f0c842102c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:23:06.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:06.227+0000 7f0c842102c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:23:06.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:06.227+0000 7f0c842102c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:23:06.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:06.229+0000 7f0c842102c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-17T02:23:06.319 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:23:06.324 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:23:06.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:06.772+0000 7f0c842102c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:07.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:07.543+0000 7f0c842102c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:08.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:08.323+0000 7f0c842102c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:09.141 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-17T02:23:09.198 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-17T02:23:09.198 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:23:09.199 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-17T02:23:09.261 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:23:09.261 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-17T02:23:09.360 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:23:09.361 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-17T02:23:09.458 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:23:09.459 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-17T02:23:09.555 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:23:09.555 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-17T02:23:09.651 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:23:09.651 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-17T02:23:09.751 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:23:09.751 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-17T02:23:09.847 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-08-17T02:23:09.848 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-17T02:23:09.907 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-08-17T02:23:09.907 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-17T02:23:10.004 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-08-17T02:23:10.004 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-17T02:23:10.099 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-08-17T02:23:10.100 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-17T02:23:10.194 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-08-17T02:23:10.195 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-17T02:23:10.289 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-08-17T02:23:10.290 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-17T02:23:10.385 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-08-17T02:23:10.385 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-17T02:23:10.480 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:23:10.481 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-17T02:23:10.519 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:23:10.519 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-08-17T02:23:10.597 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-08-17T02:23:10.597 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-17T02:23:10.632 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-08-17T02:23:10.632 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-08-17T02:23:10.707 INFO:tasks.ceph:Adding keys to all mons... 2024-08-17T02:23:10.707 DEBUG:teuthology.orchestra.run.smithi002:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:23:10.711 DEBUG:teuthology.orchestra.run.smithi145:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:23:10.764 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr.y] 2024-08-17T02:23:10.764 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBvCcBmB03dGRAAyO2HdzwzRHbPmPbrniDmdg== 2024-08-17T02:23:10.764 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a] 2024-08-17T02:23:10.764 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBvCcBmb9GqJhAAjrQLZjEhK0srQETT3P69Ng== 2024-08-17T02:23:10.764 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.c] 2024-08-17T02:23:10.764 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBvCcBmI8MnMBAA9PSoSvdG6kH2HD+WdhsVGw== 2024-08-17T02:23:10.764 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.0] 2024-08-17T02:23:10.764 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBxCcBmCrWGOBAAmZWigQg/P7akSJVjplcKvg== 2024-08-17T02:23:10.764 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.1] 2024-08-17T02:23:10.765 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQB1CcBm7fhIARAANtK9JQfxZVBwT+oVkINk3w== 2024-08-17T02:23:10.765 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.2] 2024-08-17T02:23:10.765 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQB4CcBmRF75BBAADNzPVcb2yvLXHgS+UmzWPQ== 2024-08-17T02:23:10.765 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.3] 2024-08-17T02:23:10.765 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQB7CcBmDOTrBxAASyI0BQz8oCWUv+1qjIy/wg== 2024-08-17T02:23:10.765 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr.x] 2024-08-17T02:23:10.765 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBvCcBmtDxrIBAAolNgIbldebcVMGMphE133Q== 2024-08-17T02:23:10.765 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b] 2024-08-17T02:23:10.765 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBvCcBmkROjORAAqWPiQxu1+5BIe95RedFjQg== 2024-08-17T02:23:10.765 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.d] 2024-08-17T02:23:10.765 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBwCcBmBSFRBxAAP1nEz2KnWwYlwcisXK0a9g== 2024-08-17T02:23:10.765 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.4] 2024-08-17T02:23:10.765 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCBCcBmNZCMABAA7+GJp5LfDxOX0FhF/gpYcA== 2024-08-17T02:23:10.766 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.5] 2024-08-17T02:23:10.766 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCECcBmtORCBBAAn0lNM1S6REDpCCbjB94ooA== 2024-08-17T02:23:10.766 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.6] 2024-08-17T02:23:10.766 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCHCcBm68hzCBAAFb21xFgI5LySVcHt1gP0aQ== 2024-08-17T02:23:10.766 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.7] 2024-08-17T02:23:10.766 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCKCcBm8gaXDRAAK7SLxSJO9FXHBIQZB8ouQA== 2024-08-17T02:23:10.766 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2024-08-17T02:23:10.766 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBwCcBmssdtDxAASkIYITbSqZHZouto8BcmZw== 2024-08-17T02:23:10.766 INFO:teuthology.orchestra.run.smithi002.stdout:[client.2] 2024-08-17T02:23:10.766 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBwCcBmNH6AFRAAXVSUQfj7HQae+UNNB3b52Q== 2024-08-17T02:23:10.766 INFO:teuthology.orchestra.run.smithi002.stdout:[client.1] 2024-08-17T02:23:10.766 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBwCcBmFSeSGxAAJsRcOdtuooES7d/9tdnz1A== 2024-08-17T02:23:10.766 INFO:teuthology.orchestra.run.smithi002.stdout:[client.3] 2024-08-17T02:23:10.767 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBwCcBmwlOTIRAAKN1PcscSDN/CX7uH7vbEjQ== 2024-08-17T02:23:10.799 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr.y] 2024-08-17T02:23:10.800 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBvCcBmB03dGRAAyO2HdzwzRHbPmPbrniDmdg== 2024-08-17T02:23:10.800 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.a] 2024-08-17T02:23:10.800 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBvCcBmb9GqJhAAjrQLZjEhK0srQETT3P69Ng== 2024-08-17T02:23:10.800 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.c] 2024-08-17T02:23:10.800 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBvCcBmI8MnMBAA9PSoSvdG6kH2HD+WdhsVGw== 2024-08-17T02:23:10.800 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.0] 2024-08-17T02:23:10.800 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBxCcBmCrWGOBAAmZWigQg/P7akSJVjplcKvg== 2024-08-17T02:23:10.800 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.1] 2024-08-17T02:23:10.800 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQB1CcBm7fhIARAANtK9JQfxZVBwT+oVkINk3w== 2024-08-17T02:23:10.800 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.2] 2024-08-17T02:23:10.800 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQB4CcBmRF75BBAADNzPVcb2yvLXHgS+UmzWPQ== 2024-08-17T02:23:10.800 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.3] 2024-08-17T02:23:10.801 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQB7CcBmDOTrBxAASyI0BQz8oCWUv+1qjIy/wg== 2024-08-17T02:23:10.801 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr.x] 2024-08-17T02:23:10.801 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBvCcBmtDxrIBAAolNgIbldebcVMGMphE133Q== 2024-08-17T02:23:10.801 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.b] 2024-08-17T02:23:10.801 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBvCcBmkROjORAAqWPiQxu1+5BIe95RedFjQg== 2024-08-17T02:23:10.801 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.d] 2024-08-17T02:23:10.801 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBwCcBmBSFRBxAAP1nEz2KnWwYlwcisXK0a9g== 2024-08-17T02:23:10.801 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.4] 2024-08-17T02:23:10.801 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCBCcBmNZCMABAA7+GJp5LfDxOX0FhF/gpYcA== 2024-08-17T02:23:10.801 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.5] 2024-08-17T02:23:10.801 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCECcBmtORCBBAAn0lNM1S6REDpCCbjB94ooA== 2024-08-17T02:23:10.801 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.6] 2024-08-17T02:23:10.801 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCHCcBm68hzCBAAFb21xFgI5LySVcHt1gP0aQ== 2024-08-17T02:23:10.802 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.7] 2024-08-17T02:23:10.802 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCKCcBm8gaXDRAAK7SLxSJO9FXHBIQZB8ouQA== 2024-08-17T02:23:10.802 INFO:teuthology.orchestra.run.smithi145.stdout:[client.0] 2024-08-17T02:23:10.802 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBwCcBmssdtDxAASkIYITbSqZHZouto8BcmZw== 2024-08-17T02:23:10.802 INFO:teuthology.orchestra.run.smithi145.stdout:[client.2] 2024-08-17T02:23:10.802 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBwCcBmNH6AFRAAXVSUQfj7HQae+UNNB3b52Q== 2024-08-17T02:23:10.802 INFO:teuthology.orchestra.run.smithi145.stdout:[client.1] 2024-08-17T02:23:10.802 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBwCcBmFSeSGxAAJsRcOdtuooES7d/9tdnz1A== 2024-08-17T02:23:10.802 INFO:teuthology.orchestra.run.smithi145.stdout:[client.3] 2024-08-17T02:23:10.802 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBwCcBmwlOTIRAAKN1PcscSDN/CX7uH7vbEjQ== 2024-08-17T02:23:10.803 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:23:10.812 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:23:10.930 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:23:10.934 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:23:11.023 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:23:11.027 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:23:11.116 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:11.120 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:11.207 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:11.211 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:11.298 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:11.302 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:11.390 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:11.394 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:11.481 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:23:11.484 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:23:11.571 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:23:11.575 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:23:11.665 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:23:11.669 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:23:11.758 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:11.762 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:11.849 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:11.853 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:11.940 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:11.944 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:12.030 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:12.034 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:12.121 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:23:12.124 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:23:12.214 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:23:12.218 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:23:12.308 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:23:12.312 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:23:12.402 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:23:12.406 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:23:12.497 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-17T02:23:12.497 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-17T02:23:12.552 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:23:12.653 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-17T02:23:12.709 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-17T02:23:12.765 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:23:12.865 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-17T02:23:12.921 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-17T02:23:12.976 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:23:13.074 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-17T02:23:13.130 DEBUG:teuthology.orchestra.run.smithi002:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:13.135 DEBUG:teuthology.orchestra.run.smithi145:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:13.169 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-17T02:23:13.170 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-17T02:23:13.170 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-17T02:23:13.211 INFO:tasks.ceph.mon.a:Started 2024-08-17T02:23:13.212 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-17T02:23:13.212 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-17T02:23:13.218 INFO:tasks.ceph.mon.b:Started 2024-08-17T02:23:13.219 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-17T02:23:13.219 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-17T02:23:13.223 INFO:tasks.ceph.mon.c:Started 2024-08-17T02:23:13.223 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-17T02:23:13.223 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-17T02:23:13.224 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-17T02:23:13.228 INFO:tasks.ceph.mgr.y:Started 2024-08-17T02:23:13.228 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-17T02:23:13.228 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-17T02:23:13.231 INFO:tasks.ceph.mgr.x:Started 2024-08-17T02:23:13.232 INFO:tasks.ceph:Setting crush tunables to default 2024-08-17T02:23:13.232 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph osd crush tunables default 2024-08-17T02:23:13.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.383+0000 7fda22e00640 1 Processor -- start 2024-08-17T02:23:13.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.383+0000 7fda22e00640 1 -- start start 2024-08-17T02:23:13.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.384+0000 7fda22e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fda1c0afca0 0x7fda1c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:13.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.384+0000 7fda22e00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fda1c0acf10 0x7fda1c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:13.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.384+0000 7fda22e00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda1c15a4e0 con 0x7fda1c1589a0 2024-08-17T02:23:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.384+0000 7fda22e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1c0b0980 con 0x7fda1c0afca0 2024-08-17T02:23:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.384+0000 7fda22e00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1c0c92b0 con 0x7fda1c0acf10 2024-08-17T02:23:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.385+0000 7fda20e00640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fda1c1589a0 0x7fda1c158de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:33160/0 (socket says 172.21.15.2:33160) 2024-08-17T02:23:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.385+0000 7fda20e00640 1 -- 172.21.15.2:0/3697278261 learned_addr learned my addr 172.21.15.2:0/3697278261 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.385+0000 7fda1be00640 1 --2- 172.21.15.2:0/3697278261 >> v2:172.21.15.2:3300/0 conn(0x7fda1c0afca0 0x7fda1c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.385+0000 7fda1be00640 1 -- 172.21.15.2:0/3697278261 >> v2:172.21.15.2:3300/0 conn(0x7fda1c0afca0 msgr2=0x7fda1c0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:23:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.385+0000 7fda1be00640 1 -- 172.21.15.2:0/3697278261 >> v2:172.21.15.2:3300/0 conn(0x7fda1c0afca0 msgr2=0x7fda1c0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:23:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.385+0000 7fda1be00640 1 --2- 172.21.15.2:0/3697278261 >> v2:172.21.15.2:3300/0 conn(0x7fda1c0afca0 0x7fda1c0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:23:13.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.385+0000 7fda1b400640 1 --2- 172.21.15.2:0/3697278261 >> v2:172.21.15.145:3300/0 conn(0x7fda1c0acf10 0x7fda1c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:13.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.385+0000 7fda1be00640 1 --2- 172.21.15.2:0/3697278261 >> v2:172.21.15.2:3300/0 conn(0x7fda1c0afca0 0x7fda1c0b0070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:23:13.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.385+0000 7fda1b400640 1 -- 172.21.15.2:0/3697278261 >> v2:172.21.15.145:3300/0 conn(0x7fda1c0acf10 msgr2=0x7fda1c159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:23:13.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.385+0000 7fda1b400640 1 -- 172.21.15.2:0/3697278261 >> v2:172.21.15.145:3300/0 conn(0x7fda1c0acf10 msgr2=0x7fda1c159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:23:13.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.385+0000 7fda1b400640 1 --2- 172.21.15.2:0/3697278261 >> v2:172.21.15.145:3300/0 conn(0x7fda1c0acf10 0x7fda1c159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:23:13.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.385+0000 7fda1b400640 1 --2- 172.21.15.2:0/3697278261 >> v2:172.21.15.145:3300/0 conn(0x7fda1c0acf10 0x7fda1c159fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:23:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.586+0000 7fda1be00640 1 --2- 172.21.15.2:0/3697278261 >> v2:172.21.15.2:3300/0 conn(0x7fda1c0afca0 0x7fda1c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.586+0000 7fda1b400640 1 --2- 172.21.15.2:0/3697278261 >> v2:172.21.15.145:3300/0 conn(0x7fda1c0acf10 0x7fda1c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.586+0000 7fda1be00640 1 -- 172.21.15.2:0/3697278261 >> v2:172.21.15.145:3300/0 conn(0x7fda1c0acf10 msgr2=0x7fda1c159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:13.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.586+0000 7fda1be00640 1 --2- 172.21.15.2:0/3697278261 >> v2:172.21.15.145:3300/0 conn(0x7fda1c0acf10 0x7fda1c159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:13.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.586+0000 7fda1be00640 1 -- 172.21.15.2:0/3697278261 >> v1:172.21.15.145:6789/0 conn(0x7fda1c1589a0 legacy=0x7fda1c158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:13.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.586+0000 7fda1be00640 1 -- 172.21.15.2:0/3697278261 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1c0ad480 con 0x7fda1c0afca0 2024-08-17T02:23:13.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.586+0000 7fda1aa00640 1 -- 172.21.15.2:0/3697278261 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3278427141 0 0) 0x7fda14001490 con 0x7fda1c1589a0 2024-08-17T02:23:13.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.588+0000 7fda1be00640 1 --2- 172.21.15.2:0/3697278261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1c0afca0 0x7fda1c0b0070 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fda1c0c83b0 tx=0x7fda0c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d4cfd74de117cd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:13.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.588+0000 7fda1aa00640 1 -- 172.21.15.2:0/3697278261 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c02adf0 con 0x7fda1c0afca0 2024-08-17T02:23:13.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.588+0000 7fda1aa00640 1 -- 172.21.15.2:0/3697278261 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c02e070 con 0x7fda1c0afca0 2024-08-17T02:23:13.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.588+0000 7fda1aa00640 1 -- 172.21.15.2:0/3697278261 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c034650 con 0x7fda1c0afca0 2024-08-17T02:23:13.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.589+0000 7fda22e00640 1 -- 172.21.15.2:0/3697278261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1c0afca0 msgr2=0x7fda1c0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:13.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.589+0000 7fda22e00640 1 --2- 172.21.15.2:0/3697278261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1c0afca0 0x7fda1c0b0070 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fda1c0c83b0 tx=0x7fda0c008040 comp rx=0 tx=0).stop 2024-08-17T02:23:13.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.589+0000 7fda22e00640 1 -- 172.21.15.2:0/3697278261 shutdown_connections 2024-08-17T02:23:13.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.589+0000 7fda22e00640 1 --2- 172.21.15.2:0/3697278261 >> v2:172.21.15.145:3300/0 conn(0x7fda1c0acf10 0x7fda1c159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:13.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.589+0000 7fda22e00640 1 --2- 172.21.15.2:0/3697278261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1c0afca0 0x7fda1c0b0070 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:13.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.589+0000 7fda22e00640 1 -- 172.21.15.2:0/3697278261 >> 172.21.15.2:0/3697278261 conn(0x7fda1c066e60 msgr2=0x7fda1c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:13.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.589+0000 7fda22e00640 1 -- 172.21.15.2:0/3697278261 shutdown_connections 2024-08-17T02:23:13.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.589+0000 7fda22e00640 1 -- 172.21.15.2:0/3697278261 wait complete. 2024-08-17T02:23:13.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.591+0000 7fda22e00640 1 Processor -- start 2024-08-17T02:23:13.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.591+0000 7fda22e00640 1 -- start start 2024-08-17T02:23:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.592+0000 7fda22e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1c0acf10 0x7fda1c169700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.592+0000 7fda22e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda1c0afca0 0x7fda1c159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.592+0000 7fda22e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda1c1589a0 0x7fda1c1448f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.592+0000 7fda22e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c15a2d0 con 0x7fda1c0acf10 2024-08-17T02:23:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.592+0000 7fda22e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c169270 con 0x7fda1c1589a0 2024-08-17T02:23:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.592+0000 7fda22e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c0a9fb0 con 0x7fda1c0afca0 2024-08-17T02:23:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.593+0000 7fda1be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1c0acf10 0x7fda1c169700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.593+0000 7fda1be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1c0acf10 0x7fda1c169700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59786/0 (socket says 172.21.15.2:59786) 2024-08-17T02:23:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.593+0000 7fda1be00640 1 -- 172.21.15.2:0/673273320 learned_addr learned my addr 172.21.15.2:0/673273320 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.593+0000 7fda1b400640 1 --2- 172.21.15.2:0/673273320 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda1c0afca0 0x7fda1c159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.593+0000 7fda20e00640 1 --2- 172.21.15.2:0/673273320 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda1c1589a0 0x7fda1c1448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.593+0000 7fda1be00640 1 -- 172.21.15.2:0/673273320 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda1c0afca0 msgr2=0x7fda1c159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.593+0000 7fda1be00640 1 --2- 172.21.15.2:0/673273320 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda1c0afca0 0x7fda1c159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.593+0000 7fda1be00640 1 -- 172.21.15.2:0/673273320 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda1c1589a0 msgr2=0x7fda1c1448f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.593+0000 7fda1be00640 1 --2- 172.21.15.2:0/673273320 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda1c1589a0 0x7fda1c1448f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.593+0000 7fda1be00640 1 -- 172.21.15.2:0/673273320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c00e040 con 0x7fda1c0acf10 2024-08-17T02:23:13.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.593+0000 7fda20e00640 1 --2- 172.21.15.2:0/673273320 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda1c1589a0 0x7fda1c1448f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:13.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.593+0000 7fda1be00640 1 --2- 172.21.15.2:0/673273320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1c0acf10 0x7fda1c169700 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fda0c006fd0 tx=0x7fda0c036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:13.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.595+0000 7fda13400640 1 -- 172.21.15.2:0/673273320 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c033790 con 0x7fda1c0acf10 2024-08-17T02:23:13.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.595+0000 7fda13400640 1 -- 172.21.15.2:0/673273320 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c0338f0 con 0x7fda1c0acf10 2024-08-17T02:23:13.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.595+0000 7fda22e00640 1 -- 172.21.15.2:0/673273320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1c0aa290 con 0x7fda1c0acf10 2024-08-17T02:23:13.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.595+0000 7fda13400640 1 -- 172.21.15.2:0/673273320 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c033cb0 con 0x7fda1c0acf10 2024-08-17T02:23:13.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.595+0000 7fda22e00640 1 -- 172.21.15.2:0/673273320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1c168c00 con 0x7fda1c0acf10 2024-08-17T02:23:13.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.596+0000 7fda13400640 1 -- 172.21.15.2:0/673273320 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fda0c03d680 con 0x7fda1c0acf10 2024-08-17T02:23:13.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.596+0000 7fda13400640 1 -- 172.21.15.2:0/673273320 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fda0c047790 con 0x7fda1c0acf10 2024-08-17T02:23:13.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.597+0000 7fda22e00640 1 -- 172.21.15.2:0/673273320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1c063fb0 con 0x7fda1c0acf10 2024-08-17T02:23:13.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.600+0000 7fda13400640 1 -- 172.21.15.2:0/673273320 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fda0c04c060 con 0x7fda1c0acf10 2024-08-17T02:23:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.669+0000 7fda22e00640 1 -- 172.21.15.2:0/673273320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fda1c067b70 con 0x7fda1c0acf10 2024-08-17T02:23:13.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.672+0000 7fda13400640 1 -- 172.21.15.2:0/673273320 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fda0c042070 con 0x7fda1c0acf10 2024-08-17T02:23:13.673 INFO:teuthology.orchestra.run.smithi002.stderr:adjusted tunables profile to default 2024-08-17T02:23:13.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.673+0000 7fda22e00640 1 -- 172.21.15.2:0/673273320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1c0acf10 msgr2=0x7fda1c169700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.673+0000 7fda22e00640 1 --2- 172.21.15.2:0/673273320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1c0acf10 0x7fda1c169700 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fda0c006fd0 tx=0x7fda0c036000 comp rx=0 tx=0).stop 2024-08-17T02:23:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.673+0000 7fda22e00640 1 -- 172.21.15.2:0/673273320 shutdown_connections 2024-08-17T02:23:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.673+0000 7fda22e00640 1 --2- 172.21.15.2:0/673273320 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda1c1589a0 0x7fda1c1448f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.673+0000 7fda22e00640 1 --2- 172.21.15.2:0/673273320 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda1c0afca0 0x7fda1c159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.673+0000 7fda22e00640 1 --2- 172.21.15.2:0/673273320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1c0acf10 0x7fda1c169700 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.673+0000 7fda22e00640 1 -- 172.21.15.2:0/673273320 >> 172.21.15.2:0/673273320 conn(0x7fda1c066e60 msgr2=0x7fda1c158de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.674+0000 7fda22e00640 1 -- 172.21.15.2:0/673273320 shutdown_connections 2024-08-17T02:23:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:13.674+0000 7fda22e00640 1 -- 172.21.15.2:0/673273320 wait complete. 2024-08-17T02:23:13.690 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-17T02:23:13.690 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:23:13.690 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-17T02:23:13.719 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:13.718+0000 7fdbb5228ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:23:13.726 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:23:13.725+0000 7f755d76cec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:23:13.747 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:23:13.747 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-17T02:23:13.843 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:23:13.843 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-17T02:23:13.870 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:13.870+0000 7fdbb5228ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:23:13.882 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:23:13.881+0000 7f755d76cec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:23:13.928 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:13.928+0000 7fdbb5228ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:23:13.938 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:23:13.938 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-17T02:23:13.944 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:23:13.943+0000 7f755d76cec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:23:14.000 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-08-17T02:23:14.000 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-17T02:23:14.056 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-08-17T02:23:14.057 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-17T02:23:14.152 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-08-17T02:23:14.152 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-17T02:23:14.233 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:23:14.232+0000 7f755d76cec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:23:14.236 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:14.236+0000 7fdbb5228ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:23:14.248 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-08-17T02:23:14.248 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-17T02:23:14.286 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:23:14.285+0000 7f755d76cec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:23:14.289 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:14.288+0000 7fdbb5228ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:23:14.344 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94 0 2024-08-17T02:23:14.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.528+0000 7f1d75400640 1 Processor -- start 2024-08-17T02:23:14.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.528+0000 7f1d75400640 1 -- start start 2024-08-17T02:23:14.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.529+0000 7f1d75400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1d70158dd0 0x7f1d7006e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:14.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.529+0000 7f1d75400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d7006ead0 0x7f1d700b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:14.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.529+0000 7f1d75400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7006eef0 con 0x7f1d70158a00 2024-08-17T02:23:14.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.529+0000 7f1d75400640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d70159230 con 0x7f1d70158dd0 2024-08-17T02:23:14.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.529+0000 7f1d75400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d700cbc50 con 0x7f1d7006ead0 2024-08-17T02:23:14.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.529+0000 7f1d67e00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1d70158dd0 0x7f1d7006e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:14.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.529+0000 7f1d74a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d7006ead0 0x7f1d700b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:14.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.529+0000 7f1d67e00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1d70158dd0 0x7f1d7006e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:41486/0 (socket says 172.21.15.145:41486) 2024-08-17T02:23:14.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.529+0000 7f1d67e00640 1 -- 172.21.15.145:0/1695593994 learned_addr learned my addr 172.21.15.145:0/1695593994 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-08-17T02:23:14.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.530+0000 7f1d67e00640 1 -- 172.21.15.145:0/1695593994 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d7006ead0 msgr2=0x7f1d700b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:14.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.530+0000 7f1d67e00640 1 --2- 172.21.15.145:0/1695593994 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d7006ead0 0x7f1d700b3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.530+0000 7f1d67e00640 1 -- 172.21.15.145:0/1695593994 >> v1:172.21.15.2:6789/0 conn(0x7f1d70158a00 legacy=0x7f1d700cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:14.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.530+0000 7f1d67e00640 1 -- 172.21.15.145:0/1695593994 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d700cbf30 con 0x7f1d70158dd0 2024-08-17T02:23:14.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.530+0000 7f1d74a00640 1 --2- 172.21.15.145:0/1695593994 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d7006ead0 0x7f1d700b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:14.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.531+0000 7f1d67e00640 1 --2- 172.21.15.145:0/1695593994 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d70158dd0 0x7f1d7006e590 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1d58009910 tx=0x7f1d580091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20179935da394e2e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:14.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.531+0000 7f1d6f400640 1 -- 172.21.15.145:0/1695593994 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5802ae40 con 0x7f1d70158dd0 2024-08-17T02:23:14.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.531+0000 7f1d6f400640 1 -- 172.21.15.145:0/1695593994 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d58032440 con 0x7f1d70158dd0 2024-08-17T02:23:14.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.531+0000 7f1d6f400640 1 -- 172.21.15.145:0/1695593994 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d58032820 con 0x7f1d70158dd0 2024-08-17T02:23:14.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.531+0000 7f1d75400640 1 -- 172.21.15.145:0/1695593994 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d70158dd0 msgr2=0x7f1d7006e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:14.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.531+0000 7f1d75400640 1 --2- 172.21.15.145:0/1695593994 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d70158dd0 0x7f1d7006e590 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1d58009910 tx=0x7f1d580091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.531+0000 7f1d75400640 1 -- 172.21.15.145:0/1695593994 shutdown_connections 2024-08-17T02:23:14.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.531+0000 7f1d75400640 1 --2- 172.21.15.145:0/1695593994 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d7006ead0 0x7f1d700b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.531+0000 7f1d75400640 1 --2- 172.21.15.145:0/1695593994 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d70158dd0 0x7f1d7006e590 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.532+0000 7f1d75400640 1 -- 172.21.15.145:0/1695593994 >> 172.21.15.145:0/1695593994 conn(0x7f1d700cfb80 msgr2=0x7f1d700cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:14.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.532+0000 7f1d75400640 1 -- 172.21.15.145:0/1695593994 shutdown_connections 2024-08-17T02:23:14.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.532+0000 7f1d75400640 1 -- 172.21.15.145:0/1695593994 wait complete. 2024-08-17T02:23:14.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.533+0000 7f1d75400640 1 Processor -- start 2024-08-17T02:23:14.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.533+0000 7f1d75400640 1 -- start start 2024-08-17T02:23:14.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.534+0000 7f1d75400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d7006ead0 0x7f1d700c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:14.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.534+0000 7f1d75400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d70158a00 0x7f1d700a64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:14.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.534+0000 7f1d75400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d70158dd0 0x7f1d7015a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:14.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.534+0000 7f1d75400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d700a6c20 con 0x7f1d70158a00 2024-08-17T02:23:14.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.534+0000 7f1d75400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d700a6a10 con 0x7f1d70158dd0 2024-08-17T02:23:14.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.534+0000 7f1d75400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d700c77c0 con 0x7f1d7006ead0 2024-08-17T02:23:14.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.534+0000 7f1d6fe00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d7006ead0 0x7f1d700c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:14.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.534+0000 7f1d74a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d70158dd0 0x7f1d7015a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:14.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.534+0000 7f1d6fe00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d7006ead0 0x7f1d700c6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:49082/0 (socket says 172.21.15.145:49082) 2024-08-17T02:23:14.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.534+0000 7f1d6fe00640 1 -- 172.21.15.145:0/3515694001 learned_addr learned my addr 172.21.15.145:0/3515694001 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-08-17T02:23:14.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.534+0000 7f1d67e00640 1 --2- 172.21.15.145:0/3515694001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d70158a00 0x7f1d700a64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:14.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.535+0000 7f1d6fe00640 1 -- 172.21.15.145:0/3515694001 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d70158dd0 msgr2=0x7f1d7015a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:14.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.535+0000 7f1d6fe00640 1 --2- 172.21.15.145:0/3515694001 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d70158dd0 0x7f1d7015a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.535+0000 7f1d6fe00640 1 -- 172.21.15.145:0/3515694001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d70158a00 msgr2=0x7f1d700a64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:14.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.535+0000 7f1d6fe00640 1 --2- 172.21.15.145:0/3515694001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d70158a00 0x7f1d700a64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.535+0000 7f1d6fe00640 1 -- 172.21.15.145:0/3515694001 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d68009a20 con 0x7f1d7006ead0 2024-08-17T02:23:14.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.535+0000 7f1d6fe00640 1 --2- 172.21.15.145:0/3515694001 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d7006ead0 0x7f1d700c6f90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000c560 tx=0x7f1d60007ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:14.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.535+0000 7f1d67400640 1 -- 172.21.15.145:0/3515694001 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d60011590 con 0x7f1d7006ead0 2024-08-17T02:23:14.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.535+0000 7f1d67400640 1 -- 172.21.15.145:0/3515694001 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d60011710 con 0x7f1d7006ead0 2024-08-17T02:23:14.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.535+0000 7f1d75400640 1 -- 172.21.15.145:0/3515694001 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d58009450 con 0x7f1d7006ead0 2024-08-17T02:23:14.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.535+0000 7f1d67400640 1 -- 172.21.15.145:0/3515694001 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d60011ad0 con 0x7f1d7006ead0 2024-08-17T02:23:14.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.535+0000 7f1d75400640 1 -- 172.21.15.145:0/3515694001 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d700c7d80 con 0x7f1d7006ead0 2024-08-17T02:23:14.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.536+0000 7f1d67400640 1 -- 172.21.15.145:0/3515694001 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f1d6001c440 con 0x7f1d7006ead0 2024-08-17T02:23:14.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.536+0000 7f1d67400640 1 -- 172.21.15.145:0/3515694001 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f1d60012770 con 0x7f1d7006ead0 2024-08-17T02:23:14.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.536+0000 7f1d75400640 1 -- 172.21.15.145:0/3515694001 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d70070720 con 0x7f1d7006ead0 2024-08-17T02:23:14.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.539+0000 7f1d67400640 1 -- 172.21.15.145:0/3515694001 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f1d60017070 con 0x7f1d7006ead0 2024-08-17T02:23:14.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.615+0000 7f1d75400640 1 -- 172.21.15.145:0/3515694001 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94", "id": 0} v 0) v1 -- 0x7f1d700ceb00 con 0x7f1d7006ead0 2024-08-17T02:23:14.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.618+0000 7f1d67400640 1 -- 172.21.15.145:0/3515694001 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1d6001c8d0 con 0x7f1d7006ead0 2024-08-17T02:23:14.619 INFO:teuthology.orchestra.run.smithi145.stdout:0 2024-08-17T02:23:14.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.619+0000 7f1d75400640 1 -- 172.21.15.145:0/3515694001 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d7006ead0 msgr2=0x7f1d700c6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:14.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.619+0000 7f1d75400640 1 --2- 172.21.15.145:0/3515694001 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d7006ead0 0x7f1d700c6f90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000c560 tx=0x7f1d60007ef0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.619+0000 7f1d75400640 1 -- 172.21.15.145:0/3515694001 shutdown_connections 2024-08-17T02:23:14.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.619+0000 7f1d75400640 1 --2- 172.21.15.145:0/3515694001 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d70158dd0 0x7f1d7015a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.619+0000 7f1d75400640 1 --2- 172.21.15.145:0/3515694001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d70158a00 0x7f1d700a64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.619+0000 7f1d75400640 1 --2- 172.21.15.145:0/3515694001 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d7006ead0 0x7f1d700c6f90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.619+0000 7f1d75400640 1 -- 172.21.15.145:0/3515694001 >> 172.21.15.145:0/3515694001 conn(0x7f1d700cfb80 msgr2=0x7f1d700b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:14.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.619+0000 7f1d75400640 1 -- 172.21.15.145:0/3515694001 shutdown_connections 2024-08-17T02:23:14.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.619+0000 7f1d75400640 1 -- 172.21.15.145:0/3515694001 wait complete. 2024-08-17T02:23:14.634 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 9cd868cf-f5f3-413d-adb0-dfb0e23cd952 1 2024-08-17T02:23:14.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.778+0000 7fdc69000640 1 Processor -- start 2024-08-17T02:23:14.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.778+0000 7fdc69000640 1 -- start start 2024-08-17T02:23:14.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.779+0000 7fdc69000640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fdc640caf10 0x7fdc640cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:14.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.779+0000 7fdc69000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdc64158ca0 0x7fdc640cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:14.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.779+0000 7fdc69000640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc640af600 con 0x7fdc641588d0 2024-08-17T02:23:14.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.779+0000 7fdc69000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc640afb60 con 0x7fdc64158ca0 2024-08-17T02:23:14.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.779+0000 7fdc69000640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc640d04e0 con 0x7fdc640caf10 2024-08-17T02:23:14.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.779+0000 7fdc63400640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fdc641588d0 0x7fdc640ca800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:40980/0 (socket says 172.21.15.145:40980) 2024-08-17T02:23:14.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.779+0000 7fdc63400640 1 -- 172.21.15.145:0/1423926141 learned_addr learned my addr 172.21.15.145:0/1423926141 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-08-17T02:23:14.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.779+0000 7fdc62a00640 1 --2- 172.21.15.145:0/1423926141 >> v2:172.21.15.145:3300/0 conn(0x7fdc640caf10 0x7fdc640cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:14.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.780+0000 7fdc63e00640 1 --2- 172.21.15.145:0/1423926141 >> v2:172.21.15.2:3300/0 conn(0x7fdc64158ca0 0x7fdc640cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:14.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.780+0000 7fdc62000640 1 -- 172.21.15.145:0/1423926141 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668723252 0 0) 0x7fdc640af600 con 0x7fdc641588d0 2024-08-17T02:23:14.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.780+0000 7fdc62000640 1 -- 172.21.15.145:0/1423926141 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc480034e0 con 0x7fdc641588d0 2024-08-17T02:23:14.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.780+0000 7fdc62a00640 1 -- 172.21.15.145:0/1423926141 >> v2:172.21.15.2:3300/0 conn(0x7fdc64158ca0 msgr2=0x7fdc640cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:14.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.780+0000 7fdc62a00640 1 --2- 172.21.15.145:0/1423926141 >> v2:172.21.15.2:3300/0 conn(0x7fdc64158ca0 0x7fdc640cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.780+0000 7fdc62a00640 1 -- 172.21.15.145:0/1423926141 >> v1:172.21.15.145:6789/0 conn(0x7fdc641588d0 legacy=0x7fdc640ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:14.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.780+0000 7fdc62a00640 1 -- 172.21.15.145:0/1423926141 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc640af830 con 0x7fdc640caf10 2024-08-17T02:23:14.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.781+0000 7fdc62a00640 1 --2- 172.21.15.145:0/1423926141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc640caf10 0x7fdc640cf1f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdc640b26f0 tx=0x7fdc500090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64ae56e8d0dfc839 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:14.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.781+0000 7fdc62000640 1 -- 172.21.15.145:0/1423926141 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5002ad20 con 0x7fdc640caf10 2024-08-17T02:23:14.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.781+0000 7fdc62000640 1 -- 172.21.15.145:0/1423926141 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5002ae80 con 0x7fdc640caf10 2024-08-17T02:23:14.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.781+0000 7fdc62000640 1 -- 172.21.15.145:0/1423926141 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50032670 con 0x7fdc640caf10 2024-08-17T02:23:14.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.782+0000 7fdc69000640 1 -- 172.21.15.145:0/1423926141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc640caf10 msgr2=0x7fdc640cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:14.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.782+0000 7fdc69000640 1 --2- 172.21.15.145:0/1423926141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc640caf10 0x7fdc640cf1f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdc640b26f0 tx=0x7fdc500090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.782+0000 7fdc69000640 1 -- 172.21.15.145:0/1423926141 shutdown_connections 2024-08-17T02:23:14.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.782+0000 7fdc69000640 1 --2- 172.21.15.145:0/1423926141 >> v2:172.21.15.2:3300/0 conn(0x7fdc64158ca0 0x7fdc640cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.782+0000 7fdc69000640 1 --2- 172.21.15.145:0/1423926141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc640caf10 0x7fdc640cf1f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.782+0000 7fdc69000640 1 -- 172.21.15.145:0/1423926141 >> 172.21.15.145:0/1423926141 conn(0x7fdc64087a80 msgr2=0x7fdc6406e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:14.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.782+0000 7fdc69000640 1 -- 172.21.15.145:0/1423926141 shutdown_connections 2024-08-17T02:23:14.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.782+0000 7fdc69000640 1 -- 172.21.15.145:0/1423926141 wait complete. 2024-08-17T02:23:14.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.783+0000 7fdc69000640 1 Processor -- start 2024-08-17T02:23:14.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.783+0000 7fdc69000640 1 -- start start 2024-08-17T02:23:14.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.784+0000 7fdc69000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc640caf10 0x7fdc640c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.784+0000 7fdc69000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc641588d0 0x7fdc64154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.784+0000 7fdc69000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc64158ca0 0x7fdc640aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.784+0000 7fdc69000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc64154dc0 con 0x7fdc640caf10 2024-08-17T02:23:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.784+0000 7fdc69000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc640b47a0 con 0x7fdc641588d0 2024-08-17T02:23:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.784+0000 7fdc69000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc640b3b00 con 0x7fdc64158ca0 2024-08-17T02:23:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.784+0000 7fdc62a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc641588d0 0x7fdc64154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.784+0000 7fdc63e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc64158ca0 0x7fdc640aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.784+0000 7fdc62a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc641588d0 0x7fdc64154880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:41524/0 (socket says 172.21.15.145:41524) 2024-08-17T02:23:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.784+0000 7fdc62a00640 1 -- 172.21.15.145:0/1614451184 learned_addr learned my addr 172.21.15.145:0/1614451184 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-08-17T02:23:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.784+0000 7fdc63400640 1 --2- 172.21.15.145:0/1614451184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc640caf10 0x7fdc640c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.785+0000 7fdc62a00640 1 -- 172.21.15.145:0/1614451184 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc64158ca0 msgr2=0x7fdc640aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.785+0000 7fdc62a00640 1 --2- 172.21.15.145:0/1614451184 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc64158ca0 0x7fdc640aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.785+0000 7fdc62a00640 1 -- 172.21.15.145:0/1614451184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc640caf10 msgr2=0x7fdc640c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.785+0000 7fdc62a00640 1 --2- 172.21.15.145:0/1614451184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc640caf10 0x7fdc640c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.785+0000 7fdc62a00640 1 -- 172.21.15.145:0/1614451184 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc50009390 con 0x7fdc641588d0 2024-08-17T02:23:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.785+0000 7fdc62a00640 1 --2- 172.21.15.145:0/1614451184 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc641588d0 0x7fdc64154880 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009360 tx=0x7fdc50032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.785+0000 7fdc5aa00640 1 -- 172.21.15.145:0/1614451184 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5003b6e0 con 0x7fdc641588d0 2024-08-17T02:23:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.785+0000 7fdc5aa00640 1 -- 172.21.15.145:0/1614451184 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5003b840 con 0x7fdc641588d0 2024-08-17T02:23:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.785+0000 7fdc69000640 1 -- 172.21.15.145:0/1614451184 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc640b3de0 con 0x7fdc641588d0 2024-08-17T02:23:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.785+0000 7fdc5aa00640 1 -- 172.21.15.145:0/1614451184 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5003bc00 con 0x7fdc641588d0 2024-08-17T02:23:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.785+0000 7fdc69000640 1 -- 172.21.15.145:0/1614451184 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc640b4430 con 0x7fdc641588d0 2024-08-17T02:23:14.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.786+0000 7fdc5aa00640 1 -- 172.21.15.145:0/1614451184 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fdc50039040 con 0x7fdc641588d0 2024-08-17T02:23:14.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.786+0000 7fdc5aa00640 1 -- 172.21.15.145:0/1614451184 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fdc50041030 con 0x7fdc641588d0 2024-08-17T02:23:14.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.786+0000 7fdc69000640 1 -- 172.21.15.145:0/1614451184 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc64070720 con 0x7fdc641588d0 2024-08-17T02:23:14.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.789+0000 7fdc5aa00640 1 -- 172.21.15.145:0/1614451184 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fdc50037070 con 0x7fdc641588d0 2024-08-17T02:23:14.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.862+0000 7fdc69000640 1 -- 172.21.15.145:0/1614451184 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9cd868cf-f5f3-413d-adb0-dfb0e23cd952", "id": 1} v 0) v1 -- 0x7fdc64088b20 con 0x7fdc641588d0 2024-08-17T02:23:14.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.866+0000 7fdc5aa00640 1 -- 172.21.15.145:0/1614451184 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9cd868cf-f5f3-413d-adb0-dfb0e23cd952", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdc50046800 con 0x7fdc641588d0 2024-08-17T02:23:14.867 INFO:teuthology.orchestra.run.smithi145.stdout:1 2024-08-17T02:23:14.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.867+0000 7fdc69000640 1 -- 172.21.15.145:0/1614451184 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc641588d0 msgr2=0x7fdc64154880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:14.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.867+0000 7fdc69000640 1 --2- 172.21.15.145:0/1614451184 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc641588d0 0x7fdc64154880 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009360 tx=0x7fdc50032000 comp rx=0 tx=0).stop 2024-08-17T02:23:14.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.867+0000 7fdc69000640 1 -- 172.21.15.145:0/1614451184 shutdown_connections 2024-08-17T02:23:14.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.868+0000 7fdc69000640 1 --2- 172.21.15.145:0/1614451184 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc64158ca0 0x7fdc640aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.868+0000 7fdc69000640 1 --2- 172.21.15.145:0/1614451184 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc641588d0 0x7fdc64154880 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.868+0000 7fdc69000640 1 --2- 172.21.15.145:0/1614451184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc640caf10 0x7fdc640c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.868+0000 7fdc69000640 1 -- 172.21.15.145:0/1614451184 >> 172.21.15.145:0/1614451184 conn(0x7fdc64087a80 msgr2=0x7fdc64157c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:14.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.868+0000 7fdc69000640 1 -- 172.21.15.145:0/1614451184 shutdown_connections 2024-08-17T02:23:14.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:14.868+0000 7fdc69000640 1 -- 172.21.15.145:0/1614451184 wait complete. 2024-08-17T02:23:14.882 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 6cea5b6d-f990-40ef-a6b1-6f3735eb551c 2 2024-08-17T02:23:15.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.026+0000 7f76be400640 1 Processor -- start 2024-08-17T02:23:15.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.026+0000 7f76be400640 1 -- start start 2024-08-17T02:23:15.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.027+0000 7f76be400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f76b80cb0d0 0x7f76b8158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.027+0000 7f76be400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f76b80cda30 0x7f76b80cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.027+0000 7f76be400640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b80af9a0 con 0x7f76b81589e0 2024-08-17T02:23:15.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.027+0000 7f76be400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b80af810 con 0x7f76b80cb0d0 2024-08-17T02:23:15.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.027+0000 7f76be400640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b80ce740 con 0x7f76b80cda30 2024-08-17T02:23:15.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.028+0000 7f76b7e00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f76b80cda30 0x7f76b80cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.028+0000 7f76b7e00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f76b80cda30 0x7f76b80cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:41538/0 (socket says 172.21.15.145:41538) 2024-08-17T02:23:15.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.028+0000 7f76b7e00640 1 -- 172.21.15.145:0/1293869945 learned_addr learned my addr 172.21.15.145:0/1293869945 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-08-17T02:23:15.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.028+0000 7f76b7400640 1 --1- 172.21.15.145:0/1293869945 >> v1:172.21.15.145:6789/0 conn(0x7f76b81589e0 0x7f76b80ca9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:40996/0 (socket says 172.21.15.145:40996) 2024-08-17T02:23:15.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.028+0000 7f76b7e00640 1 -- 172.21.15.145:0/1293869945 >> v2:172.21.15.2:3300/0 conn(0x7f76b80cb0d0 msgr2=0x7f76b8158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:15.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.028+0000 7f76b7e00640 1 --2- 172.21.15.145:0/1293869945 >> v2:172.21.15.2:3300/0 conn(0x7f76b80cb0d0 0x7f76b8158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.028+0000 7f76b7e00640 1 -- 172.21.15.145:0/1293869945 >> v1:172.21.15.145:6789/0 conn(0x7f76b81589e0 legacy=0x7f76b80ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.028+0000 7f76b7e00640 1 -- 172.21.15.145:0/1293869945 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b80cea00 con 0x7f76b80cda30 2024-08-17T02:23:15.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.029+0000 7f76b7e00640 1 --2- 172.21.15.145:0/1293869945 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76b80cda30 0x7f76b80cdeb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f76b80cbe00 tx=0x7f76b0009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de80b9ba30439422 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.029+0000 7f76b6000640 1 -- 172.21.15.145:0/1293869945 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b002e050 con 0x7f76b80cda30 2024-08-17T02:23:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.029+0000 7f76b6000640 1 -- 172.21.15.145:0/1293869945 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b0007400 con 0x7f76b80cda30 2024-08-17T02:23:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.029+0000 7f76b6000640 1 -- 172.21.15.145:0/1293869945 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b00077e0 con 0x7f76b80cda30 2024-08-17T02:23:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.030+0000 7f76be400640 1 -- 172.21.15.145:0/1293869945 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76b80cda30 msgr2=0x7f76b80cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.030+0000 7f76be400640 1 --2- 172.21.15.145:0/1293869945 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76b80cda30 0x7f76b80cdeb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f76b80cbe00 tx=0x7f76b0009840 comp rx=0 tx=0).stop 2024-08-17T02:23:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.030+0000 7f76be400640 1 -- 172.21.15.145:0/1293869945 shutdown_connections 2024-08-17T02:23:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.030+0000 7f76be400640 1 --2- 172.21.15.145:0/1293869945 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76b80cda30 0x7f76b80cdeb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.030+0000 7f76be400640 1 --2- 172.21.15.145:0/1293869945 >> v2:172.21.15.2:3300/0 conn(0x7f76b80cb0d0 0x7f76b8158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.030+0000 7f76be400640 1 -- 172.21.15.145:0/1293869945 >> 172.21.15.145:0/1293869945 conn(0x7f76b806e590 msgr2=0x7f76b806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.030+0000 7f76be400640 1 -- 172.21.15.145:0/1293869945 shutdown_connections 2024-08-17T02:23:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.030+0000 7f76be400640 1 -- 172.21.15.145:0/1293869945 wait complete. 2024-08-17T02:23:15.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.031+0000 7f76be400640 1 Processor -- start 2024-08-17T02:23:15.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.032+0000 7f76be400640 1 -- start start 2024-08-17T02:23:15.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.032+0000 7f76be400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76b80cb0d0 0x7f76b8153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.032+0000 7f76be400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76b80cda30 0x7f76b816c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.032+0000 7f76be400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b81589e0 0x7f76b80b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.032+0000 7f76be400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b816d650 con 0x7f76b80cb0d0 2024-08-17T02:23:15.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.032+0000 7f76be400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b80b4cb0 con 0x7f76b80cda30 2024-08-17T02:23:15.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.032+0000 7f76be400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b816d090 con 0x7f76b81589e0 2024-08-17T02:23:15.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.033+0000 7f76b6a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76b80cda30 0x7f76b816c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.033+0000 7f76b7e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b81589e0 0x7f76b80b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.033+0000 7f76b7400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76b80cb0d0 0x7f76b8153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.033+0000 7f76b6a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76b80cda30 0x7f76b816c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:41550/0 (socket says 172.21.15.145:41550) 2024-08-17T02:23:15.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.033+0000 7f76b7e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b81589e0 0x7f76b80b5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:49094/0 (socket says 172.21.15.145:49094) 2024-08-17T02:23:15.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.033+0000 7f76b6a00640 1 -- 172.21.15.145:0/2766633319 learned_addr learned my addr 172.21.15.145:0/2766633319 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-08-17T02:23:15.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.033+0000 7f76b6a00640 1 -- 172.21.15.145:0/2766633319 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b81589e0 msgr2=0x7f76b80b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.033+0000 7f76b6a00640 1 --2- 172.21.15.145:0/2766633319 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b81589e0 0x7f76b80b5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.033+0000 7f76b6a00640 1 -- 172.21.15.145:0/2766633319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76b80cb0d0 msgr2=0x7f76b8153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.033+0000 7f76b6a00640 1 --2- 172.21.15.145:0/2766633319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76b80cb0d0 0x7f76b8153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.033+0000 7f76b6a00640 1 -- 172.21.15.145:0/2766633319 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b0009ae0 con 0x7f76b80cda30 2024-08-17T02:23:15.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.033+0000 7f76b7400640 1 --2- 172.21.15.145:0/2766633319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76b80cb0d0 0x7f76b8153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:15.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.033+0000 7f76b6a00640 1 --2- 172.21.15.145:0/2766633319 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76b80cda30 0x7f76b816c6b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f76a400b600 tx=0x7f76a40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:15.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.034+0000 7f76aea00640 1 -- 172.21.15.145:0/2766633319 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a400f5f0 con 0x7f76b80cda30 2024-08-17T02:23:15.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.034+0000 7f76aea00640 1 -- 172.21.15.145:0/2766633319 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a400f750 con 0x7f76b80cda30 2024-08-17T02:23:15.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.034+0000 7f76aea00640 1 -- 172.21.15.145:0/2766633319 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a400fb10 con 0x7f76b80cda30 2024-08-17T02:23:15.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.034+0000 7f76be400640 1 -- 172.21.15.145:0/2766633319 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b816d370 con 0x7f76b80cda30 2024-08-17T02:23:15.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.034+0000 7f76be400640 1 -- 172.21.15.145:0/2766633319 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b80b4160 con 0x7f76b80cda30 2024-08-17T02:23:15.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.034+0000 7f76aea00640 1 -- 172.21.15.145:0/2766633319 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f76a4010710 con 0x7f76b80cda30 2024-08-17T02:23:15.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.034+0000 7f76aea00640 1 -- 172.21.15.145:0/2766633319 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f76a4010df0 con 0x7f76b80cda30 2024-08-17T02:23:15.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.035+0000 7f76be400640 1 -- 172.21.15.145:0/2766633319 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b80b47a0 con 0x7f76b80cda30 2024-08-17T02:23:15.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.037+0000 7f76aea00640 1 -- 172.21.15.145:0/2766633319 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f76b80b47a0 con 0x7f76b80cda30 2024-08-17T02:23:15.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.111+0000 7f76be400640 1 -- 172.21.15.145:0/2766633319 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6cea5b6d-f990-40ef-a6b1-6f3735eb551c", "id": 2} v 0) v1 -- 0x7f76b80b4350 con 0x7f76b80cda30 2024-08-17T02:23:15.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.115+0000 7f76aea00640 1 -- 172.21.15.145:0/2766633319 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6cea5b6d-f990-40ef-a6b1-6f3735eb551c", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f76a4010ac0 con 0x7f76b80cda30 2024-08-17T02:23:15.116 INFO:teuthology.orchestra.run.smithi145.stdout:2 2024-08-17T02:23:15.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.116+0000 7f76be400640 1 -- 172.21.15.145:0/2766633319 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76b80cda30 msgr2=0x7f76b816c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.117+0000 7f76be400640 1 --2- 172.21.15.145:0/2766633319 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76b80cda30 0x7f76b816c6b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f76a400b600 tx=0x7f76a40091a0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.117+0000 7f76be400640 1 -- 172.21.15.145:0/2766633319 shutdown_connections 2024-08-17T02:23:15.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.117+0000 7f76be400640 1 --2- 172.21.15.145:0/2766633319 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b81589e0 0x7f76b80b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.117+0000 7f76be400640 1 --2- 172.21.15.145:0/2766633319 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76b80cda30 0x7f76b816c6b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.117+0000 7f76be400640 1 --2- 172.21.15.145:0/2766633319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76b80cb0d0 0x7f76b8153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.117+0000 7f76be400640 1 -- 172.21.15.145:0/2766633319 >> 172.21.15.145:0/2766633319 conn(0x7f76b806e590 msgr2=0x7f76b80b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:15.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.117+0000 7f76be400640 1 -- 172.21.15.145:0/2766633319 shutdown_connections 2024-08-17T02:23:15.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.117+0000 7f76be400640 1 -- 172.21.15.145:0/2766633319 wait complete. 2024-08-17T02:23:15.128 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:15.128+0000 7fdbb5228ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:23:15.132 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 2948af0c-73f1-40fa-93e9-8a96979ad50c 3 2024-08-17T02:23:15.145 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:23:15.144+0000 7f755d76cec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:23:15.234 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:15.232+0000 7fdbb5228ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:23:15.248 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:23:15.247+0000 7f755d76cec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:23:15.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.275+0000 7fe79ae00640 1 Processor -- start 2024-08-17T02:23:15.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.275+0000 7fe79ae00640 1 -- start start 2024-08-17T02:23:15.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.277+0000 7fe79ae00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe794158a00 0x7fe794158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.277+0000 7fe79ae00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7940cbc50 con 0x7fe79406eca0 2024-08-17T02:23:15.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.277+0000 7fe79ae00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7940cbf30 con 0x7fe7940cb190 2024-08-17T02:23:15.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.277+0000 7fe79ae00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7940cc210 con 0x7fe794158a00 2024-08-17T02:23:15.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.277+0000 7fe799a00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe794158a00 0x7fe794158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.277+0000 7fe799000640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fe7940cb190 0x7fe79406e590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:41006/0 (socket says 172.21.15.145:41006) 2024-08-17T02:23:15.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.277+0000 7fe799000640 1 -- 172.21.15.145:0/2410586926 learned_addr learned my addr 172.21.15.145:0/2410586926 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-08-17T02:23:15.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.277+0000 7fe799a00640 1 -- 172.21.15.145:0/2410586926 >> v1:172.21.15.145:6789/0 conn(0x7fe7940cb190 legacy=0x7fe79406e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.277+0000 7fe799a00640 1 -- 172.21.15.145:0/2410586926 >> v1:172.21.15.2:6789/0 conn(0x7fe79406eca0 legacy=0x7fe7940b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.277+0000 7fe793e00640 1 -- 172.21.15.145:0/2410586926 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976986917 0 0) 0x7fe7940cbf30 con 0x7fe7940cb190 2024-08-17T02:23:15.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.277+0000 7fe799a00640 1 -- 172.21.15.145:0/2410586926 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7940b2930 con 0x7fe794158a00 2024-08-17T02:23:15.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.278+0000 7fe799a00640 1 --2- 172.21.15.145:0/2410586926 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe794158a00 0x7fe794158dd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe788009850 tx=0x7fe7880090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ce82aa6e8f4e72 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:15.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.279+0000 7fe793e00640 1 -- 172.21.15.145:0/2410586926 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78802ac60 con 0x7fe794158a00 2024-08-17T02:23:15.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.279+0000 7fe793e00640 1 -- 172.21.15.145:0/2410586926 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78802adc0 con 0x7fe794158a00 2024-08-17T02:23:15.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.279+0000 7fe793e00640 1 -- 172.21.15.145:0/2410586926 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe788032670 con 0x7fe794158a00 2024-08-17T02:23:15.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.280+0000 7fe79ae00640 1 -- 172.21.15.145:0/2410586926 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe794158a00 msgr2=0x7fe794158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.280+0000 7fe79ae00640 1 --2- 172.21.15.145:0/2410586926 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe794158a00 0x7fe794158dd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe788009850 tx=0x7fe7880090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.280+0000 7fe79ae00640 1 -- 172.21.15.145:0/2410586926 shutdown_connections 2024-08-17T02:23:15.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.280+0000 7fe79ae00640 1 --2- 172.21.15.145:0/2410586926 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe794158a00 0x7fe794158dd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.280+0000 7fe79ae00640 1 -- 172.21.15.145:0/2410586926 >> 172.21.15.145:0/2410586926 conn(0x7fe7940cfb80 msgr2=0x7fe7940cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:15.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.280+0000 7fe79ae00640 1 -- 172.21.15.145:0/2410586926 shutdown_connections 2024-08-17T02:23:15.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.280+0000 7fe79ae00640 1 -- 172.21.15.145:0/2410586926 wait complete. 2024-08-17T02:23:15.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.281+0000 7fe79ae00640 1 Processor -- start 2024-08-17T02:23:15.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.281+0000 7fe79ae00640 1 -- start start 2024-08-17T02:23:15.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.282+0000 7fe79ae00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe79406eca0 0x7fe794155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.282+0000 7fe79ae00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe7940cb190 0x7fe7940a64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.282+0000 7fe79ae00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe794158a00 0x7fe7940a70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.282+0000 7fe79ae00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe794156270 con 0x7fe794158a00 2024-08-17T02:23:15.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.282+0000 7fe79ae00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe794169c50 con 0x7fe79406eca0 2024-08-17T02:23:15.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.282+0000 7fe79ae00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79416a1d0 con 0x7fe7940cb190 2024-08-17T02:23:15.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.283+0000 7fe799a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe79406eca0 0x7fe794155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.283+0000 7fe799000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe7940cb190 0x7fe7940a64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.283+0000 7fe799a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe79406eca0 0x7fe794155d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:41570/0 (socket says 172.21.15.145:41570) 2024-08-17T02:23:15.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.283+0000 7fe799a00640 1 -- 172.21.15.145:0/88860130 learned_addr learned my addr 172.21.15.145:0/88860130 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-08-17T02:23:15.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.283+0000 7fe79a400640 1 --2- 172.21.15.145:0/88860130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe794158a00 0x7fe7940a70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.283+0000 7fe799a00640 1 -- 172.21.15.145:0/88860130 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe7940cb190 msgr2=0x7fe7940a64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.283+0000 7fe799a00640 1 --2- 172.21.15.145:0/88860130 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe7940cb190 0x7fe7940a64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.283+0000 7fe799a00640 1 -- 172.21.15.145:0/88860130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe794158a00 msgr2=0x7fe7940a70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.283+0000 7fe799a00640 1 --2- 172.21.15.145:0/88860130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe794158a00 0x7fe7940a70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.283+0000 7fe799a00640 1 -- 172.21.15.145:0/88860130 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe788009390 con 0x7fe79406eca0 2024-08-17T02:23:15.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.283+0000 7fe799a00640 1 --2- 172.21.15.145:0/88860130 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe79406eca0 0x7fe794155d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe788009850 tx=0x7fe788032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:15.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.284+0000 7fe790c00640 1 -- 172.21.15.145:0/88860130 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe788031730 con 0x7fe79406eca0 2024-08-17T02:23:15.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.284+0000 7fe790c00640 1 -- 172.21.15.145:0/88860130 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7880318b0 con 0x7fe79406eca0 2024-08-17T02:23:15.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.284+0000 7fe790c00640 1 -- 172.21.15.145:0/88860130 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe788031c70 con 0x7fe79406eca0 2024-08-17T02:23:15.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.284+0000 7fe79ae00640 1 -- 172.21.15.145:0/88860130 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7940afd60 con 0x7fe79406eca0 2024-08-17T02:23:15.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.284+0000 7fe79ae00640 1 -- 172.21.15.145:0/88860130 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7940b02e0 con 0x7fe79406eca0 2024-08-17T02:23:15.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.284+0000 7fe790c00640 1 -- 172.21.15.145:0/88860130 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fe788039050 con 0x7fe79406eca0 2024-08-17T02:23:15.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.284+0000 7fe790c00640 1 -- 172.21.15.145:0/88860130 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fe78803cde0 con 0x7fe79406eca0 2024-08-17T02:23:15.287 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:15.285+0000 7fdbb5228ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:23:15.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.285+0000 7fe79ae00640 1 -- 172.21.15.145:0/88860130 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe794070720 con 0x7fe79406eca0 2024-08-17T02:23:15.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.287+0000 7fe790c00640 1 -- 172.21.15.145:0/88860130 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fe78804a060 con 0x7fe79406eca0 2024-08-17T02:23:15.298 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:23:15.298+0000 7f755d76cec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:23:15.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.361+0000 7fe79ae00640 1 -- 172.21.15.145:0/88860130 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2948af0c-73f1-40fa-93e9-8a96979ad50c", "id": 3} v 0) v1 -- 0x7fe794067420 con 0x7fe79406eca0 2024-08-17T02:23:15.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.365+0000 7fe790c00640 1 -- 172.21.15.145:0/88860130 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2948af0c-73f1-40fa-93e9-8a96979ad50c", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe788040070 con 0x7fe79406eca0 2024-08-17T02:23:15.365 INFO:teuthology.orchestra.run.smithi145.stdout:3 2024-08-17T02:23:15.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.366+0000 7fe79ae00640 1 -- 172.21.15.145:0/88860130 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe79406eca0 msgr2=0x7fe794155d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.366+0000 7fe79ae00640 1 --2- 172.21.15.145:0/88860130 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe79406eca0 0x7fe794155d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe788009850 tx=0x7fe788032000 comp rx=0 tx=0).stop 2024-08-17T02:23:15.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.366+0000 7fe79ae00640 1 -- 172.21.15.145:0/88860130 shutdown_connections 2024-08-17T02:23:15.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.366+0000 7fe79ae00640 1 --2- 172.21.15.145:0/88860130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe794158a00 0x7fe7940a70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.366+0000 7fe79ae00640 1 --2- 172.21.15.145:0/88860130 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe7940cb190 0x7fe7940a64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.366+0000 7fe79ae00640 1 --2- 172.21.15.145:0/88860130 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe79406eca0 0x7fe794155d30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.366+0000 7fe79ae00640 1 -- 172.21.15.145:0/88860130 >> 172.21.15.145:0/88860130 conn(0x7fe7940cfb80 msgr2=0x7fe794157b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:15.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.366+0000 7fe79ae00640 1 -- 172.21.15.145:0/88860130 shutdown_connections 2024-08-17T02:23:15.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.366+0000 7fe79ae00640 1 -- 172.21.15.145:0/88860130 wait complete. 2024-08-17T02:23:15.380 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new ce4e1edd-5bd5-45b6-9392-7d6755500a28 4 2024-08-17T02:23:15.465 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:15.464+0000 7fdbb5228ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:23:15.474 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:23:15.473+0000 7f755d76cec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:23:15.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.526+0000 7f2136800640 1 Processor -- start 2024-08-17T02:23:15.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.526+0000 7f2136800640 1 -- start start 2024-08-17T02:23:15.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.527+0000 7f2136800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21301589e0 0x7f2130158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.527+0000 7f2136800640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f21300cda30 0x7f21300cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.527+0000 7f2136800640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21300af9a0 con 0x7f21300ca9c0 2024-08-17T02:23:15.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.527+0000 7f2136800640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21300af810 con 0x7f21300cda30 2024-08-17T02:23:15.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.527+0000 7f2136800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21300ce740 con 0x7f21301589e0 2024-08-17T02:23:15.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.527+0000 7f212fe00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f21300cda30 0x7f21300cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.527+0000 7f212f400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21301589e0 0x7f2130158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.528+0000 7f212f400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21301589e0 0x7f2130158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:49126/0 (socket says 172.21.15.145:49126) 2024-08-17T02:23:15.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.528+0000 7f212fe00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f21300cda30 0x7f21300cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:41572/0 (socket says 172.21.15.145:41572) 2024-08-17T02:23:15.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.528+0000 7f212f400640 1 -- 172.21.15.145:0/820173902 learned_addr learned my addr 172.21.15.145:0/820173902 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-08-17T02:23:15.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.528+0000 7f212ea00640 1 --1- 172.21.15.145:0/820173902 >> v1:172.21.15.145:6789/0 conn(0x7f21300ca9c0 0x7f21300cadd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:41014/0 (socket says 172.21.15.145:41014) 2024-08-17T02:23:15.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.528+0000 7f212f400640 1 -- 172.21.15.145:0/820173902 >> v2:172.21.15.145:3300/0 conn(0x7f21300cda30 msgr2=0x7f21300cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:15.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.528+0000 7f212f400640 1 --2- 172.21.15.145:0/820173902 >> v2:172.21.15.145:3300/0 conn(0x7f21300cda30 0x7f21300cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.528+0000 7f212f400640 1 -- 172.21.15.145:0/820173902 >> v1:172.21.15.145:6789/0 conn(0x7f21300ca9c0 legacy=0x7f21300cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.528+0000 7f212f400640 1 -- 172.21.15.145:0/820173902 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21300cea00 con 0x7f21301589e0 2024-08-17T02:23:15.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.529+0000 7f212f400640 1 --2- 172.21.15.145:0/820173902 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21301589e0 0x7f2130158db0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2120009910 tx=0x7f21200091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f1d63724864213b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:15.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.529+0000 7f212e000640 1 -- 172.21.15.145:0/820173902 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212002ae40 con 0x7f21301589e0 2024-08-17T02:23:15.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.529+0000 7f212e000640 1 -- 172.21.15.145:0/820173902 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2120032440 con 0x7f21301589e0 2024-08-17T02:23:15.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.529+0000 7f212e000640 1 -- 172.21.15.145:0/820173902 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2120032820 con 0x7f21301589e0 2024-08-17T02:23:15.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.530+0000 7f2136800640 1 -- 172.21.15.145:0/820173902 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21301589e0 msgr2=0x7f2130158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.530+0000 7f2136800640 1 --2- 172.21.15.145:0/820173902 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21301589e0 0x7f2130158db0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2120009910 tx=0x7f21200091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.530+0000 7f2136800640 1 -- 172.21.15.145:0/820173902 shutdown_connections 2024-08-17T02:23:15.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.530+0000 7f2136800640 1 --2- 172.21.15.145:0/820173902 >> v2:172.21.15.145:3300/0 conn(0x7f21300cda30 0x7f21300cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.530+0000 7f2136800640 1 --2- 172.21.15.145:0/820173902 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21301589e0 0x7f2130158db0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.530+0000 7f2136800640 1 -- 172.21.15.145:0/820173902 >> 172.21.15.145:0/820173902 conn(0x7f213006e590 msgr2=0x7f213006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:15.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.530+0000 7f2136800640 1 -- 172.21.15.145:0/820173902 shutdown_connections 2024-08-17T02:23:15.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.530+0000 7f2136800640 1 -- 172.21.15.145:0/820173902 wait complete. 2024-08-17T02:23:15.532 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:23:15.530+0000 7f755d76cec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:23:15.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.532+0000 7f2136800640 1 Processor -- start 2024-08-17T02:23:15.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.532+0000 7f2136800640 1 -- start start 2024-08-17T02:23:15.534 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:15.532+0000 7fdbb5228ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:23:15.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.534+0000 7f2136800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21300ca9c0 0x7f21300b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.534+0000 7f2136800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21300cda30 0x7f21300b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.534+0000 7f2136800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f21301589e0 0x7f213014a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.534+0000 7f2136800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21300b3bc0 con 0x7f21300ca9c0 2024-08-17T02:23:15.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.534+0000 7f2136800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21300c6dc0 con 0x7f21301589e0 2024-08-17T02:23:15.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.534+0000 7f2136800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21300c7940 con 0x7f21300cda30 2024-08-17T02:23:15.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.534+0000 7f212ea00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21300cda30 0x7f21300b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.534+0000 7f212ea00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21300cda30 0x7f21300b3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:49130/0 (socket says 172.21.15.145:49130) 2024-08-17T02:23:15.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.534+0000 7f212fe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f21301589e0 0x7f213014a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.534+0000 7f212ea00640 1 -- 172.21.15.145:0/402503616 learned_addr learned my addr 172.21.15.145:0/402503616 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-08-17T02:23:15.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.534+0000 7f212f400640 1 --2- 172.21.15.145:0/402503616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21300ca9c0 0x7f21300b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.535+0000 7f212fe00640 1 -- 172.21.15.145:0/402503616 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21300cda30 msgr2=0x7f21300b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.535+0000 7f212fe00640 1 --2- 172.21.15.145:0/402503616 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21300cda30 0x7f21300b3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.535+0000 7f212fe00640 1 -- 172.21.15.145:0/402503616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21300ca9c0 msgr2=0x7f21300b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.535+0000 7f212fe00640 1 --2- 172.21.15.145:0/402503616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21300ca9c0 0x7f21300b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.535+0000 7f212fe00640 1 -- 172.21.15.145:0/402503616 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2120009450 con 0x7f21301589e0 2024-08-17T02:23:15.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.535+0000 7f212fe00640 1 --2- 172.21.15.145:0/402503616 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f21301589e0 0x7f213014a590 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2128009e50 tx=0x7f212800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:15.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.535+0000 7f2126a00640 1 -- 172.21.15.145:0/402503616 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212800cd40 con 0x7f21301589e0 2024-08-17T02:23:15.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.535+0000 7f2126a00640 1 -- 172.21.15.145:0/402503616 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212800f040 con 0x7f21301589e0 2024-08-17T02:23:15.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.535+0000 7f2126a00640 1 -- 172.21.15.145:0/402503616 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212800cea0 con 0x7f21301589e0 2024-08-17T02:23:15.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.535+0000 7f2136800640 1 -- 172.21.15.145:0/402503616 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f213014af30 con 0x7f21301589e0 2024-08-17T02:23:15.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.535+0000 7f2136800640 1 -- 172.21.15.145:0/402503616 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21300c7010 con 0x7f21301589e0 2024-08-17T02:23:15.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.536+0000 7f2126a00640 1 -- 172.21.15.145:0/402503616 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f2128014b70 con 0x7f21301589e0 2024-08-17T02:23:15.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.536+0000 7f2126a00640 1 -- 172.21.15.145:0/402503616 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f2128014e20 con 0x7f21301589e0 2024-08-17T02:23:15.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.536+0000 7f2136800640 1 -- 172.21.15.145:0/402503616 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2130063fb0 con 0x7f21301589e0 2024-08-17T02:23:15.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.538+0000 7f2126a00640 1 -- 172.21.15.145:0/402503616 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f212803b7a0 con 0x7f21301589e0 2024-08-17T02:23:15.594 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:23:15.593+0000 7f755d76cec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:23:15.598 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:15.597+0000 7fdbb5228ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:23:15.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.613+0000 7f2136800640 1 -- 172.21.15.145:0/402503616 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ce4e1edd-5bd5-45b6-9392-7d6755500a28", "id": 4} v 0) v1 -- 0x7f21300b5ae0 con 0x7f21301589e0 2024-08-17T02:23:15.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.617+0000 7f2126a00640 1 -- 172.21.15.145:0/402503616 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ce4e1edd-5bd5-45b6-9392-7d6755500a28", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f212802a070 con 0x7f21301589e0 2024-08-17T02:23:15.618 INFO:teuthology.orchestra.run.smithi145.stdout:4 2024-08-17T02:23:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.618+0000 7f2136800640 1 -- 172.21.15.145:0/402503616 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f21301589e0 msgr2=0x7f213014a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.618+0000 7f2136800640 1 --2- 172.21.15.145:0/402503616 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f21301589e0 0x7f213014a590 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2128009e50 tx=0x7f212800b040 comp rx=0 tx=0).stop 2024-08-17T02:23:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.618+0000 7f2136800640 1 -- 172.21.15.145:0/402503616 shutdown_connections 2024-08-17T02:23:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.618+0000 7f2136800640 1 --2- 172.21.15.145:0/402503616 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f21301589e0 0x7f213014a590 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.618+0000 7f2136800640 1 --2- 172.21.15.145:0/402503616 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21300cda30 0x7f21300b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.618+0000 7f2136800640 1 --2- 172.21.15.145:0/402503616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21300ca9c0 0x7f21300b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.618+0000 7f2136800640 1 -- 172.21.15.145:0/402503616 >> 172.21.15.145:0/402503616 conn(0x7f213006e590 msgr2=0x7f21301568d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.619+0000 7f2136800640 1 -- 172.21.15.145:0/402503616 shutdown_connections 2024-08-17T02:23:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.619+0000 7f2136800640 1 -- 172.21.15.145:0/402503616 wait complete. 2024-08-17T02:23:15.633 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 8e161cb6-0c9b-44c3-b22e-a4db65f167df 5 2024-08-17T02:23:15.706 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:23:15.705+0000 7f755d76cec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:23:15.712 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:15.711+0000 7fdbb5228ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:23:15.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.774+0000 7feaac200640 1 Processor -- start 2024-08-17T02:23:15.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.774+0000 7feaac200640 1 -- start start 2024-08-17T02:23:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.776+0000 7feaac200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7feaa40685c0 0x7feaa4068990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.776+0000 7feaac200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feaa4159270 0x7feaa40ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.776+0000 7feaac200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa40cdb40 con 0x7feaa40aea30 2024-08-17T02:23:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.776+0000 7feaac200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa40af3b0 con 0x7feaa4159270 2024-08-17T02:23:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.776+0000 7feaac200640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa40cddb0 con 0x7feaa40685c0 2024-08-17T02:23:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.776+0000 7feaa9800640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7feaa40685c0 0x7feaa4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.776+0000 7feaa9800640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7feaa40685c0 0x7feaa4068990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:41590/0 (socket says 172.21.15.145:41590) 2024-08-17T02:23:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.776+0000 7feaa9800640 1 -- 172.21.15.145:0/4264720137 learned_addr learned my addr 172.21.15.145:0/4264720137 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-08-17T02:23:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.776+0000 7feaaa200640 1 --2- 172.21.15.145:0/4264720137 >> v2:172.21.15.2:3300/0 conn(0x7feaa4159270 0x7feaa40ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.776+0000 7feaa9800640 1 -- 172.21.15.145:0/4264720137 >> v2:172.21.15.2:3300/0 conn(0x7feaa4159270 msgr2=0x7feaa40ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:15.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.776+0000 7feaa9800640 1 --2- 172.21.15.145:0/4264720137 >> v2:172.21.15.2:3300/0 conn(0x7feaa4159270 0x7feaa40ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.776+0000 7feaa9800640 1 -- 172.21.15.145:0/4264720137 >> v1:172.21.15.2:6789/0 conn(0x7feaa40aea30 legacy=0x7feaa4158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.776+0000 7feaa9800640 1 -- 172.21.15.145:0/4264720137 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa40ce090 con 0x7feaa40685c0 2024-08-17T02:23:15.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.777+0000 7feaa9800640 1 --2- 172.21.15.145:0/4264720137 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feaa40685c0 0x7feaa4068990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7feaa406f480 tx=0x7fea980091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5f1e283ded7cdfa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:15.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.778+0000 7feaa3e00640 1 -- 172.21.15.145:0/4264720137 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9802ae80 con 0x7feaa40685c0 2024-08-17T02:23:15.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.778+0000 7feaa3e00640 1 -- 172.21.15.145:0/4264720137 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea98032440 con 0x7feaa40685c0 2024-08-17T02:23:15.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.778+0000 7feaa3e00640 1 -- 172.21.15.145:0/4264720137 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea98032800 con 0x7feaa40685c0 2024-08-17T02:23:15.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.778+0000 7feaac200640 1 -- 172.21.15.145:0/4264720137 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feaa40685c0 msgr2=0x7feaa4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.778+0000 7feaac200640 1 --2- 172.21.15.145:0/4264720137 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feaa40685c0 0x7feaa4068990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7feaa406f480 tx=0x7fea980091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.779+0000 7feaac200640 1 -- 172.21.15.145:0/4264720137 shutdown_connections 2024-08-17T02:23:15.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.779+0000 7feaac200640 1 --2- 172.21.15.145:0/4264720137 >> v2:172.21.15.2:3300/0 conn(0x7feaa4159270 0x7feaa40ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.779+0000 7feaac200640 1 --2- 172.21.15.145:0/4264720137 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feaa40685c0 0x7feaa4068990 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.779+0000 7feaac200640 1 -- 172.21.15.145:0/4264720137 >> 172.21.15.145:0/4264720137 conn(0x7feaa406f010 msgr2=0x7feaa40cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:15.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.779+0000 7feaac200640 1 -- 172.21.15.145:0/4264720137 shutdown_connections 2024-08-17T02:23:15.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.779+0000 7feaac200640 1 -- 172.21.15.145:0/4264720137 wait complete. 2024-08-17T02:23:15.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.780+0000 7feaac200640 1 Processor -- start 2024-08-17T02:23:15.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.780+0000 7feaac200640 1 -- start start 2024-08-17T02:23:15.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.781+0000 7feaac200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feaa40685c0 0x7feaa41458a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.781+0000 7feaac200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feaa40aea30 0x7feaa40b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.781+0000 7feaac200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaa4159270 0x7feaa40c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.781+0000 7feaac200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa40b4540 con 0x7feaa4159270 2024-08-17T02:23:15.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.781+0000 7feaac200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa40b4820 con 0x7feaa40685c0 2024-08-17T02:23:15.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.781+0000 7feaac200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa40b4b00 con 0x7feaa40aea30 2024-08-17T02:23:15.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.781+0000 7feaa9800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feaa40685c0 0x7feaa41458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.781+0000 7feaa8e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feaa40aea30 0x7feaa40b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.781+0000 7feaa9800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feaa40685c0 0x7feaa41458a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:41598/0 (socket says 172.21.15.145:41598) 2024-08-17T02:23:15.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.781+0000 7feaa9800640 1 -- 172.21.15.145:0/3459717999 learned_addr learned my addr 172.21.15.145:0/3459717999 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-08-17T02:23:15.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.781+0000 7feaaa200640 1 --2- 172.21.15.145:0/3459717999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaa4159270 0x7feaa40c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.782+0000 7feaa8e00640 1 -- 172.21.15.145:0/3459717999 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feaa40685c0 msgr2=0x7feaa41458a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.782+0000 7feaa8e00640 1 --2- 172.21.15.145:0/3459717999 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feaa40685c0 0x7feaa41458a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.782+0000 7feaa8e00640 1 -- 172.21.15.145:0/3459717999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaa4159270 msgr2=0x7feaa40c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.782+0000 7feaa8e00640 1 --2- 172.21.15.145:0/3459717999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaa4159270 0x7feaa40c7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.782+0000 7feaa8e00640 1 -- 172.21.15.145:0/3459717999 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea98009450 con 0x7feaa40aea30 2024-08-17T02:23:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.782+0000 7feaa9800640 1 --2- 172.21.15.145:0/3459717999 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feaa40685c0 0x7feaa41458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:15.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.782+0000 7feaaa200640 1 --2- 172.21.15.145:0/3459717999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaa4159270 0x7feaa40c7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:15.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.782+0000 7feaa8e00640 1 --2- 172.21.15.145:0/3459717999 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feaa40aea30 0x7feaa40b3c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fea9000c4b0 tx=0x7fea90007e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:15.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.782+0000 7feaa0c00640 1 -- 172.21.15.145:0/3459717999 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea90011590 con 0x7feaa40aea30 2024-08-17T02:23:15.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.782+0000 7feaa0c00640 1 -- 172.21.15.145:0/3459717999 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea900116f0 con 0x7feaa40aea30 2024-08-17T02:23:15.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.782+0000 7feaac200640 1 -- 172.21.15.145:0/3459717999 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa414d680 con 0x7feaa40aea30 2024-08-17T02:23:15.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.782+0000 7feaa0c00640 1 -- 172.21.15.145:0/3459717999 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea90011ab0 con 0x7feaa40aea30 2024-08-17T02:23:15.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.782+0000 7feaac200640 1 -- 172.21.15.145:0/3459717999 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa4145de0 con 0x7feaa40aea30 2024-08-17T02:23:15.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.783+0000 7feaa0c00640 1 -- 172.21.15.145:0/3459717999 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fea9001c440 con 0x7feaa40aea30 2024-08-17T02:23:15.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.783+0000 7feaa0c00640 1 -- 172.21.15.145:0/3459717999 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fea90012420 con 0x7feaa40aea30 2024-08-17T02:23:15.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.784+0000 7feaac200640 1 -- 172.21.15.145:0/3459717999 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa414db80 con 0x7feaa40aea30 2024-08-17T02:23:15.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.788+0000 7feaa0c00640 1 -- 172.21.15.145:0/3459717999 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fea90017070 con 0x7feaa40aea30 2024-08-17T02:23:15.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.861+0000 7feaac200640 1 -- 172.21.15.145:0/3459717999 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8e161cb6-0c9b-44c3-b22e-a4db65f167df", "id": 5} v 0) v1 -- 0x7feaa4063fb0 con 0x7feaa40aea30 2024-08-17T02:23:15.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.865+0000 7feaa0c00640 1 -- 172.21.15.145:0/3459717999 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8e161cb6-0c9b-44c3-b22e-a4db65f167df", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fea9001c6f0 con 0x7feaa40aea30 2024-08-17T02:23:15.866 INFO:teuthology.orchestra.run.smithi145.stdout:5 2024-08-17T02:23:15.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.867+0000 7feaac200640 1 -- 172.21.15.145:0/3459717999 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feaa40aea30 msgr2=0x7feaa40b3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.867+0000 7feaac200640 1 --2- 172.21.15.145:0/3459717999 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feaa40aea30 0x7feaa40b3c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fea9000c4b0 tx=0x7fea90007e30 comp rx=0 tx=0).stop 2024-08-17T02:23:15.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.867+0000 7feaac200640 1 -- 172.21.15.145:0/3459717999 shutdown_connections 2024-08-17T02:23:15.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.867+0000 7feaac200640 1 --2- 172.21.15.145:0/3459717999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaa4159270 0x7feaa40c7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.867+0000 7feaac200640 1 --2- 172.21.15.145:0/3459717999 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feaa40aea30 0x7feaa40b3c40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.867+0000 7feaac200640 1 --2- 172.21.15.145:0/3459717999 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feaa40685c0 0x7feaa41458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.867+0000 7feaac200640 1 -- 172.21.15.145:0/3459717999 >> 172.21.15.145:0/3459717999 conn(0x7feaa406f010 msgr2=0x7feaa4153520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:15.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.867+0000 7feaac200640 1 -- 172.21.15.145:0/3459717999 shutdown_connections 2024-08-17T02:23:15.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:15.867+0000 7feaac200640 1 -- 172.21.15.145:0/3459717999 wait complete. 2024-08-17T02:23:15.881 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new c1f132ba-54e2-47f8-a725-881b32fec209 6 2024-08-17T02:23:16.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.024+0000 7f060ca00640 1 Processor -- start 2024-08-17T02:23:16.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.024+0000 7f060ca00640 1 -- start start 2024-08-17T02:23:16.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.025+0000 7f060ca00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0608158a00 0x7f0608158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:16.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.025+0000 7f060ca00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06080cbc50 con 0x7f06080cb190 2024-08-17T02:23:16.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.025+0000 7f060ca00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06080cbf30 con 0x7f060806eca0 2024-08-17T02:23:16.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.025+0000 7f060ca00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06080cc210 con 0x7f0608158a00 2024-08-17T02:23:16.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.025+0000 7f0607200640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f060806eca0 0x7f06080b3130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:41022/0 (socket says 172.21.15.145:41022) 2024-08-17T02:23:16.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.025+0000 7f0607200640 1 -- 172.21.15.145:0/2992713452 learned_addr learned my addr 172.21.15.145:0/2992713452 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-08-17T02:23:16.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.025+0000 7f0606800640 1 --2- 172.21.15.145:0/2992713452 >> v2:172.21.15.2:3300/0 conn(0x7f0608158a00 0x7f0608158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:16.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.026+0000 7f0605e00640 1 -- 172.21.15.145:0/2992713452 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3863175468 0 0) 0x7f06080cbf30 con 0x7f060806eca0 2024-08-17T02:23:16.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.026+0000 7f0605e00640 1 -- 172.21.15.145:0/2992713452 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05ec0034e0 con 0x7f060806eca0 2024-08-17T02:23:16.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.026+0000 7f0605e00640 1 -- 172.21.15.145:0/2992713452 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116934355 0 0) 0x7f06080cbc50 con 0x7f06080cb190 2024-08-17T02:23:16.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.026+0000 7f0605e00640 1 -- 172.21.15.145:0/2992713452 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06080cbf30 con 0x7f06080cb190 2024-08-17T02:23:16.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.026+0000 7f0606800640 1 -- 172.21.15.145:0/2992713452 >> v1:172.21.15.145:6789/0 conn(0x7f060806eca0 legacy=0x7f06080b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:16.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.026+0000 7f0606800640 1 -- 172.21.15.145:0/2992713452 >> v1:172.21.15.2:6789/0 conn(0x7f06080cb190 legacy=0x7f060806e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:16.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.026+0000 7f0606800640 1 -- 172.21.15.145:0/2992713452 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06080b2930 con 0x7f0608158a00 2024-08-17T02:23:16.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.027+0000 7f0606800640 1 --2- 172.21.15.145:0/2992713452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0608158a00 0x7f0608158dd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f05f8009850 tx=0x7f05f80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2340e4f66623996 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:16.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.027+0000 7f0605e00640 1 -- 172.21.15.145:0/2992713452 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f802ae20 con 0x7f0608158a00 2024-08-17T02:23:16.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.027+0000 7f0605e00640 1 -- 172.21.15.145:0/2992713452 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f8032440 con 0x7f0608158a00 2024-08-17T02:23:16.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.027+0000 7f0605e00640 1 -- 172.21.15.145:0/2992713452 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f80327e0 con 0x7f0608158a00 2024-08-17T02:23:16.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.028+0000 7f060ca00640 1 -- 172.21.15.145:0/2992713452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0608158a00 msgr2=0x7f0608158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:16.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.028+0000 7f060ca00640 1 --2- 172.21.15.145:0/2992713452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0608158a00 0x7f0608158dd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f05f8009850 tx=0x7f05f80090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.028+0000 7f060ca00640 1 -- 172.21.15.145:0/2992713452 shutdown_connections 2024-08-17T02:23:16.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.028+0000 7f060ca00640 1 --2- 172.21.15.145:0/2992713452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0608158a00 0x7f0608158dd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.028+0000 7f060ca00640 1 -- 172.21.15.145:0/2992713452 >> 172.21.15.145:0/2992713452 conn(0x7f06080cfb80 msgr2=0x7f06080cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:16.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.028+0000 7f060ca00640 1 -- 172.21.15.145:0/2992713452 shutdown_connections 2024-08-17T02:23:16.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.028+0000 7f060ca00640 1 -- 172.21.15.145:0/2992713452 wait complete. 2024-08-17T02:23:16.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.029+0000 7f060ca00640 1 Processor -- start 2024-08-17T02:23:16.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.030+0000 7f060ca00640 1 -- start start 2024-08-17T02:23:16.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.030+0000 7f060ca00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f060806eca0 0x7f0608157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:16.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.030+0000 7f060ca00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06080cb190 0x7f06080c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:16.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.031+0000 7f060ca00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0608158a00 0x7f06080c9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:16.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.031+0000 7f060ca00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0608169150 con 0x7f0608158a00 2024-08-17T02:23:16.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.031+0000 7f060ca00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0608169f50 con 0x7f06080cb190 2024-08-17T02:23:16.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.031+0000 7f060ca00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0608169340 con 0x7f060806eca0 2024-08-17T02:23:16.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.031+0000 7f0606800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f060806eca0 0x7f0608157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:16.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.031+0000 7f05ffe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06080cb190 0x7f06080c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:16.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.031+0000 7f0606800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f060806eca0 0x7f0608157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:49140/0 (socket says 172.21.15.145:49140) 2024-08-17T02:23:16.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.031+0000 7f0606800640 1 -- 172.21.15.145:0/195480135 learned_addr learned my addr 172.21.15.145:0/195480135 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-08-17T02:23:16.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.031+0000 7f0607200640 1 --2- 172.21.15.145:0/195480135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0608158a00 0x7f06080c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:16.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.031+0000 7f0606800640 1 -- 172.21.15.145:0/195480135 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06080cb190 msgr2=0x7f06080c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:16.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.031+0000 7f0606800640 1 --2- 172.21.15.145:0/195480135 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06080cb190 0x7f06080c8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.031+0000 7f0606800640 1 -- 172.21.15.145:0/195480135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0608158a00 msgr2=0x7f06080c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:16.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.031+0000 7f0606800640 1 --2- 172.21.15.145:0/195480135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0608158a00 0x7f06080c9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.031+0000 7f0606800640 1 -- 172.21.15.145:0/195480135 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f8009390 con 0x7f060806eca0 2024-08-17T02:23:16.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.032+0000 7f0606800640 1 --2- 172.21.15.145:0/195480135 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f060806eca0 0x7f0608157c20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f05f8009360 tx=0x7f05f8032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:16.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.032+0000 7f05fe000640 1 -- 172.21.15.145:0/195480135 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f8000c40 con 0x7f060806eca0 2024-08-17T02:23:16.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.032+0000 7f05fe000640 1 -- 172.21.15.145:0/195480135 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f8031a60 con 0x7f060806eca0 2024-08-17T02:23:16.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.032+0000 7f05fe000640 1 -- 172.21.15.145:0/195480135 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f8031e00 con 0x7f060806eca0 2024-08-17T02:23:16.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.032+0000 7f060ca00640 1 -- 172.21.15.145:0/195480135 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0608169620 con 0x7f060806eca0 2024-08-17T02:23:16.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.032+0000 7f060ca00640 1 -- 172.21.15.145:0/195480135 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0608169be0 con 0x7f060806eca0 2024-08-17T02:23:16.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.032+0000 7f05fe000640 1 -- 172.21.15.145:0/195480135 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f05f8039040 con 0x7f060806eca0 2024-08-17T02:23:16.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.032+0000 7f05fe000640 1 -- 172.21.15.145:0/195480135 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f05f803d8c0 con 0x7f060806eca0 2024-08-17T02:23:16.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.033+0000 7f060ca00640 1 -- 172.21.15.145:0/195480135 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0608070720 con 0x7f060806eca0 2024-08-17T02:23:16.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.035+0000 7f05fe000640 1 -- 172.21.15.145:0/195480135 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f05f8042070 con 0x7f060806eca0 2024-08-17T02:23:16.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.109+0000 7f060ca00640 1 -- 172.21.15.145:0/195480135 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c1f132ba-54e2-47f8-a725-881b32fec209", "id": 6} v 0) v1 -- 0x7f06080cf870 con 0x7f060806eca0 2024-08-17T02:23:16.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.113+0000 7f05fe000640 1 -- 172.21.15.145:0/195480135 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c1f132ba-54e2-47f8-a725-881b32fec209", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f05f8037070 con 0x7f060806eca0 2024-08-17T02:23:16.114 INFO:teuthology.orchestra.run.smithi145.stdout:6 2024-08-17T02:23:16.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.114+0000 7f060ca00640 1 -- 172.21.15.145:0/195480135 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f060806eca0 msgr2=0x7f0608157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:16.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.114+0000 7f060ca00640 1 --2- 172.21.15.145:0/195480135 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f060806eca0 0x7f0608157c20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f05f8009360 tx=0x7f05f8032000 comp rx=0 tx=0).stop 2024-08-17T02:23:16.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.114+0000 7f060ca00640 1 -- 172.21.15.145:0/195480135 shutdown_connections 2024-08-17T02:23:16.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.114+0000 7f060ca00640 1 --2- 172.21.15.145:0/195480135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0608158a00 0x7f06080c9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.114+0000 7f060ca00640 1 --2- 172.21.15.145:0/195480135 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06080cb190 0x7f06080c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.114+0000 7f060ca00640 1 --2- 172.21.15.145:0/195480135 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f060806eca0 0x7f0608157c20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.114+0000 7f060ca00640 1 -- 172.21.15.145:0/195480135 >> 172.21.15.145:0/195480135 conn(0x7f06080cfb80 msgr2=0x7f06080b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:16.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.115+0000 7f060ca00640 1 -- 172.21.15.145:0/195480135 shutdown_connections 2024-08-17T02:23:16.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.115+0000 7f060ca00640 1 -- 172.21.15.145:0/195480135 wait complete. 2024-08-17T02:23:16.130 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new b0d61fc9-84ed-4d82-961c-2240773be302 7 2024-08-17T02:23:16.179 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:23:16.178+0000 7f755d76cec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:23:16.190 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:16.189+0000 7fdbb5228ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:23:16.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.275+0000 7f8ebce00640 1 Processor -- start 2024-08-17T02:23:16.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.275+0000 7f8ebce00640 1 -- start start 2024-08-17T02:23:16.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.276+0000 7f8ebce00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8eb8158a00 0x7f8eb8158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:16.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.276+0000 7f8ebce00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8eb80cb190 0x7f8eb80cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:16.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.276+0000 7f8ebce00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8eb806e590 0x7f8eb806e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:16.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.276+0000 7f8ebce00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb806eef0 con 0x7f8eb8158a00 2024-08-17T02:23:16.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.276+0000 7f8ebce00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb80cbc50 con 0x7f8eb80cb190 2024-08-17T02:23:16.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.276+0000 7f8ebce00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb80cbf30 con 0x7f8eb806e590 2024-08-17T02:23:16.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.276+0000 7f8eb7e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8eb806e590 0x7f8eb806e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:16.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.276+0000 7f8eb6a00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8eb80cb190 0x7f8eb80cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:16.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.276+0000 7f8eb7e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8eb806e590 0x7f8eb806e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:49152/0 (socket says 172.21.15.145:49152) 2024-08-17T02:23:16.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.276+0000 7f8eb7e00640 1 -- 172.21.15.145:0/4101944892 learned_addr learned my addr 172.21.15.145:0/4101944892 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-08-17T02:23:16.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.276+0000 7f8eb7400640 1 --2- 172.21.15.145:0/4101944892 >> v2:172.21.15.2:3300/0 conn(0x7f8eb8158a00 0x7f8eb8158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:16.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.277+0000 7f8eb7e00640 1 -- 172.21.15.145:0/4101944892 >> v2:172.21.15.145:3300/0 conn(0x7f8eb80cb190 msgr2=0x7f8eb80cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:16.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.277+0000 7f8eb7e00640 1 --2- 172.21.15.145:0/4101944892 >> v2:172.21.15.145:3300/0 conn(0x7f8eb80cb190 0x7f8eb80cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.277+0000 7f8eb7e00640 1 -- 172.21.15.145:0/4101944892 >> v2:172.21.15.2:3300/0 conn(0x7f8eb8158a00 msgr2=0x7f8eb8158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:16.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.277+0000 7f8eb7e00640 1 --2- 172.21.15.145:0/4101944892 >> v2:172.21.15.2:3300/0 conn(0x7f8eb8158a00 0x7f8eb8158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.277+0000 7f8eb7e00640 1 -- 172.21.15.145:0/4101944892 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb80cc210 con 0x7f8eb806e590 2024-08-17T02:23:16.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.278+0000 7f8eb7e00640 1 --2- 172.21.15.145:0/4101944892 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8eb806e590 0x7f8eb806e9b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80ca0b0 tx=0x7f8eb0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc2ae922f9b7af08 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:16.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.278+0000 7f8eb6000640 1 -- 172.21.15.145:0/4101944892 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0031400 con 0x7f8eb806e590 2024-08-17T02:23:16.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.278+0000 7f8eb6000640 1 -- 172.21.15.145:0/4101944892 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb002d050 con 0x7f8eb806e590 2024-08-17T02:23:16.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.278+0000 7f8eb6000640 1 -- 172.21.15.145:0/4101944892 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb00317d0 con 0x7f8eb806e590 2024-08-17T02:23:16.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.279+0000 7f8ebce00640 1 -- 172.21.15.145:0/4101944892 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8eb806e590 msgr2=0x7f8eb806e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:16.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.279+0000 7f8ebce00640 1 --2- 172.21.15.145:0/4101944892 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8eb806e590 0x7f8eb806e9b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80ca0b0 tx=0x7f8eb0009840 comp rx=0 tx=0).stop 2024-08-17T02:23:16.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.279+0000 7f8ebce00640 1 -- 172.21.15.145:0/4101944892 shutdown_connections 2024-08-17T02:23:16.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.279+0000 7f8ebce00640 1 --2- 172.21.15.145:0/4101944892 >> v2:172.21.15.145:3300/0 conn(0x7f8eb80cb190 0x7f8eb80cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.279+0000 7f8ebce00640 1 --2- 172.21.15.145:0/4101944892 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8eb806e590 0x7f8eb806e9b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.279+0000 7f8ebce00640 1 --2- 172.21.15.145:0/4101944892 >> v2:172.21.15.2:3300/0 conn(0x7f8eb8158a00 0x7f8eb8158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.279+0000 7f8ebce00640 1 -- 172.21.15.145:0/4101944892 >> 172.21.15.145:0/4101944892 conn(0x7f8eb80cfb80 msgr2=0x7f8eb80cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:16.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.279+0000 7f8ebce00640 1 -- 172.21.15.145:0/4101944892 shutdown_connections 2024-08-17T02:23:16.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.279+0000 7f8ebce00640 1 -- 172.21.15.145:0/4101944892 wait complete. 2024-08-17T02:23:16.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.280+0000 7f8ebce00640 1 Processor -- start 2024-08-17T02:23:16.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.281+0000 7f8ebce00640 1 -- start start 2024-08-17T02:23:16.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.281+0000 7f8ebce00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8eb806e590 0x7f8eb80c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.281+0000 7f8ebce00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8eb80cb190 0x7f8eb816b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.281+0000 7f8ebce00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8eb8158a00 0x7f8eb80a73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.281+0000 7f8ebce00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb80ca150 con 0x7f8eb8158a00 2024-08-17T02:23:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.281+0000 7f8ebce00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb80c9540 con 0x7f8eb806e590 2024-08-17T02:23:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.281+0000 7f8ebce00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb80c9820 con 0x7f8eb80cb190 2024-08-17T02:23:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.282+0000 7f8eb7400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8eb806e590 0x7f8eb80c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.282+0000 7f8eb6a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8eb80cb190 0x7f8eb816b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.282+0000 7f8eb7400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8eb806e590 0x7f8eb80c8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:41612/0 (socket says 172.21.15.145:41612) 2024-08-17T02:23:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.282+0000 7f8eb7400640 1 -- 172.21.15.145:0/884443171 learned_addr learned my addr 172.21.15.145:0/884443171 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-08-17T02:23:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.282+0000 7f8eb7e00640 1 --2- 172.21.15.145:0/884443171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8eb8158a00 0x7f8eb80a73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.282+0000 7f8eb7400640 1 -- 172.21.15.145:0/884443171 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8eb80cb190 msgr2=0x7f8eb816b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.282+0000 7f8eb7400640 1 --2- 172.21.15.145:0/884443171 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8eb80cb190 0x7f8eb816b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.282+0000 7f8eb7400640 1 -- 172.21.15.145:0/884443171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8eb8158a00 msgr2=0x7f8eb80a73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:16.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.282+0000 7f8eb7400640 1 --2- 172.21.15.145:0/884443171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8eb8158a00 0x7f8eb80a73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.282+0000 7f8eb7400640 1 -- 172.21.15.145:0/884443171 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb0009ae0 con 0x7f8eb806e590 2024-08-17T02:23:16.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.282+0000 7f8eb7400640 1 --2- 172.21.15.145:0/884443171 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8eb806e590 0x7f8eb80c8e30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8ea800e900 tx=0x7f8ea80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:16.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.283+0000 7f8eaea00640 1 -- 172.21.15.145:0/884443171 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea800c8e0 con 0x7f8eb806e590 2024-08-17T02:23:16.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.283+0000 7f8eaea00640 1 -- 172.21.15.145:0/884443171 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea800ca40 con 0x7f8eb806e590 2024-08-17T02:23:16.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.283+0000 7f8ebce00640 1 -- 172.21.15.145:0/884443171 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb80c9b00 con 0x7f8eb806e590 2024-08-17T02:23:16.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.283+0000 7f8eaea00640 1 -- 172.21.15.145:0/884443171 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea800cde0 con 0x7f8eb806e590 2024-08-17T02:23:16.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.283+0000 7f8ebce00640 1 -- 172.21.15.145:0/884443171 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb816bf20 con 0x7f8eb806e590 2024-08-17T02:23:16.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.283+0000 7f8eaea00640 1 -- 172.21.15.145:0/884443171 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f8ea8005970 con 0x7f8eb806e590 2024-08-17T02:23:16.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.283+0000 7f8eaea00640 1 -- 172.21.15.145:0/884443171 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f8ea8005c20 con 0x7f8eb806e590 2024-08-17T02:23:16.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.284+0000 7f8ebce00640 1 -- 172.21.15.145:0/884443171 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb8070720 con 0x7f8eb806e590 2024-08-17T02:23:16.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.286+0000 7f8eaea00640 1 -- 172.21.15.145:0/884443171 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f8ea8021060 con 0x7f8eb806e590 2024-08-17T02:23:16.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.360+0000 7f8ebce00640 1 -- 172.21.15.145:0/884443171 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b0d61fc9-84ed-4d82-961c-2240773be302", "id": 7} v 0) v1 -- 0x7f8eb80cf8a0 con 0x7f8eb806e590 2024-08-17T02:23:16.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.364+0000 7f8eaea00640 1 -- 172.21.15.145:0/884443171 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b0d61fc9-84ed-4d82-961c-2240773be302", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8ea8029020 con 0x7f8eb806e590 2024-08-17T02:23:16.365 INFO:teuthology.orchestra.run.smithi145.stdout:7 2024-08-17T02:23:16.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.365+0000 7f8ebce00640 1 -- 172.21.15.145:0/884443171 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8eb806e590 msgr2=0x7f8eb80c8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:16.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.365+0000 7f8ebce00640 1 --2- 172.21.15.145:0/884443171 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8eb806e590 0x7f8eb80c8e30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8ea800e900 tx=0x7f8ea80090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.365+0000 7f8ebce00640 1 -- 172.21.15.145:0/884443171 shutdown_connections 2024-08-17T02:23:16.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.365+0000 7f8ebce00640 1 --2- 172.21.15.145:0/884443171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8eb8158a00 0x7f8eb80a73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.365+0000 7f8ebce00640 1 --2- 172.21.15.145:0/884443171 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8eb80cb190 0x7f8eb816b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.365+0000 7f8ebce00640 1 --2- 172.21.15.145:0/884443171 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8eb806e590 0x7f8eb80c8e30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.365+0000 7f8ebce00640 1 -- 172.21.15.145:0/884443171 >> 172.21.15.145:0/884443171 conn(0x7f8eb80cfb80 msgr2=0x7f8eb80ce5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:16.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.365+0000 7f8ebce00640 1 -- 172.21.15.145:0/884443171 shutdown_connections 2024-08-17T02:23:16.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-08-17T02:23:16.365+0000 7f8ebce00640 1 -- 172.21.15.145:0/884443171 wait complete. 2024-08-17T02:23:16.379 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-17T02:23:16.380 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-17T02:23:16.384 INFO:tasks.ceph.osd.0:Started 2024-08-17T02:23:16.384 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-17T02:23:16.384 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-17T02:23:16.388 INFO:tasks.ceph.osd.1:Started 2024-08-17T02:23:16.388 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-17T02:23:16.388 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-17T02:23:16.391 INFO:tasks.ceph.osd.2:Started 2024-08-17T02:23:16.392 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-17T02:23:16.392 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-17T02:23:16.397 INFO:tasks.ceph.osd.3:Started 2024-08-17T02:23:16.397 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-17T02:23:16.397 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-17T02:23:16.401 INFO:tasks.ceph.osd.4:Started 2024-08-17T02:23:16.401 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-17T02:23:16.401 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-17T02:23:16.405 INFO:tasks.ceph.osd.5:Started 2024-08-17T02:23:16.405 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-17T02:23:16.405 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-17T02:23:16.410 INFO:tasks.ceph.osd.6:Started 2024-08-17T02:23:16.410 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-17T02:23:16.410 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-17T02:23:16.415 INFO:tasks.ceph.osd.7:Started 2024-08-17T02:23:16.415 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:16.489 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:16.489+0000 7fdbb5228ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:23:16.491 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:23:16.490+0000 7f755d76cec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:23:16.578 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:16.577+0000 7fdbb5228ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:23:16.581 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:23:16.579+0000 7f755d76cec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:23:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.629+0000 7fad3de00640 1 Processor -- start 2024-08-17T02:23:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.629+0000 7fad3de00640 1 -- start start 2024-08-17T02:23:16.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.630+0000 7fad3de00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad380cc220 0x7fad380c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:16.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.630+0000 7fad3de00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fad380cc630 0x7fad380c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.630+0000 7fad3de00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad380c4bb0 con 0x7fad380b0040 2024-08-17T02:23:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.630+0000 7fad3de00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad380c8c10 con 0x7fad380cc630 2024-08-17T02:23:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.630+0000 7fad3de00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad38157230 con 0x7fad380cc220 2024-08-17T02:23:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.631+0000 7fad36000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad380cc220 0x7fad380c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.631+0000 7fad37400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fad380cc630 0x7fad380c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.631+0000 7fad36a00640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fad380b0040 0x7fad380cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:37416/0 (socket says 172.21.15.2:37416) 2024-08-17T02:23:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.631+0000 7fad36a00640 1 -- 172.21.15.2:0/352075047 learned_addr learned my addr 172.21.15.2:0/352075047 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.631+0000 7fad37400640 1 -- 172.21.15.2:0/352075047 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad380cc220 msgr2=0x7fad380c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.631+0000 7fad37400640 1 --2- 172.21.15.2:0/352075047 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad380cc220 0x7fad380c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.631+0000 7fad37400640 1 -- 172.21.15.2:0/352075047 >> v1:172.21.15.145:6789/0 conn(0x7fad380b0040 legacy=0x7fad380cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.631+0000 7fad37400640 1 -- 172.21.15.2:0/352075047 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad38087070 con 0x7fad380cc630 2024-08-17T02:23:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.631+0000 7fad36000640 1 --2- 172.21.15.2:0/352075047 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad380cc220 0x7fad380c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.632+0000 7fad37400640 1 --2- 172.21.15.2:0/352075047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad380cc630 0x7fad380c95e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fad30009e60 tx=0x7fad30009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3fd69e8b4759e2b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.632+0000 7fad35600640 1 -- 172.21.15.2:0/352075047 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30007550 con 0x7fad380cc630 2024-08-17T02:23:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.633+0000 7fad35600640 1 -- 172.21.15.2:0/352075047 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3002d050 con 0x7fad380cc630 2024-08-17T02:23:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.633+0000 7fad35600640 1 -- 172.21.15.2:0/352075047 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30007920 con 0x7fad380cc630 2024-08-17T02:23:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.633+0000 7fad3de00640 1 -- 172.21.15.2:0/352075047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad380cc630 msgr2=0x7fad380c95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.633+0000 7fad3de00640 1 --2- 172.21.15.2:0/352075047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad380cc630 0x7fad380c95e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fad30009e60 tx=0x7fad30009780 comp rx=0 tx=0).stop 2024-08-17T02:23:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.633+0000 7fad3de00640 1 -- 172.21.15.2:0/352075047 shutdown_connections 2024-08-17T02:23:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.633+0000 7fad3de00640 1 --2- 172.21.15.2:0/352075047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad380cc630 0x7fad380c95e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.633+0000 7fad3de00640 1 --2- 172.21.15.2:0/352075047 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad380cc220 0x7fad380c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.633+0000 7fad3de00640 1 -- 172.21.15.2:0/352075047 >> 172.21.15.2:0/352075047 conn(0x7fad380ce590 msgr2=0x7fad380ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.633+0000 7fad3de00640 1 -- 172.21.15.2:0/352075047 shutdown_connections 2024-08-17T02:23:16.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.633+0000 7fad3de00640 1 -- 172.21.15.2:0/352075047 wait complete. 2024-08-17T02:23:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.635+0000 7fad3de00640 1 Processor -- start 2024-08-17T02:23:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.635+0000 7fad3de00640 1 -- start start 2024-08-17T02:23:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.636+0000 7fad3de00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad380b0040 0x7fad3815c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.636+0000 7fad3de00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad380cc220 0x7fad38152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.636+0000 7fad3de00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad380cc630 0x7fad380c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.636+0000 7fad3de00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad380b0940 con 0x7fad380cc630 2024-08-17T02:23:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.636+0000 7fad3de00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad380b0bb0 con 0x7fad380cc220 2024-08-17T02:23:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.636+0000 7fad3de00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad380b0e90 con 0x7fad380b0040 2024-08-17T02:23:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.636+0000 7fad36a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad380b0040 0x7fad3815c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.636+0000 7fad36000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad380cc220 0x7fad38152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.636+0000 7fad37400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad380cc630 0x7fad380c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.636+0000 7fad36000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad380cc220 0x7fad38152740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:49490/0 (socket says 172.21.15.2:49490) 2024-08-17T02:23:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.636+0000 7fad36a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad380b0040 0x7fad3815c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:53416/0 (socket says 172.21.15.2:53416) 2024-08-17T02:23:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.636+0000 7fad36000640 1 -- 172.21.15.2:0/3799356518 learned_addr learned my addr 172.21.15.2:0/3799356518 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.637+0000 7fad36000640 1 -- 172.21.15.2:0/3799356518 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad380b0040 msgr2=0x7fad3815c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.637+0000 7fad36000640 1 --2- 172.21.15.2:0/3799356518 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad380b0040 0x7fad3815c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.637+0000 7fad36000640 1 -- 172.21.15.2:0/3799356518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad380cc630 msgr2=0x7fad380c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.637+0000 7fad36000640 1 --2- 172.21.15.2:0/3799356518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad380cc630 0x7fad380c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.637+0000 7fad36000640 1 -- 172.21.15.2:0/3799356518 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad24009390 con 0x7fad380cc220 2024-08-17T02:23:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.637+0000 7fad36a00640 1 --2- 172.21.15.2:0/3799356518 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad380b0040 0x7fad3815c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.637+0000 7fad36000640 1 --2- 172.21.15.2:0/3799356518 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad380cc220 0x7fad38152740 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fad2400ec80 tx=0x7fad240090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:16.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.637+0000 7fad2e000640 1 -- 172.21.15.2:0/3799356518 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2400eec0 con 0x7fad380cc220 2024-08-17T02:23:16.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.637+0000 7fad2e000640 1 -- 172.21.15.2:0/3799356518 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2400cbc0 con 0x7fad380cc220 2024-08-17T02:23:16.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.637+0000 7fad3de00640 1 -- 172.21.15.2:0/3799356518 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad30009a20 con 0x7fad380cc220 2024-08-17T02:23:16.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.637+0000 7fad2e000640 1 -- 172.21.15.2:0/3799356518 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad24013470 con 0x7fad380cc220 2024-08-17T02:23:16.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.637+0000 7fad3de00640 1 -- 172.21.15.2:0/3799356518 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad3815c6b0 con 0x7fad380cc220 2024-08-17T02:23:16.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.638+0000 7fad2e000640 1 -- 172.21.15.2:0/3799356518 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fad24005970 con 0x7fad380cc220 2024-08-17T02:23:16.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.638+0000 7fad2e000640 1 -- 172.21.15.2:0/3799356518 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fad24006700 con 0x7fad380cc220 2024-08-17T02:23:16.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.638+0000 7fad3de00640 1 -- 172.21.15.2:0/3799356518 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad380c80a0 con 0x7fad380cc220 2024-08-17T02:23:16.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.641+0000 7fad2e000640 1 -- 172.21.15.2:0/3799356518 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fad380c80a0 con 0x7fad380cc220 2024-08-17T02:23:16.691 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:16.690+0000 7fdbb5228ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:23:16.702 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:23:16.701+0000 7f755d76cec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:23:16.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.704+0000 7fad3de00640 1 -- 172.21.15.2:0/3799356518 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad38063fb0 con 0x7fad380cc220 2024-08-17T02:23:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.705+0000 7fad2e000640 1 -- 172.21.15.2:0/3799356518 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fad24021060 con 0x7fad380cc220 2024-08-17T02:23:16.707 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:16.707 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":10,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:23:16.362200+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.706+0000 7fad3de00640 1 -- 172.21.15.2:0/3799356518 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad380cc220 msgr2=0x7fad38152740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.706+0000 7fad3de00640 1 --2- 172.21.15.2:0/3799356518 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad380cc220 0x7fad38152740 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fad2400ec80 tx=0x7fad240090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.707+0000 7fad3de00640 1 -- 172.21.15.2:0/3799356518 shutdown_connections 2024-08-17T02:23:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.707+0000 7fad3de00640 1 --2- 172.21.15.2:0/3799356518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad380cc630 0x7fad380c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.707+0000 7fad3de00640 1 --2- 172.21.15.2:0/3799356518 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad380cc220 0x7fad38152740 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.707+0000 7fad3de00640 1 --2- 172.21.15.2:0/3799356518 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad380b0040 0x7fad3815c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.707+0000 7fad3de00640 1 -- 172.21.15.2:0/3799356518 >> 172.21.15.2:0/3799356518 conn(0x7fad380ce590 msgr2=0x7fad38095cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.707+0000 7fad3de00640 1 -- 172.21.15.2:0/3799356518 shutdown_connections 2024-08-17T02:23:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:16.707+0000 7fad3de00640 1 -- 172.21.15.2:0/3799356518 wait complete. 2024-08-17T02:23:16.723 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-17T02:23:16.723 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-17T02:23:16.973 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:16.972+0000 7fdbb5228ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:23:17.001 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:23:17.000+0000 7f755d76cec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:23:17.026 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:17.025+0000 7fdbb5228ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:23:17.057 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:23:17.056+0000 7f755d76cec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:23:17.059 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-08-17T02:23:17.059+0000 7f0d9451d2c0 -1 Falling back to public interface 2024-08-17T02:23:17.072 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-08-17T02:23:17.072+0000 7f663b8412c0 -1 Falling back to public interface 2024-08-17T02:23:17.076 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-08-17T02:23:17.076+0000 7f908ce362c0 -1 Falling back to public interface 2024-08-17T02:23:17.081 INFO:tasks.ceph.osd.1.smithi002.stderr:2024-08-17T02:23:17.080+0000 7eff5ea0b2c0 -1 Falling back to public interface 2024-08-17T02:23:17.082 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-08-17T02:23:17.081+0000 7fbac3e502c0 -1 Falling back to public interface 2024-08-17T02:23:17.082 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-08-17T02:23:17.081+0000 7fbac1800640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6806/0: (98) Address already in use 2024-08-17T02:23:17.086 INFO:tasks.ceph.osd.2.smithi002.stderr:2024-08-17T02:23:17.085+0000 7f6a66a132c0 -1 Falling back to public interface 2024-08-17T02:23:17.106 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-08-17T02:23:17.106+0000 7fe54b8112c0 -1 Falling back to public interface 2024-08-17T02:23:17.124 INFO:tasks.ceph.osd.3.smithi002.stderr:2024-08-17T02:23:17.123+0000 7efc9860e2c0 -1 Falling back to public interface 2024-08-17T02:23:17.211 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:17.211+0000 7fdbb5228ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:23:17.250 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:23:17.246+0000 7f755d76cec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:23:17.267 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:17.267+0000 7fdbb5228ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:23:17.306 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:23:17.305+0000 7f755d76cec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:23:17.346 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:17.345+0000 7fdbb5228ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:23:17.389 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:23:17.388+0000 7f755d76cec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:23:17.398 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:17.398+0000 7fdbb5228ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:23:17.442 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:23:17.441+0000 7f755d76cec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:23:17.529 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:17.687 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.686+0000 7f605f800640 1 Processor -- start 2024-08-17T02:23:17.687 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.686+0000 7f605f800640 1 -- start start 2024-08-17T02:23:17.688 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.687+0000 7f605f800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6058159230 0x7f60580ae940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:17.688 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.687+0000 7f605f800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60580cf0b0 con 0x7f60580aee80 2024-08-17T02:23:17.688 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.687+0000 7f605f800640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60580af390 con 0x7f6058158e60 2024-08-17T02:23:17.688 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.687+0000 7f605f800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60580cea60 con 0x7f6058159230 2024-08-17T02:23:17.689 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.687+0000 7f6057e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6058159230 0x7f60580ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:17.689 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.687+0000 7f605d800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f60580aee80 0x7f60580682e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46970/0 (socket says 172.21.15.2:46970) 2024-08-17T02:23:17.689 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.688+0000 7f605d800640 1 -- 172.21.15.2:0/3222264065 learned_addr learned my addr 172.21.15.2:0/3222264065 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:17.689 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.687+0000 7f605ce00640 1 --1- 172.21.15.2:0/3222264065 >> v1:172.21.15.145:6789/0 conn(0x7f6058158e60 0x7f60580cf540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:37420/0 (socket says 172.21.15.2:37420) 2024-08-17T02:23:17.689 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.688+0000 7f6057e00640 1 -- 172.21.15.2:0/3222264065 >> v1:172.21.15.145:6789/0 conn(0x7f6058158e60 legacy=0x7f60580cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.689 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.688+0000 7f6057e00640 1 -- 172.21.15.2:0/3222264065 >> v1:172.21.15.2:6789/0 conn(0x7f60580aee80 legacy=0x7f60580682e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.689 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.688+0000 7f6057e00640 1 -- 172.21.15.2:0/3222264065 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60580ced40 con 0x7f6058159230 2024-08-17T02:23:17.690 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.689+0000 7f6057e00640 1 --2- 172.21.15.2:0/3222264065 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6058159230 0x7f60580ae940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6044009880 tx=0x7f60440090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b7e7642c912e6a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:17.690 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.689+0000 7f6057400640 1 -- 172.21.15.2:0/3222264065 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604402ad70 con 0x7f6058159230 2024-08-17T02:23:17.690 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.689+0000 7f6057400640 1 -- 172.21.15.2:0/3222264065 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6044032440 con 0x7f6058159230 2024-08-17T02:23:17.690 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.689+0000 7f6057400640 1 -- 172.21.15.2:0/3222264065 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6044032820 con 0x7f6058159230 2024-08-17T02:23:17.691 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.690+0000 7f605f800640 1 -- 172.21.15.2:0/3222264065 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6058159230 msgr2=0x7f60580ae940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.691 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.690+0000 7f605f800640 1 --2- 172.21.15.2:0/3222264065 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6058159230 0x7f60580ae940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6044009880 tx=0x7f60440090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.691 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.690+0000 7f605f800640 1 -- 172.21.15.2:0/3222264065 shutdown_connections 2024-08-17T02:23:17.691 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.690+0000 7f605f800640 1 --2- 172.21.15.2:0/3222264065 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6058159230 0x7f60580ae940 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.691 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.690+0000 7f605f800640 1 -- 172.21.15.2:0/3222264065 >> 172.21.15.2:0/3222264065 conn(0x7f605806ef60 msgr2=0x7f60580b16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:17.691 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.690+0000 7f605f800640 1 -- 172.21.15.2:0/3222264065 shutdown_connections 2024-08-17T02:23:17.692 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.690+0000 7f605f800640 1 -- 172.21.15.2:0/3222264065 wait complete. 2024-08-17T02:23:17.692 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.691+0000 7f605f800640 1 Processor -- start 2024-08-17T02:23:17.692 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.691+0000 7f605f800640 1 -- start start 2024-08-17T02:23:17.694 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.692+0000 7f605f800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60580aee80 0x7f6058169790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:17.694 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.692+0000 7f605f800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6058158e60 0x7f605816d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:17.694 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.692+0000 7f605f800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6058159230 0x7f6058153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:17.694 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.692+0000 7f605f800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60580a66b0 con 0x7f60580aee80 2024-08-17T02:23:17.694 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.692+0000 7f605f800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6058169da0 con 0x7f6058158e60 2024-08-17T02:23:17.694 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.692+0000 7f605f800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605816a080 con 0x7f6058159230 2024-08-17T02:23:17.694 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.693+0000 7f605ce00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60580aee80 0x7f6058169790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:17.695 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.693+0000 7f605ce00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60580aee80 0x7f6058169790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37348/0 (socket says 172.21.15.2:37348) 2024-08-17T02:23:17.695 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.693+0000 7f605ce00640 1 -- 172.21.15.2:0/1642796054 learned_addr learned my addr 172.21.15.2:0/1642796054 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:17.695 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.693+0000 7f6057e00640 1 --2- 172.21.15.2:0/1642796054 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6058158e60 0x7f605816d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:17.695 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.693+0000 7f605d800640 1 --2- 172.21.15.2:0/1642796054 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6058159230 0x7f6058153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:17.695 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.693+0000 7f605ce00640 1 -- 172.21.15.2:0/1642796054 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6058159230 msgr2=0x7f6058153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.695 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.693+0000 7f605ce00640 1 --2- 172.21.15.2:0/1642796054 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6058159230 0x7f6058153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.695 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.693+0000 7f605ce00640 1 -- 172.21.15.2:0/1642796054 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6058158e60 msgr2=0x7f605816d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.695 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.693+0000 7f605ce00640 1 --2- 172.21.15.2:0/1642796054 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6058158e60 0x7f605816d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.695 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.693+0000 7f605ce00640 1 -- 172.21.15.2:0/1642796054 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6044009390 con 0x7f60580aee80 2024-08-17T02:23:17.695 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.693+0000 7f605d800640 1 --2- 172.21.15.2:0/1642796054 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6058159230 0x7f6058153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:17.696 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.693+0000 7f605ce00640 1 --2- 172.21.15.2:0/1642796054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60580aee80 0x7f6058169790 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f604c00c590 tx=0x7f604c007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:17.696 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.694+0000 7f604be00640 1 -- 172.21.15.2:0/1642796054 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c007300 con 0x7f60580aee80 2024-08-17T02:23:17.697 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.694+0000 7f604be00640 1 -- 172.21.15.2:0/1642796054 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604c0074a0 con 0x7f60580aee80 2024-08-17T02:23:17.697 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.694+0000 7f604be00640 1 -- 172.21.15.2:0/1642796054 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c0047a0 con 0x7f60580aee80 2024-08-17T02:23:17.697 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.694+0000 7f605f800640 1 -- 172.21.15.2:0/1642796054 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605816a360 con 0x7f60580aee80 2024-08-17T02:23:17.697 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.694+0000 7f605f800640 1 -- 172.21.15.2:0/1642796054 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605816dcd0 con 0x7f60580aee80 2024-08-17T02:23:17.697 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.694+0000 7f604be00640 1 -- 172.21.15.2:0/1642796054 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f604c004bd0 con 0x7f60580aee80 2024-08-17T02:23:17.697 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.694+0000 7f604be00640 1 -- 172.21.15.2:0/1642796054 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f604c012440 con 0x7f60580aee80 2024-08-17T02:23:17.697 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.695+0000 7f605f800640 1 -- 172.21.15.2:0/1642796054 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6058064540 con 0x7f60580aee80 2024-08-17T02:23:17.698 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.697+0000 7f604be00640 1 -- 172.21.15.2:0/1642796054 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f604c021060 con 0x7f60580aee80 2024-08-17T02:23:17.762 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.761+0000 7f605f800640 1 -- 172.21.15.2:0/1642796054 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6058069c10 con 0x7f60580aee80 2024-08-17T02:23:17.763 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.762+0000 7f604be00640 1 -- 172.21.15.2:0/1642796054 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f604c018070 con 0x7f60580aee80 2024-08-17T02:23:17.763 INFO:teuthology.misc.health.smithi002.stdout: 2024-08-17T02:23:17.763 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":10,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:23:16.362200+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:17.764 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.763+0000 7f605f800640 1 -- 172.21.15.2:0/1642796054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60580aee80 msgr2=0x7f6058169790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.764 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.763+0000 7f605f800640 1 --2- 172.21.15.2:0/1642796054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60580aee80 0x7f6058169790 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f604c00c590 tx=0x7f604c007ee0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.764 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.763+0000 7f605f800640 1 -- 172.21.15.2:0/1642796054 shutdown_connections 2024-08-17T02:23:17.764 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.763+0000 7f605f800640 1 --2- 172.21.15.2:0/1642796054 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6058159230 0x7f6058153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.764 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.763+0000 7f605f800640 1 --2- 172.21.15.2:0/1642796054 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6058158e60 0x7f605816d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.764 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.763+0000 7f605f800640 1 --2- 172.21.15.2:0/1642796054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60580aee80 0x7f6058169790 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.765 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.763+0000 7f605f800640 1 -- 172.21.15.2:0/1642796054 >> 172.21.15.2:0/1642796054 conn(0x7f605806ef60 msgr2=0x7f60580b3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:17.765 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.763+0000 7f605f800640 1 -- 172.21.15.2:0/1642796054 shutdown_connections 2024-08-17T02:23:17.765 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:17.763+0000 7f605f800640 1 -- 172.21.15.2:0/1642796054 wait complete. 2024-08-17T02:23:17.775 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-17T02:23:17.924 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:17.923+0000 7fdbb5228ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:23:17.995 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:23:17.994+0000 7f755d76cec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:23:18.034 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:18.034+0000 7fdbb5228ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:23:18.112 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:23:18.111+0000 7f755d76cec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:23:19.056 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:19.055+0000 7fdb99a00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-17T02:23:19.056 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-08-17T02:23:19.055+0000 7fdb99a00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-17T02:23:20.649 INFO:tasks.ceph.osd.1.smithi002.stderr:2024-08-17T02:23:20.647+0000 7eff5ea0b2c0 -1 osd.1 0 log_to_monitors true 2024-08-17T02:23:20.650 INFO:tasks.ceph.osd.2.smithi002.stderr:2024-08-17T02:23:20.649+0000 7f6a66a132c0 -1 osd.2 0 log_to_monitors true 2024-08-17T02:23:20.702 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-08-17T02:23:20.701+0000 7f908ce362c0 -1 osd.7 0 log_to_monitors true 2024-08-17T02:23:20.702 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-08-17T02:23:20.702+0000 7f0d9451d2c0 -1 osd.4 0 log_to_monitors true 2024-08-17T02:23:20.718 INFO:tasks.ceph.osd.3.smithi002.stderr:2024-08-17T02:23:20.716+0000 7efc9860e2c0 -1 osd.3 0 log_to_monitors true 2024-08-17T02:23:20.890 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-08-17T02:23:20.888+0000 7fbac3e502c0 -1 osd.0 0 log_to_monitors true 2024-08-17T02:23:20.907 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-08-17T02:23:20.906+0000 7f663b8412c0 -1 osd.6 0 log_to_monitors true 2024-08-17T02:23:20.980 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-08-17T02:23:20.979+0000 7fe54b8112c0 -1 osd.5 0 log_to_monitors true 2024-08-17T02:23:23.791 INFO:tasks.ceph.osd.2.smithi002.stderr:2024-08-17T02:23:23.790+0000 7f6a5fe00640 -1 osd.2 0 waiting for initial osdmap 2024-08-17T02:23:23.801 INFO:tasks.ceph.osd.2.smithi002.stderr:2024-08-17T02:23:23.800+0000 7f6a57200640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:23:23.801 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-08-17T02:23:23.800+0000 7fbabd200640 -1 osd.0 0 waiting for initial osdmap 2024-08-17T02:23:23.805 INFO:tasks.ceph.osd.3.smithi002.stderr:2024-08-17T02:23:23.804+0000 7efc91a00640 -1 osd.3 0 waiting for initial osdmap 2024-08-17T02:23:23.809 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-08-17T02:23:23.809+0000 7fbab4600640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:23:23.816 INFO:tasks.ceph.osd.3.smithi002.stderr:2024-08-17T02:23:23.815+0000 7efc88e00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:23:23.832 INFO:tasks.ceph.osd.1.smithi002.stderr:2024-08-17T02:23:23.832+0000 7eff59c00640 -1 osd.1 0 waiting for initial osdmap 2024-08-17T02:23:23.838 INFO:tasks.ceph.osd.1.smithi002.stderr:2024-08-17T02:23:23.837+0000 7eff4f200640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:23:24.273 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-08-17T02:23:24.273+0000 7f9086200640 -1 osd.7 0 waiting for initial osdmap 2024-08-17T02:23:24.281 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-08-17T02:23:24.280+0000 7f907d600640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:23:24.343 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-08-17T02:23:24.343+0000 7fe544c00640 -1 osd.5 0 waiting for initial osdmap 2024-08-17T02:23:24.349 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-08-17T02:23:24.348+0000 7fe53c000640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:23:24.362 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-08-17T02:23:24.361+0000 7f6634c00640 -1 osd.6 0 waiting for initial osdmap 2024-08-17T02:23:24.368 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-08-17T02:23:24.368+0000 7f662c000640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:23:24.372 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-08-17T02:23:24.372+0000 7f0d8dc00640 -1 osd.4 0 waiting for initial osdmap 2024-08-17T02:23:24.377 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-08-17T02:23:24.377+0000 7f0d85000640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:23:24.582 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:24.726 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.726+0000 7feb1be00640 1 Processor -- start 2024-08-17T02:23:24.726 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.726+0000 7feb1be00640 1 -- start start 2024-08-17T02:23:24.728 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.727+0000 7feb1be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feb1c0ccb80 0x7feb1c156d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:24.728 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.727+0000 7feb1be00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb1c1585c0 0x7feb1c158a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:24.728 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.727+0000 7feb1be00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb1c15b310 con 0x7feb1c0cc7b0 2024-08-17T02:23:24.729 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.727+0000 7feb1be00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb1c15a700 con 0x7feb1c0ccb80 2024-08-17T02:23:24.729 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.727+0000 7feb1be00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c15a9e0 con 0x7feb1c1585c0 2024-08-17T02:23:24.729 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.727+0000 7feb1a000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feb1c0ccb80 0x7feb1c156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:24.729 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.727+0000 7feb1aa00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7feb1c0cc7b0 0x7feb1c159b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46972/0 (socket says 172.21.15.2:46972) 2024-08-17T02:23:24.729 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.727+0000 7feb1aa00640 1 -- 172.21.15.2:0/2117527510 learned_addr learned my addr 172.21.15.2:0/2117527510 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:24.729 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.727+0000 7feb1b400640 1 --2- 172.21.15.2:0/2117527510 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb1c1585c0 0x7feb1c158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:24.729 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.727+0000 7feb19600640 1 -- 172.21.15.2:0/2117527510 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3087525008 0 0) 0x7feb1c15b310 con 0x7feb1c0cc7b0 2024-08-17T02:23:24.730 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.727+0000 7feb1a000640 1 -- 172.21.15.2:0/2117527510 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb1c1585c0 msgr2=0x7feb1c158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:24.730 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.727+0000 7feb1a000640 1 --2- 172.21.15.2:0/2117527510 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb1c1585c0 0x7feb1c158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:24.730 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.727+0000 7feb1a000640 1 -- 172.21.15.2:0/2117527510 >> v1:172.21.15.2:6789/0 conn(0x7feb1c0cc7b0 legacy=0x7feb1c159b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:24.730 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.727+0000 7feb1a000640 1 -- 172.21.15.2:0/2117527510 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1c15acc0 con 0x7feb1c0ccb80 2024-08-17T02:23:24.730 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.727+0000 7feb1b400640 1 --2- 172.21.15.2:0/2117527510 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb1c1585c0 0x7feb1c158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:24.735 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.729+0000 7feb1a000640 1 --2- 172.21.15.2:0/2117527510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb1c0ccb80 0x7feb1c156d90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feb08009850 tx=0x7feb080090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded941f2978fde52 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:24.735 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.729+0000 7feb19600640 1 -- 172.21.15.2:0/2117527510 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0802ad90 con 0x7feb1c0ccb80 2024-08-17T02:23:24.735 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.729+0000 7feb19600640 1 -- 172.21.15.2:0/2117527510 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb08032440 con 0x7feb1c0ccb80 2024-08-17T02:23:24.735 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.729+0000 7feb19600640 1 -- 172.21.15.2:0/2117527510 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb080327e0 con 0x7feb1c0ccb80 2024-08-17T02:23:24.736 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.730+0000 7feb1be00640 1 -- 172.21.15.2:0/2117527510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb1c0ccb80 msgr2=0x7feb1c156d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:24.736 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.730+0000 7feb1be00640 1 --2- 172.21.15.2:0/2117527510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb1c0ccb80 0x7feb1c156d90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feb08009850 tx=0x7feb080090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:24.736 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.730+0000 7feb1be00640 1 -- 172.21.15.2:0/2117527510 shutdown_connections 2024-08-17T02:23:24.736 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.730+0000 7feb1be00640 1 --2- 172.21.15.2:0/2117527510 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb1c1585c0 0x7feb1c158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:24.736 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.730+0000 7feb1be00640 1 --2- 172.21.15.2:0/2117527510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb1c0ccb80 0x7feb1c156d90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:24.736 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.730+0000 7feb1be00640 1 -- 172.21.15.2:0/2117527510 >> 172.21.15.2:0/2117527510 conn(0x7feb1c06e4e0 msgr2=0x7feb1c06e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:24.736 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.730+0000 7feb1be00640 1 -- 172.21.15.2:0/2117527510 shutdown_connections 2024-08-17T02:23:24.736 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.730+0000 7feb1be00640 1 -- 172.21.15.2:0/2117527510 wait complete. 2024-08-17T02:23:24.737 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.731+0000 7feb1be00640 1 Processor -- start 2024-08-17T02:23:24.737 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.731+0000 7feb1be00640 1 -- start start 2024-08-17T02:23:24.737 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.731+0000 7feb1be00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb1c0cc7b0 0x7feb1c15ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:24.737 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.731+0000 7feb1be00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb1c0ccb80 0x7feb1c0c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:24.737 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.731+0000 7feb1be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb1c1585c0 0x7feb1c0c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:24.737 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.731+0000 7feb1be00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c0c9b20 con 0x7feb1c1585c0 2024-08-17T02:23:24.738 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.731+0000 7feb1be00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c14b9d0 con 0x7feb1c0ccb80 2024-08-17T02:23:24.738 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.731+0000 7feb1be00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c14adc0 con 0x7feb1c0cc7b0 2024-08-17T02:23:24.738 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.733+0000 7feb1b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb1c1585c0 0x7feb1c0c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:24.738 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.733+0000 7feb1b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb1c1585c0 0x7feb1c0c95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37392/0 (socket says 172.21.15.2:37392) 2024-08-17T02:23:24.738 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.733+0000 7feb1b400640 1 -- 172.21.15.2:0/2016886157 learned_addr learned my addr 172.21.15.2:0/2016886157 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:24.739 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.733+0000 7feb1aa00640 1 --2- 172.21.15.2:0/2016886157 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb1c0cc7b0 0x7feb1c15ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:24.739 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.733+0000 7feb1a000640 1 --2- 172.21.15.2:0/2016886157 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb1c0ccb80 0x7feb1c0c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:24.739 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.733+0000 7feb1b400640 1 -- 172.21.15.2:0/2016886157 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb1c0cc7b0 msgr2=0x7feb1c15ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:24.739 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.733+0000 7feb1b400640 1 --2- 172.21.15.2:0/2016886157 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb1c0cc7b0 0x7feb1c15ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:24.739 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.733+0000 7feb1b400640 1 -- 172.21.15.2:0/2016886157 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb1c0ccb80 msgr2=0x7feb1c0c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:24.739 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.733+0000 7feb1b400640 1 --2- 172.21.15.2:0/2016886157 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb1c0ccb80 0x7feb1c0c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:24.740 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.733+0000 7feb1b400640 1 -- 172.21.15.2:0/2016886157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb14009a20 con 0x7feb1c1585c0 2024-08-17T02:23:24.740 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.733+0000 7feb1b400640 1 --2- 172.21.15.2:0/2016886157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb1c1585c0 0x7feb1c0c95e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7feb14009f20 tx=0x7feb1400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:24.740 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.734+0000 7feb12000640 1 -- 172.21.15.2:0/2016886157 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1400ce10 con 0x7feb1c1585c0 2024-08-17T02:23:24.740 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.734+0000 7feb12000640 1 -- 172.21.15.2:0/2016886157 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1400f040 con 0x7feb1c1585c0 2024-08-17T02:23:24.740 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.734+0000 7feb1be00640 1 -- 172.21.15.2:0/2016886157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb08009390 con 0x7feb1c1585c0 2024-08-17T02:23:24.740 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.734+0000 7feb12000640 1 -- 172.21.15.2:0/2016886157 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb140146d0 con 0x7feb1c1585c0 2024-08-17T02:23:24.740 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.734+0000 7feb1be00640 1 -- 172.21.15.2:0/2016886157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb1c14b380 con 0x7feb1c1585c0 2024-08-17T02:23:24.741 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.735+0000 7feb1be00640 1 -- 172.21.15.2:0/2016886157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb1c14bb60 con 0x7feb1c1585c0 2024-08-17T02:23:24.742 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.736+0000 7feb12000640 1 -- 172.21.15.2:0/2016886157 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7feb14003020 con 0x7feb1c1585c0 2024-08-17T02:23:24.742 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.736+0000 7feb12000640 1 --2- 172.21.15.2:0/2016886157 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7feafc0650c0 0x7feafc067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:24.743 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.736+0000 7feb12000640 1 -- 172.21.15.2:0/2016886157 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7feb14081fd0 con 0x7feb1c1585c0 2024-08-17T02:23:24.743 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.737+0000 7feb1aa00640 1 --2- 172.21.15.2:0/2016886157 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7feafc0650c0 0x7feafc067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:24.743 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.737+0000 7feb1aa00640 1 --2- 172.21.15.2:0/2016886157 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7feafc0650c0 0x7feafc067570 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7feb0c0011e0 tx=0x7feb0c007ca0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:24.744 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.741+0000 7feb12000640 1 -- 172.21.15.2:0/2016886157 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7feb14050f10 con 0x7feb1c1585c0 2024-08-17T02:23:24.934 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.933+0000 7feb1be00640 1 -- 172.21.15.2:0/2016886157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb1c14b720 con 0x7feb1c1585c0 2024-08-17T02:23:24.934 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.934+0000 7feb12000640 1 -- 172.21.15.2:0/2016886157 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10348 (secure 0 0 0) 0x7feb14018090 con 0x7feb1c1585c0 2024-08-17T02:23:24.934 INFO:teuthology.misc.health.smithi002.stdout: 2024-08-17T02:23:24.935 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":13,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:23:24.806576+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:24.937 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.937+0000 7feb1be00640 1 -- 172.21.15.2:0/2016886157 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7feafc0650c0 msgr2=0x7feafc067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:24.937 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.937+0000 7feb1be00640 1 --2- 172.21.15.2:0/2016886157 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7feafc0650c0 0x7feafc067570 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7feb0c0011e0 tx=0x7feb0c007ca0 comp rx=0 tx=0).stop 2024-08-17T02:23:24.937 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.937+0000 7feb1be00640 1 -- 172.21.15.2:0/2016886157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb1c1585c0 msgr2=0x7feb1c0c95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:24.937 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.937+0000 7feb1be00640 1 --2- 172.21.15.2:0/2016886157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb1c1585c0 0x7feb1c0c95e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7feb14009f20 tx=0x7feb1400b040 comp rx=0 tx=0).stop 2024-08-17T02:23:24.937 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.937+0000 7feb1be00640 1 -- 172.21.15.2:0/2016886157 shutdown_connections 2024-08-17T02:23:24.937 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.937+0000 7feb1be00640 1 --2- 172.21.15.2:0/2016886157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb1c1585c0 0x7feb1c0c95e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:24.937 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.937+0000 7feb1be00640 1 --2- 172.21.15.2:0/2016886157 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb1c0ccb80 0x7feb1c0c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:24.937 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.937+0000 7feb1be00640 1 --2- 172.21.15.2:0/2016886157 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7feafc0650c0 0x7feafc067570 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:24.938 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.937+0000 7feb1be00640 1 --2- 172.21.15.2:0/2016886157 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb1c0cc7b0 0x7feb1c15ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:24.938 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.937+0000 7feb1be00640 1 -- 172.21.15.2:0/2016886157 >> 172.21.15.2:0/2016886157 conn(0x7feb1c06e4e0 msgr2=0x7feb1c0cabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:24.938 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.937+0000 7feb1be00640 1 -- 172.21.15.2:0/2016886157 shutdown_connections 2024-08-17T02:23:24.938 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:23:24.937+0000 7feb1be00640 1 -- 172.21.15.2:0/2016886157 wait complete. 2024-08-17T02:23:24.949 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-17T02:23:24.949 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-17T02:23:24.949 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:23:24.950 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:23:24.953 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:23:24.954 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:23:24.954 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:23:24.957 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:23:24.958 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:23:24.958 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:23:24.962 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:23:24.962 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:23:24.963 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:23:24.966 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:23:24.966 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-17T02:23:24.967 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:25.080 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2024-08-17T02:23:25.081 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2024-08-17T02:23:25.088 INFO:tasks.ceph.mds.b.smithi145.stdout:starting mds.b at 2024-08-17T02:23:25.089 INFO:tasks.ceph.mds.d.smithi145.stdout:starting mds.d at 2024-08-17T02:23:25.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.128+0000 7fd22fe00640 1 Processor -- start 2024-08-17T02:23:25.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.128+0000 7fd22fe00640 1 -- start start 2024-08-17T02:23:25.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.129+0000 7fd22fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd2280add30 0x7fd228156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:25.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.129+0000 7fd22fe00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2280cb160 con 0x7fd2280ca050 2024-08-17T02:23:25.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.129+0000 7fd22fe00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2280b0d10 con 0x7fd2280ad960 2024-08-17T02:23:25.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.129+0000 7fd22fe00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2280ca550 con 0x7fd2280add30 2024-08-17T02:23:25.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.130+0000 7fd22ca00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd2280ca050 0x7fd2280aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44692/0 (socket says 172.21.15.2:44692) 2024-08-17T02:23:25.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.130+0000 7fd22ca00640 1 -- 172.21.15.2:0/2812807291 learned_addr learned my addr 172.21.15.2:0/2812807291 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:25.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.130+0000 7fd22de00640 1 --2- 172.21.15.2:0/2812807291 >> v2:172.21.15.2:3300/0 conn(0x7fd2280add30 0x7fd228156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:25.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.130+0000 7fd227e00640 1 -- 172.21.15.2:0/2812807291 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566317412 0 0) 0x7fd2280b0d10 con 0x7fd2280ad960 2024-08-17T02:23:25.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.130+0000 7fd227e00640 1 -- 172.21.15.2:0/2812807291 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2100034e0 con 0x7fd2280ad960 2024-08-17T02:23:25.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.130+0000 7fd22de00640 1 -- 172.21.15.2:0/2812807291 >> v1:172.21.15.145:6789/0 conn(0x7fd2280ad960 legacy=0x7fd228156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:25.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.130+0000 7fd22de00640 1 -- 172.21.15.2:0/2812807291 >> v1:172.21.15.2:6789/0 conn(0x7fd2280ca050 legacy=0x7fd2280aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:25.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.130+0000 7fd227e00640 1 -- 172.21.15.2:0/2812807291 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 716642667 0 0) 0x7fd2280cb160 con 0x7fd2280ca050 2024-08-17T02:23:25.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.130+0000 7fd22de00640 1 -- 172.21.15.2:0/2812807291 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2280ca830 con 0x7fd2280add30 2024-08-17T02:23:25.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.131+0000 7fd22de00640 1 --2- 172.21.15.2:0/2812807291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2280add30 0x7fd228156b30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd220009e60 tx=0x7fd220009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c9a3dc1d265a4c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:25.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.131+0000 7fd227e00640 1 -- 172.21.15.2:0/2812807291 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220030550 con 0x7fd2280add30 2024-08-17T02:23:25.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.131+0000 7fd227e00640 1 -- 172.21.15.2:0/2812807291 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2200306b0 con 0x7fd2280add30 2024-08-17T02:23:25.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.132+0000 7fd227e00640 1 -- 172.21.15.2:0/2812807291 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220030a50 con 0x7fd2280add30 2024-08-17T02:23:25.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.132+0000 7fd22fe00640 1 -- 172.21.15.2:0/2812807291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2280add30 msgr2=0x7fd228156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:25.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.132+0000 7fd22fe00640 1 --2- 172.21.15.2:0/2812807291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2280add30 0x7fd228156b30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd220009e60 tx=0x7fd220009780 comp rx=0 tx=0).stop 2024-08-17T02:23:25.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.132+0000 7fd22fe00640 1 -- 172.21.15.2:0/2812807291 shutdown_connections 2024-08-17T02:23:25.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.132+0000 7fd22fe00640 1 --2- 172.21.15.2:0/2812807291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2280add30 0x7fd228156b30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:25.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.132+0000 7fd22fe00640 1 -- 172.21.15.2:0/2812807291 >> 172.21.15.2:0/2812807291 conn(0x7fd228066e60 msgr2=0x7fd228067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:25.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.132+0000 7fd22fe00640 1 -- 172.21.15.2:0/2812807291 shutdown_connections 2024-08-17T02:23:25.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.132+0000 7fd22fe00640 1 -- 172.21.15.2:0/2812807291 wait complete. 2024-08-17T02:23:25.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.134+0000 7fd22fe00640 1 Processor -- start 2024-08-17T02:23:25.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.134+0000 7fd22fe00640 1 -- start start 2024-08-17T02:23:25.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.135+0000 7fd22fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2280ad960 0x7fd2281585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:25.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.135+0000 7fd22fe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2280add30 0x7fd228151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:25.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.135+0000 7fd22fe00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2280ca050 0x7fd228141eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:25.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.135+0000 7fd22fe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2280aa370 con 0x7fd2280ad960 2024-08-17T02:23:25.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.135+0000 7fd22fe00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2280aa610 con 0x7fd2280add30 2024-08-17T02:23:25.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.135+0000 7fd22fe00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2280aa8f0 con 0x7fd2280ca050 2024-08-17T02:23:25.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.135+0000 7fd22d400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2280ad960 0x7fd2281585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:25.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.135+0000 7fd22d400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2280ad960 0x7fd2281585c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34628/0 (socket says 172.21.15.2:34628) 2024-08-17T02:23:25.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.135+0000 7fd22d400640 1 -- 172.21.15.2:0/2264551045 learned_addr learned my addr 172.21.15.2:0/2264551045 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:25.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.135+0000 7fd22ca00640 1 --2- 172.21.15.2:0/2264551045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2280add30 0x7fd228151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:25.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.135+0000 7fd22de00640 1 --2- 172.21.15.2:0/2264551045 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2280ca050 0x7fd228141eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:25.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.135+0000 7fd22d400640 1 -- 172.21.15.2:0/2264551045 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2280ca050 msgr2=0x7fd228141eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:25.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.135+0000 7fd22d400640 1 --2- 172.21.15.2:0/2264551045 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2280ca050 0x7fd228141eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:25.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.135+0000 7fd22d400640 1 -- 172.21.15.2:0/2264551045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2280add30 msgr2=0x7fd228151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:25.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.135+0000 7fd22d400640 1 --2- 172.21.15.2:0/2264551045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2280add30 0x7fd228151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:25.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.135+0000 7fd22d400640 1 -- 172.21.15.2:0/2264551045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd220009a20 con 0x7fd2280ad960 2024-08-17T02:23:25.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.136+0000 7fd22d400640 1 --2- 172.21.15.2:0/2264551045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2280ad960 0x7fd2281585c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00c590 tx=0x7fd21c007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:25.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.136+0000 7fd224c00640 1 -- 172.21.15.2:0/2264551045 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c012630 con 0x7fd2280ad960 2024-08-17T02:23:25.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.136+0000 7fd224c00640 1 -- 172.21.15.2:0/2264551045 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21c0127b0 con 0x7fd2280ad960 2024-08-17T02:23:25.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.136+0000 7fd224c00640 1 -- 172.21.15.2:0/2264551045 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c012bb0 con 0x7fd2280ad960 2024-08-17T02:23:25.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.136+0000 7fd22fe00640 1 -- 172.21.15.2:0/2264551045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2280aabd0 con 0x7fd2280ad960 2024-08-17T02:23:25.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.136+0000 7fd22fe00640 1 -- 172.21.15.2:0/2264551045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2280aa060 con 0x7fd2280ad960 2024-08-17T02:23:25.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.137+0000 7fd22fe00640 1 -- 172.21.15.2:0/2264551045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2280ab0d0 con 0x7fd2280ad960 2024-08-17T02:23:25.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.138+0000 7fd224c00640 1 -- 172.21.15.2:0/2264551045 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7fd21c01a3b0 con 0x7fd2280ad960 2024-08-17T02:23:25.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.139+0000 7fd224c00640 1 --2- 172.21.15.2:0/2264551045 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd2080650c0 0x7fd208067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:25.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.139+0000 7fd224c00640 1 -- 172.21.15.2:0/2264551045 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7fd21c081cd0 con 0x7fd2280ad960 2024-08-17T02:23:25.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.139+0000 7fd22ca00640 1 --2- 172.21.15.2:0/2264551045 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd2080650c0 0x7fd208067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:25.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.140+0000 7fd22ca00640 1 --2- 172.21.15.2:0/2264551045 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd2080650c0 0x7fd208067570 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd2280b0c90 tx=0x7fd214007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:25.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.143+0000 7fd224c00640 1 -- 172.21.15.2:0/2264551045 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd21c050350 con 0x7fd2280ad960 2024-08-17T02:23:25.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.328+0000 7fd22fe00640 1 -- 172.21.15.2:0/2264551045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd228063fb0 con 0x7fd2280ad960 2024-08-17T02:23:25.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.329+0000 7fd224c00640 1 -- 172.21.15.2:0/2264551045 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10348 (secure 0 0 0) 0x7fd21c053970 con 0x7fd2280ad960 2024-08-17T02:23:25.329 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:25.329 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":13,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:23:24.806576+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.331+0000 7fd22fe00640 1 -- 172.21.15.2:0/2264551045 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd2080650c0 msgr2=0x7fd208067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.331+0000 7fd22fe00640 1 --2- 172.21.15.2:0/2264551045 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd2080650c0 0x7fd208067570 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd2280b0c90 tx=0x7fd214007ec0 comp rx=0 tx=0).stop 2024-08-17T02:23:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.331+0000 7fd22fe00640 1 -- 172.21.15.2:0/2264551045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2280ad960 msgr2=0x7fd2281585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.331+0000 7fd22fe00640 1 --2- 172.21.15.2:0/2264551045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2280ad960 0x7fd2281585c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00c590 tx=0x7fd21c007d80 comp rx=0 tx=0).stop 2024-08-17T02:23:25.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.331+0000 7fd22fe00640 1 -- 172.21.15.2:0/2264551045 shutdown_connections 2024-08-17T02:23:25.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.331+0000 7fd22fe00640 1 --2- 172.21.15.2:0/2264551045 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd2080650c0 0x7fd208067570 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:25.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.331+0000 7fd22fe00640 1 --2- 172.21.15.2:0/2264551045 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2280ca050 0x7fd228141eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:25.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.331+0000 7fd22fe00640 1 --2- 172.21.15.2:0/2264551045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2280add30 0x7fd228151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:25.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.331+0000 7fd22fe00640 1 --2- 172.21.15.2:0/2264551045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2280ad960 0x7fd2281585c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:25.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.331+0000 7fd22fe00640 1 -- 172.21.15.2:0/2264551045 >> 172.21.15.2:0/2264551045 conn(0x7fd228066e60 msgr2=0x7fd228069fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:25.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.331+0000 7fd22fe00640 1 -- 172.21.15.2:0/2264551045 shutdown_connections 2024-08-17T02:23:25.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.331+0000 7fd22fe00640 1 -- 172.21.15.2:0/2264551045 wait complete. 2024-08-17T02:23:25.346 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-08-17T02:23:25.346 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:23:25.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.499+0000 7f6f16a00640 1 Processor -- start 2024-08-17T02:23:25.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.499+0000 7f6f16a00640 1 -- start start 2024-08-17T02:23:25.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.500+0000 7f6f16a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f100ca050 0x7f6f10156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:25.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.500+0000 7f6f16a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f100cb160 con 0x7f6f100ad960 2024-08-17T02:23:25.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.500+0000 7f6f16a00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f100b0d10 con 0x7f6f100add30 2024-08-17T02:23:25.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.500+0000 7f6f16a00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f100ca550 con 0x7f6f100ca050 2024-08-17T02:23:25.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.500+0000 7f6f0fe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6f100ad960 0x7f6f10156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44704/0 (socket says 172.21.15.2:44704) 2024-08-17T02:23:25.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.500+0000 7f6f0fe00640 1 -- 172.21.15.2:0/4214801949 learned_addr learned my addr 172.21.15.2:0/4214801949 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:25.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.500+0000 7f6f07400640 1 --2- 172.21.15.2:0/4214801949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f100ca050 0x7f6f10156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:25.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.501+0000 7f6f0f400640 1 -- 172.21.15.2:0/4214801949 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3827904391 0 0) 0x7f6f100cb160 con 0x7f6f100ad960 2024-08-17T02:23:25.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.501+0000 7f6f0f400640 1 -- 172.21.15.2:0/4214801949 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ef40034e0 con 0x7f6f100ad960 2024-08-17T02:23:25.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.501+0000 7f6f07400640 1 -- 172.21.15.2:0/4214801949 >> v1:172.21.15.145:6789/0 conn(0x7f6f100add30 legacy=0x7f6f100aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:25.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.501+0000 7f6f07400640 1 -- 172.21.15.2:0/4214801949 >> v1:172.21.15.2:6789/0 conn(0x7f6f100ad960 legacy=0x7f6f10156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:25.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.501+0000 7f6f07400640 1 -- 172.21.15.2:0/4214801949 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f100ca830 con 0x7f6f100ca050 2024-08-17T02:23:25.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.502+0000 7f6f07400640 1 --2- 172.21.15.2:0/4214801949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f100ca050 0x7f6f10156b30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009880 tx=0x7f6ef80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d80980f34fdfe06 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:25.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.502+0000 7f6f0f400640 1 -- 172.21.15.2:0/4214801949 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef802aea0 con 0x7f6f100ca050 2024-08-17T02:23:25.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.502+0000 7f6f0f400640 1 -- 172.21.15.2:0/4214801949 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef8032440 con 0x7f6f100ca050 2024-08-17T02:23:25.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.502+0000 7f6f0f400640 1 -- 172.21.15.2:0/4214801949 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80327e0 con 0x7f6f100ca050 2024-08-17T02:23:25.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.503+0000 7f6f16a00640 1 -- 172.21.15.2:0/4214801949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f100ca050 msgr2=0x7f6f10156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:25.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.503+0000 7f6f16a00640 1 --2- 172.21.15.2:0/4214801949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f100ca050 0x7f6f10156b30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009880 tx=0x7f6ef80090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:25.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.503+0000 7f6f16a00640 1 -- 172.21.15.2:0/4214801949 shutdown_connections 2024-08-17T02:23:25.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.503+0000 7f6f16a00640 1 --2- 172.21.15.2:0/4214801949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f100ca050 0x7f6f10156b30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:25.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.503+0000 7f6f16a00640 1 -- 172.21.15.2:0/4214801949 >> 172.21.15.2:0/4214801949 conn(0x7f6f10066e60 msgr2=0x7f6f10067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:25.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.503+0000 7f6f16a00640 1 -- 172.21.15.2:0/4214801949 shutdown_connections 2024-08-17T02:23:25.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.503+0000 7f6f16a00640 1 -- 172.21.15.2:0/4214801949 wait complete. 2024-08-17T02:23:25.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.504+0000 7f6f16a00640 1 Processor -- start 2024-08-17T02:23:25.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.504+0000 7f6f16a00640 1 -- start start 2024-08-17T02:23:25.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.505+0000 7f6f16a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f100ad960 0x7f6f101421e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:25.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.505+0000 7f6f16a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f100add30 0x7f6f101527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:25.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.505+0000 7f6f16a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f100ca050 0x7f6f10152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:25.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.505+0000 7f6f16a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f10166cb0 con 0x7f6f100add30 2024-08-17T02:23:25.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.505+0000 7f6f16a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1016ae50 con 0x7f6f100ca050 2024-08-17T02:23:25.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.505+0000 7f6f16a00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1016a240 con 0x7f6f100ad960 2024-08-17T02:23:25.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.505+0000 7f6f07400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f100add30 0x7f6f101527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:25.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.506+0000 7f6f0fe00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f100ad960 0x7f6f101421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:25.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.506+0000 7f6f07400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f100add30 0x7f6f101527f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34632/0 (socket says 172.21.15.2:34632) 2024-08-17T02:23:25.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.506+0000 7f6f07400640 1 -- 172.21.15.2:0/1278042990 learned_addr learned my addr 172.21.15.2:0/1278042990 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:25.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.506+0000 7f6f14a00640 1 --2- 172.21.15.2:0/1278042990 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f100ca050 0x7f6f10152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:25.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.506+0000 7f6f0fe00640 1 -- 172.21.15.2:0/1278042990 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f100ca050 msgr2=0x7f6f10152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:25.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.506+0000 7f6f0fe00640 1 --2- 172.21.15.2:0/1278042990 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f100ca050 0x7f6f10152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:25.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.506+0000 7f6f0fe00640 1 -- 172.21.15.2:0/1278042990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f100add30 msgr2=0x7f6f101527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:25.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.506+0000 7f6f0fe00640 1 --2- 172.21.15.2:0/1278042990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f100add30 0x7f6f101527f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:25.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.506+0000 7f6f0fe00640 1 -- 172.21.15.2:0/1278042990 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef8009390 con 0x7f6f100ad960 2024-08-17T02:23:25.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.506+0000 7f6f07400640 1 --2- 172.21.15.2:0/1278042990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f100add30 0x7f6f101527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:25.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.506+0000 7f6f0fe00640 1 --2- 172.21.15.2:0/1278042990 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f100ad960 0x7f6f101421e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6f00001ed0 tx=0x7f6f00007cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:25.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.507+0000 7f6f07e00640 1 -- 172.21.15.2:0/1278042990 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f00005aa0 con 0x7f6f100ad960 2024-08-17T02:23:25.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.507+0000 7f6f07e00640 1 -- 172.21.15.2:0/1278042990 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f00005c20 con 0x7f6f100ad960 2024-08-17T02:23:25.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.507+0000 7f6f07e00640 1 -- 172.21.15.2:0/1278042990 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f00007320 con 0x7f6f100ad960 2024-08-17T02:23:25.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.507+0000 7f6f16a00640 1 -- 172.21.15.2:0/1278042990 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f1016a520 con 0x7f6f100ad960 2024-08-17T02:23:25.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.507+0000 7f6f16a00640 1 -- 172.21.15.2:0/1278042990 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f1016aae0 con 0x7f6f100ad960 2024-08-17T02:23:25.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.508+0000 7f6f16a00640 1 -- 172.21.15.2:0/1278042990 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f10063fb0 con 0x7f6f100ad960 2024-08-17T02:23:25.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.509+0000 7f6f07e00640 1 -- 172.21.15.2:0/1278042990 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f6f0001b3b0 con 0x7f6f100ad960 2024-08-17T02:23:25.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.509+0000 7f6f07e00640 1 --2- 172.21.15.2:0/1278042990 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6eec0650c0 0x7f6eec067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:25.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.509+0000 7f6f07e00640 1 -- 172.21.15.2:0/1278042990 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f6f000813b0 con 0x7f6f100ad960 2024-08-17T02:23:25.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.510+0000 7f6f07400640 1 --2- 172.21.15.2:0/1278042990 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6eec0650c0 0x7f6eec067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:25.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.510+0000 7f6f07400640 1 --2- 172.21.15.2:0/1278042990 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6eec0650c0 0x7f6eec067570 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009360 tx=0x7f6ef8032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:25.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.514+0000 7f6f07e00640 1 -- 172.21.15.2:0/1278042990 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6f0004fa30 con 0x7f6f100ad960 2024-08-17T02:23:25.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.735+0000 7f6f16a00640 1 -- 172.21.15.2:0/1278042990 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f101522d0 con 0x7f6f100ad960 2024-08-17T02:23:25.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.736+0000 7f6f07e00640 1 -- 172.21.15.2:0/1278042990 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1253 (secure 0 0 0) 0x7f6f00017020 con 0x7f6f100ad960 2024-08-17T02:23:25.736 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:25.736 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3374741059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3374741059},{"type":"v1","addr":"172.21.15.2:6833","nonce":3374741059}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-08-17T02:23:25.736 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 2 2024-08-17T02:23:25.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.738+0000 7f6f16a00640 1 -- 172.21.15.2:0/1278042990 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6eec0650c0 msgr2=0x7f6eec067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:25.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.738+0000 7f6f16a00640 1 --2- 172.21.15.2:0/1278042990 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6eec0650c0 0x7f6eec067570 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009360 tx=0x7f6ef8032000 comp rx=0 tx=0).stop 2024-08-17T02:23:25.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.738+0000 7f6f16a00640 1 -- 172.21.15.2:0/1278042990 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f100ad960 msgr2=0x7f6f101421e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:25.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.738+0000 7f6f16a00640 1 --2- 172.21.15.2:0/1278042990 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f100ad960 0x7f6f101421e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6f00001ed0 tx=0x7f6f00007cc0 comp rx=0 tx=0).stop 2024-08-17T02:23:25.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.738+0000 7f6f16a00640 1 -- 172.21.15.2:0/1278042990 shutdown_connections 2024-08-17T02:23:25.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.738+0000 7f6f16a00640 1 --2- 172.21.15.2:0/1278042990 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f100ca050 0x7f6f10152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:25.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.738+0000 7f6f16a00640 1 --2- 172.21.15.2:0/1278042990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f100add30 0x7f6f101527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:25.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.738+0000 7f6f16a00640 1 --2- 172.21.15.2:0/1278042990 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6eec0650c0 0x7f6eec067570 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:25.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.738+0000 7f6f16a00640 1 --2- 172.21.15.2:0/1278042990 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f100ad960 0x7f6f101421e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:25.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.738+0000 7f6f16a00640 1 -- 172.21.15.2:0/1278042990 >> 172.21.15.2:0/1278042990 conn(0x7f6f10066e60 msgr2=0x7f6f1015a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:25.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.738+0000 7f6f16a00640 1 -- 172.21.15.2:0/1278042990 shutdown_connections 2024-08-17T02:23:25.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:25.738+0000 7f6f16a00640 1 -- 172.21.15.2:0/1278042990 wait complete. 2024-08-17T02:23:27.753 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:23:27.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.915+0000 7f4b54400640 1 Processor -- start 2024-08-17T02:23:27.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.915+0000 7f4b54400640 1 -- start start 2024-08-17T02:23:27.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.917+0000 7f4b54400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f4b4c0ca050 0x7f4b4c156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:27.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.917+0000 7f4b54400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4c0cb160 con 0x7f4b4c0ad960 2024-08-17T02:23:27.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.917+0000 7f4b54400640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4c0b0d10 con 0x7f4b4c0add30 2024-08-17T02:23:27.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.917+0000 7f4b54400640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b4c0ca550 con 0x7f4b4c0ca050 2024-08-17T02:23:27.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.917+0000 7f4b51a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4b4c0ad960 0x7f4b4c156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44718/0 (socket says 172.21.15.2:44718) 2024-08-17T02:23:27.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.917+0000 7f4b51a00640 1 -- 172.21.15.2:0/2053458433 learned_addr learned my addr 172.21.15.2:0/2053458433 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:27.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.917+0000 7f4b4be00640 1 -- 172.21.15.2:0/2053458433 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505956281 0 0) 0x7f4b4c0cb160 con 0x7f4b4c0ad960 2024-08-17T02:23:27.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.917+0000 7f4b4be00640 1 -- 172.21.15.2:0/2053458433 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b340034e0 con 0x7f4b4c0ad960 2024-08-17T02:23:27.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.917+0000 7f4b51000640 1 --2- 172.21.15.2:0/2053458433 >> v2:172.21.15.145:3300/0 conn(0x7f4b4c0ca050 0x7f4b4c156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:27.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.918+0000 7f4b4be00640 1 -- 172.21.15.2:0/2053458433 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3955336988 0 0) 0x7f4b340034e0 con 0x7f4b4c0ad960 2024-08-17T02:23:27.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.918+0000 7f4b4be00640 1 -- 172.21.15.2:0/2053458433 >> v2:172.21.15.145:3300/0 conn(0x7f4b4c0ca050 msgr2=0x7f4b4c156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:27.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.918+0000 7f4b4be00640 1 --2- 172.21.15.2:0/2053458433 >> v2:172.21.15.145:3300/0 conn(0x7f4b4c0ca050 0x7f4b4c156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:27.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.918+0000 7f4b4be00640 1 -- 172.21.15.2:0/2053458433 >> v1:172.21.15.145:6789/0 conn(0x7f4b4c0add30 legacy=0x7f4b4c0aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:27.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.918+0000 7f4b4be00640 1 -- 172.21.15.2:0/2053458433 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c0ca830 con 0x7f4b4c0ad960 2024-08-17T02:23:27.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.918+0000 7f4b4be00640 1 -- 172.21.15.2:0/2053458433 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7f4b40001470 con 0x7f4b4c0ad960 2024-08-17T02:23:27.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.918+0000 7f4b4be00640 1 -- 172.21.15.2:0/2053458433 >> v1:172.21.15.2:6789/0 conn(0x7f4b4c0ad960 legacy=0x7f4b4c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:27.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.918+0000 7f4b4be00640 1 --2- 172.21.15.2:0/2053458433 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b340039d0 0x7f4b34003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:27.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.918+0000 7f4b4be00640 1 --2- 172.21.15.2:0/2053458433 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b34004780 0x7f4b34004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:27.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.918+0000 7f4b4be00640 1 --2- 172.21.15.2:0/2053458433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b34005130 0x7f4b3400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:27.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.918+0000 7f4b4be00640 1 -- 172.21.15.2:0/2053458433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0ca550 con 0x7f4b34005130 2024-08-17T02:23:27.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.918+0000 7f4b4be00640 1 -- 172.21.15.2:0/2053458433 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3400bfc0 con 0x7f4b340039d0 2024-08-17T02:23:27.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.918+0000 7f4b4be00640 1 -- 172.21.15.2:0/2053458433 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3400c180 con 0x7f4b34004780 2024-08-17T02:23:27.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.918+0000 7f4b51a00640 1 --2- 172.21.15.2:0/2053458433 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b340039d0 0x7f4b34003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:27.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.918+0000 7f4b51000640 1 --2- 172.21.15.2:0/2053458433 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b34004780 0x7f4b34004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:27.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.918+0000 7f4b52400640 1 --2- 172.21.15.2:0/2053458433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b34005130 0x7f4b3400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:27.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.919+0000 7f4b51a00640 1 -- 172.21.15.2:0/2053458433 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b34004780 msgr2=0x7f4b34004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:27.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.919+0000 7f4b51a00640 1 --2- 172.21.15.2:0/2053458433 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b34004780 0x7f4b34004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:27.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.919+0000 7f4b51a00640 1 -- 172.21.15.2:0/2053458433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b34005130 msgr2=0x7f4b3400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:27.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.919+0000 7f4b51a00640 1 --2- 172.21.15.2:0/2053458433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b34005130 0x7f4b3400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:27.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.919+0000 7f4b51a00640 1 -- 172.21.15.2:0/2053458433 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b340034e0 con 0x7f4b340039d0 2024-08-17T02:23:27.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.919+0000 7f4b51000640 1 --2- 172.21.15.2:0/2053458433 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b34004780 0x7f4b34004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:27.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.919+0000 7f4b52400640 1 --2- 172.21.15.2:0/2053458433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b34005130 0x7f4b3400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:27.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.919+0000 7f4b52400640 1 -- 172.21.15.2:0/2053458433 reap_dead start 2024-08-17T02:23:27.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.920+0000 7f4b51a00640 1 --2- 172.21.15.2:0/2053458433 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b340039d0 0x7f4b34003da0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4b4000c300 tx=0x7f4b40001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6b4ed6305c9a3ee server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:27.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.920+0000 7f4b4be00640 1 -- 172.21.15.2:0/2053458433 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4002e070 con 0x7f4b340039d0 2024-08-17T02:23:27.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.920+0000 7f4b4be00640 1 -- 172.21.15.2:0/2053458433 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b40005890 con 0x7f4b340039d0 2024-08-17T02:23:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.920+0000 7f4b4be00640 1 -- 172.21.15.2:0/2053458433 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b40005c70 con 0x7f4b340039d0 2024-08-17T02:23:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.920+0000 7f4b54400640 1 -- 172.21.15.2:0/2053458433 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b340039d0 msgr2=0x7f4b34003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.920+0000 7f4b54400640 1 --2- 172.21.15.2:0/2053458433 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b340039d0 0x7f4b34003da0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4b4000c300 tx=0x7f4b40001e70 comp rx=0 tx=0).stop 2024-08-17T02:23:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.921+0000 7f4b54400640 1 -- 172.21.15.2:0/2053458433 shutdown_connections 2024-08-17T02:23:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.921+0000 7f4b54400640 1 --2- 172.21.15.2:0/2053458433 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b340039d0 0x7f4b34003da0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.921+0000 7f4b54400640 1 -- 172.21.15.2:0/2053458433 >> 172.21.15.2:0/2053458433 conn(0x7f4b4c066e60 msgr2=0x7f4b4c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.921+0000 7f4b54400640 1 -- 172.21.15.2:0/2053458433 shutdown_connections 2024-08-17T02:23:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.921+0000 7f4b54400640 1 -- 172.21.15.2:0/2053458433 wait complete. 2024-08-17T02:23:27.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.922+0000 7f4b54400640 1 Processor -- start 2024-08-17T02:23:27.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.922+0000 7f4b54400640 1 -- start start 2024-08-17T02:23:27.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.923+0000 7f4b54400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b340039d0 0x7f4b4c0c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:27.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.923+0000 7f4b54400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b4c0a9590 0x7f4b4c0a9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:27.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.923+0000 7f4b54400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b4c0a45b0 0x7f4b4c0a4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:27.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.923+0000 7f4b54400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0a5e60 con 0x7f4b340039d0 2024-08-17T02:23:27.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.923+0000 7f4b54400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0c09f0 con 0x7f4b4c0a45b0 2024-08-17T02:23:27.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.923+0000 7f4b54400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0a9f40 con 0x7f4b4c0a9590 2024-08-17T02:23:27.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.923+0000 7f4b51a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b340039d0 0x7f4b4c0c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:27.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.923+0000 7f4b51a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b340039d0 0x7f4b4c0c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34658/0 (socket says 172.21.15.2:34658) 2024-08-17T02:23:27.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.923+0000 7f4b51a00640 1 -- 172.21.15.2:0/2845458427 learned_addr learned my addr 172.21.15.2:0/2845458427 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:27.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.923+0000 7f4b51000640 1 --2- 172.21.15.2:0/2845458427 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b4c0a9590 0x7f4b4c0a9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:27.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.923+0000 7f4b52400640 1 --2- 172.21.15.2:0/2845458427 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b4c0a45b0 0x7f4b4c0a4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:27.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.924+0000 7f4b51a00640 1 -- 172.21.15.2:0/2845458427 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b4c0a9590 msgr2=0x7f4b4c0a9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:27.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.924+0000 7f4b51a00640 1 --2- 172.21.15.2:0/2845458427 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b4c0a9590 0x7f4b4c0a9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:27.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.924+0000 7f4b51a00640 1 -- 172.21.15.2:0/2845458427 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b4c0a45b0 msgr2=0x7f4b4c0a4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:27.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.924+0000 7f4b51a00640 1 --2- 172.21.15.2:0/2845458427 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b4c0a45b0 0x7f4b4c0a4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:27.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.924+0000 7f4b51a00640 1 -- 172.21.15.2:0/2845458427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c0a52e0 con 0x7f4b340039d0 2024-08-17T02:23:27.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.924+0000 7f4b51a00640 1 --2- 172.21.15.2:0/2845458427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b340039d0 0x7f4b4c0c81d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4b4000c360 tx=0x7f4b40034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:27.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.924+0000 7f4b48c00640 1 -- 172.21.15.2:0/2845458427 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b40042070 con 0x7f4b340039d0 2024-08-17T02:23:27.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.924+0000 7f4b48c00640 1 -- 172.21.15.2:0/2845458427 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b40001430 con 0x7f4b340039d0 2024-08-17T02:23:27.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.924+0000 7f4b48c00640 1 -- 172.21.15.2:0/2845458427 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b400054c0 con 0x7f4b340039d0 2024-08-17T02:23:27.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.924+0000 7f4b54400640 1 -- 172.21.15.2:0/2845458427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4c0a55c0 con 0x7f4b340039d0 2024-08-17T02:23:27.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.924+0000 7f4b54400640 1 -- 172.21.15.2:0/2845458427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4c0a5b80 con 0x7f4b340039d0 2024-08-17T02:23:27.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.925+0000 7f4b54400640 1 -- 172.21.15.2:0/2845458427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b4c063fb0 con 0x7f4b340039d0 2024-08-17T02:23:27.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.926+0000 7f4b48c00640 1 -- 172.21.15.2:0/2845458427 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f4b400049b0 con 0x7f4b340039d0 2024-08-17T02:23:27.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.927+0000 7f4b48c00640 1 --2- 172.21.15.2:0/2845458427 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4b2c0650c0 0x7f4b2c067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:27.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.927+0000 7f4b48c00640 1 -- 172.21.15.2:0/2845458427 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4b400a2240 con 0x7f4b340039d0 2024-08-17T02:23:27.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.927+0000 7f4b51000640 1 --2- 172.21.15.2:0/2845458427 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4b2c0650c0 0x7f4b2c067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:27.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.928+0000 7f4b51000640 1 --2- 172.21.15.2:0/2845458427 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4b2c0650c0 0x7f4b2c067570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009690 tx=0x7f4b380090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:27.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:27.932+0000 7f4b48c00640 1 -- 172.21.15.2:0/2845458427 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4b40070750 con 0x7f4b340039d0 2024-08-17T02:23:28.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.168+0000 7f4b54400640 1 -- 172.21.15.2:0/2845458427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b4c15a8b0 con 0x7f4b340039d0 2024-08-17T02:23:28.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.168+0000 7f4b48c00640 1 -- 172.21.15.2:0/2845458427 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3518 (secure 0 0 0) 0x7f4b40073d70 con 0x7f4b340039d0 2024-08-17T02:23:28.169 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:28.169 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/88006300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":88006300},{"type":"v1","addr":"172.21.15.2:6835","nonce":88006300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3374741059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3374741059},{"type":"v1","addr":"172.21.15.2:6833","nonce":3374741059}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/3494373963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":3494373963},{"type":"v1","addr":"172.21.15.145:6837","nonce":3494373963}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6836/3984927211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3984927211},{"type":"v1","addr":"172.21.15.145:6836","nonce":3984927211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-08-17T02:23:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 3 2024-08-17T02:23:28.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.170+0000 7f4b54400640 1 -- 172.21.15.2:0/2845458427 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4b2c0650c0 msgr2=0x7f4b2c067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.170+0000 7f4b54400640 1 --2- 172.21.15.2:0/2845458427 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4b2c0650c0 0x7f4b2c067570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009690 tx=0x7f4b380090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.170+0000 7f4b54400640 1 -- 172.21.15.2:0/2845458427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b340039d0 msgr2=0x7f4b4c0c81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.170+0000 7f4b54400640 1 --2- 172.21.15.2:0/2845458427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b340039d0 0x7f4b4c0c81d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4b4000c360 tx=0x7f4b40034000 comp rx=0 tx=0).stop 2024-08-17T02:23:28.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.170+0000 7f4b54400640 1 -- 172.21.15.2:0/2845458427 shutdown_connections 2024-08-17T02:23:28.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.170+0000 7f4b54400640 1 --2- 172.21.15.2:0/2845458427 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b4c0a45b0 0x7f4b4c0a4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.170+0000 7f4b54400640 1 --2- 172.21.15.2:0/2845458427 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4b2c0650c0 0x7f4b2c067570 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.170+0000 7f4b54400640 1 --2- 172.21.15.2:0/2845458427 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b4c0a9590 0x7f4b4c0a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.170+0000 7f4b54400640 1 --2- 172.21.15.2:0/2845458427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b340039d0 0x7f4b4c0c81d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.170+0000 7f4b54400640 1 -- 172.21.15.2:0/2845458427 >> 172.21.15.2:0/2845458427 conn(0x7f4b4c066e60 msgr2=0x7f4b4c151d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:28.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.171+0000 7f4b54400640 1 -- 172.21.15.2:0/2845458427 shutdown_connections 2024-08-17T02:23:28.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.171+0000 7f4b54400640 1 -- 172.21.15.2:0/2845458427 wait complete. 2024-08-17T02:23:28.187 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:28.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.344+0000 7fd7b4200640 1 Processor -- start 2024-08-17T02:23:28.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.344+0000 7fd7b4200640 1 -- start start 2024-08-17T02:23:28.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.345+0000 7fd7b4200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7ac0afca0 0x7fd7ac0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:28.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.345+0000 7fd7b4200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd7ac0acf10 0x7fd7ac159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:28.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.345+0000 7fd7b4200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd7ac1589a0 0x7fd7ac158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:28.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.345+0000 7fd7b4200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ac0b0980 con 0x7fd7ac1589a0 2024-08-17T02:23:28.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.345+0000 7fd7b4200640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ac15a4e0 con 0x7fd7ac0acf10 2024-08-17T02:23:28.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.345+0000 7fd7b4200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac0c92b0 con 0x7fd7ac0afca0 2024-08-17T02:23:28.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.345+0000 7fd7b2200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd7ac1589a0 0x7fd7ac158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:28.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.346+0000 7fd7b2200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd7ac1589a0 0x7fd7ac158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34664/0 (socket says 172.21.15.2:34664) 2024-08-17T02:23:28.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.346+0000 7fd7b2200640 1 -- 172.21.15.2:0/659005039 learned_addr learned my addr 172.21.15.2:0/659005039 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:28.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.346+0000 7fd7b1800640 1 --2- 172.21.15.2:0/659005039 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7ac0afca0 0x7fd7ac0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:28.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.346+0000 7fd7b0e00640 1 --2- 172.21.15.2:0/659005039 >> v2:172.21.15.145:3300/0 conn(0x7fd7ac0acf10 0x7fd7ac159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:28.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.346+0000 7fd7b2200640 1 -- 172.21.15.2:0/659005039 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7ac0afca0 msgr2=0x7fd7ac0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:28.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.346+0000 7fd7b2200640 1 --2- 172.21.15.2:0/659005039 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7ac0afca0 0x7fd7ac0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.346+0000 7fd7b2200640 1 -- 172.21.15.2:0/659005039 >> v2:172.21.15.145:3300/0 conn(0x7fd7ac0acf10 msgr2=0x7fd7ac159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:28.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.346+0000 7fd7b2200640 1 --2- 172.21.15.2:0/659005039 >> v2:172.21.15.145:3300/0 conn(0x7fd7ac0acf10 0x7fd7ac159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.346+0000 7fd7b2200640 1 -- 172.21.15.2:0/659005039 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ac159360 con 0x7fd7ac1589a0 2024-08-17T02:23:28.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.347+0000 7fd7b2200640 1 --2- 172.21.15.2:0/659005039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7ac1589a0 0x7fd7ac158e20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4009f20 tx=0x7fd7a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913bbb2c0c0dff3c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:28.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.347+0000 7fd7abe00640 1 -- 172.21.15.2:0/659005039 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4031400 con 0x7fd7ac1589a0 2024-08-17T02:23:28.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.347+0000 7fd7abe00640 1 -- 172.21.15.2:0/659005039 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a402d050 con 0x7fd7ac1589a0 2024-08-17T02:23:28.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.347+0000 7fd7abe00640 1 -- 172.21.15.2:0/659005039 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a40317d0 con 0x7fd7ac1589a0 2024-08-17T02:23:28.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.348+0000 7fd7b4200640 1 -- 172.21.15.2:0/659005039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7ac1589a0 msgr2=0x7fd7ac158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.348+0000 7fd7b4200640 1 --2- 172.21.15.2:0/659005039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7ac1589a0 0x7fd7ac158e20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4009f20 tx=0x7fd7a4009840 comp rx=0 tx=0).stop 2024-08-17T02:23:28.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.348+0000 7fd7b4200640 1 -- 172.21.15.2:0/659005039 shutdown_connections 2024-08-17T02:23:28.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.348+0000 7fd7b4200640 1 --2- 172.21.15.2:0/659005039 >> v2:172.21.15.145:3300/0 conn(0x7fd7ac0acf10 0x7fd7ac159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.348+0000 7fd7b4200640 1 --2- 172.21.15.2:0/659005039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7ac1589a0 0x7fd7ac158e20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.348+0000 7fd7b4200640 1 --2- 172.21.15.2:0/659005039 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7ac0afca0 0x7fd7ac0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.348+0000 7fd7b4200640 1 -- 172.21.15.2:0/659005039 >> 172.21.15.2:0/659005039 conn(0x7fd7ac066e60 msgr2=0x7fd7ac067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:28.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.348+0000 7fd7b4200640 1 -- 172.21.15.2:0/659005039 shutdown_connections 2024-08-17T02:23:28.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.348+0000 7fd7b4200640 1 -- 172.21.15.2:0/659005039 wait complete. 2024-08-17T02:23:28.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.350+0000 7fd7b4200640 1 Processor -- start 2024-08-17T02:23:28.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.350+0000 7fd7b4200640 1 -- start start 2024-08-17T02:23:28.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.352+0000 7fd7b4200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7ac0acf10 0x7fd7ac151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:28.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.352+0000 7fd7b4200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7ac0afca0 0x7fd7ac15f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:28.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.352+0000 7fd7b4200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7ac1589a0 0x7fd7ac1511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:28.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.352+0000 7fd7b4200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac15f870 con 0x7fd7ac0afca0 2024-08-17T02:23:28.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.352+0000 7fd7b4200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac152450 con 0x7fd7ac0acf10 2024-08-17T02:23:28.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.352+0000 7fd7b4200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac1516f0 con 0x7fd7ac1589a0 2024-08-17T02:23:28.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.352+0000 7fd7b0e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7ac0afca0 0x7fd7ac15f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:28.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.352+0000 7fd7b0e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7ac0afca0 0x7fd7ac15f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34672/0 (socket says 172.21.15.2:34672) 2024-08-17T02:23:28.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.352+0000 7fd7b0e00640 1 -- 172.21.15.2:0/2241369127 learned_addr learned my addr 172.21.15.2:0/2241369127 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:28.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.352+0000 7fd7b2200640 1 --2- 172.21.15.2:0/2241369127 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7ac1589a0 0x7fd7ac1511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:28.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.352+0000 7fd7b1800640 1 --2- 172.21.15.2:0/2241369127 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7ac0acf10 0x7fd7ac151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:28.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.352+0000 7fd7b0e00640 1 -- 172.21.15.2:0/2241369127 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7ac1589a0 msgr2=0x7fd7ac1511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.353+0000 7fd7b0e00640 1 --2- 172.21.15.2:0/2241369127 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7ac1589a0 0x7fd7ac1511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.353+0000 7fd7b0e00640 1 -- 172.21.15.2:0/2241369127 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7ac0acf10 msgr2=0x7fd7ac151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.353+0000 7fd7b0e00640 1 --2- 172.21.15.2:0/2241369127 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7ac0acf10 0x7fd7ac151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.353+0000 7fd7b0e00640 1 -- 172.21.15.2:0/2241369127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a4009ae0 con 0x7fd7ac0afca0 2024-08-17T02:23:28.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.353+0000 7fd7b2200640 1 --2- 172.21.15.2:0/2241369127 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7ac1589a0 0x7fd7ac1511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:28.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.353+0000 7fd7b0e00640 1 --2- 172.21.15.2:0/2241369127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7ac0afca0 0x7fd7ac15f330 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd79800e900 tx=0x7fd7980090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:28.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.353+0000 7fd7a8c00640 1 -- 172.21.15.2:0/2241369127 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79800c8e0 con 0x7fd7ac0afca0 2024-08-17T02:23:28.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.353+0000 7fd7a8c00640 1 -- 172.21.15.2:0/2241369127 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79800ca40 con 0x7fd7ac0afca0 2024-08-17T02:23:28.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.353+0000 7fd7a8c00640 1 -- 172.21.15.2:0/2241369127 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79800cde0 con 0x7fd7ac0afca0 2024-08-17T02:23:28.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.353+0000 7fd7b4200640 1 -- 172.21.15.2:0/2241369127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ac152660 con 0x7fd7ac0afca0 2024-08-17T02:23:28.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.353+0000 7fd7b4200640 1 -- 172.21.15.2:0/2241369127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ac152c20 con 0x7fd7ac0afca0 2024-08-17T02:23:28.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.355+0000 7fd7b4200640 1 -- 172.21.15.2:0/2241369127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7ac063fb0 con 0x7fd7ac0afca0 2024-08-17T02:23:28.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.355+0000 7fd7a8c00640 1 -- 172.21.15.2:0/2241369127 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7fd798013680 con 0x7fd7ac0afca0 2024-08-17T02:23:28.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.356+0000 7fd7a8c00640 1 --2- 172.21.15.2:0/2241369127 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd78c0650c0 0x7fd78c067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:28.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.356+0000 7fd7a8c00640 1 -- 172.21.15.2:0/2241369127 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd798082200 con 0x7fd7ac0afca0 2024-08-17T02:23:28.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.361+0000 7fd7a8c00640 1 -- 172.21.15.2:0/2241369127 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd798050700 con 0x7fd7ac0afca0 2024-08-17T02:23:28.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.368+0000 7fd7b1800640 1 --2- 172.21.15.2:0/2241369127 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd78c0650c0 0x7fd78c067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:28.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.369+0000 7fd7b1800640 1 --2- 172.21.15.2:0/2241369127 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd78c0650c0 0x7fd78c067570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009d20 tx=0x7fd7a00090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:28.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.548+0000 7fd7b4200640 1 -- 172.21.15.2:0/2241369127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7ac067b70 con 0x7fd7ac0afca0 2024-08-17T02:23:28.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.549+0000 7fd7a8c00640 1 -- 172.21.15.2:0/2241369127 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12092 (secure 0 0 0) 0x7fd798017090 con 0x7fd7ac0afca0 2024-08-17T02:23:28.549 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:28.549 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":16,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:23:27.816227+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.551+0000 7fd7b4200640 1 -- 172.21.15.2:0/2241369127 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd78c0650c0 msgr2=0x7fd78c067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.551+0000 7fd7b4200640 1 --2- 172.21.15.2:0/2241369127 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd78c0650c0 0x7fd78c067570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009d20 tx=0x7fd7a00090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.551+0000 7fd7b4200640 1 -- 172.21.15.2:0/2241369127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7ac0afca0 msgr2=0x7fd7ac15f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.551+0000 7fd7b4200640 1 --2- 172.21.15.2:0/2241369127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7ac0afca0 0x7fd7ac15f330 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd79800e900 tx=0x7fd7980090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.551+0000 7fd7b4200640 1 -- 172.21.15.2:0/2241369127 shutdown_connections 2024-08-17T02:23:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.551+0000 7fd7b4200640 1 --2- 172.21.15.2:0/2241369127 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd78c0650c0 0x7fd78c067570 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.551+0000 7fd7b4200640 1 --2- 172.21.15.2:0/2241369127 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7ac1589a0 0x7fd7ac1511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.551+0000 7fd7b4200640 1 --2- 172.21.15.2:0/2241369127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7ac0afca0 0x7fd7ac15f330 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.551+0000 7fd7b4200640 1 --2- 172.21.15.2:0/2241369127 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7ac0acf10 0x7fd7ac151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.551+0000 7fd7b4200640 1 -- 172.21.15.2:0/2241369127 >> 172.21.15.2:0/2241369127 conn(0x7fd7ac066e60 msgr2=0x7fd7ac06d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:28.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.551+0000 7fd7b4200640 1 -- 172.21.15.2:0/2241369127 shutdown_connections 2024-08-17T02:23:28.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.551+0000 7fd7b4200640 1 -- 172.21.15.2:0/2241369127 wait complete. 2024-08-17T02:23:28.566 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:23:26.107978+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:23:28.567 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:23:28.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.722+0000 7f23ef000640 1 Processor -- start 2024-08-17T02:23:28.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.723+0000 7f23ef000640 1 -- start start 2024-08-17T02:23:28.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.724+0000 7f23ef000640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f23e8158ad0 0x7f23e80ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:28.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.724+0000 7f23ef000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f23e80cc480 0x7f23e80cc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:28.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.724+0000 7f23ef000640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e80ced30 con 0x7f23e80ca4d0 2024-08-17T02:23:28.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.724+0000 7f23ef000640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e80af500 con 0x7f23e8158ad0 2024-08-17T02:23:28.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.724+0000 7f23ef000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e80cd770 con 0x7f23e80cc480 2024-08-17T02:23:28.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.724+0000 7f23ed200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f23e80cc480 0x7f23e80cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:28.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.724+0000 7f23edc00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f23e8158ad0 0x7f23e80ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:28.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.724+0000 7f23ee600640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f23e80ca4d0 0x7f23e80ca950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:48286/0 (socket says 172.21.15.2:48286) 2024-08-17T02:23:28.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.724+0000 7f23ee600640 1 -- 172.21.15.2:0/1418989035 learned_addr learned my addr 172.21.15.2:0/1418989035 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:28.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.725+0000 7f23ed200640 1 -- 172.21.15.2:0/1418989035 >> v2:172.21.15.145:3300/0 conn(0x7f23e8158ad0 msgr2=0x7f23e80ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.725+0000 7f23ed200640 1 --2- 172.21.15.2:0/1418989035 >> v2:172.21.15.145:3300/0 conn(0x7f23e8158ad0 0x7f23e80ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.725+0000 7f23e7e00640 1 -- 172.21.15.2:0/1418989035 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 25199180 0 0) 0x7f23e0001490 con 0x7f23e80ca4d0 2024-08-17T02:23:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.725+0000 7f23ed200640 1 -- 172.21.15.2:0/1418989035 >> v1:172.21.15.145:6789/0 conn(0x7f23e80ca4d0 legacy=0x7f23e80ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.725+0000 7f23ed200640 1 -- 172.21.15.2:0/1418989035 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e80cda30 con 0x7f23e80cc480 2024-08-17T02:23:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.726+0000 7f23ed200640 1 --2- 172.21.15.2:0/1418989035 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f23e80cc480 0x7f23e80cc850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f23d4009850 tx=0x7f23d40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d393ab75b9705ba0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:28.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.726+0000 7f23e7e00640 1 -- 172.21.15.2:0/1418989035 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d402ae10 con 0x7f23e80cc480 2024-08-17T02:23:28.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.726+0000 7f23e7e00640 1 -- 172.21.15.2:0/1418989035 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d4032440 con 0x7f23e80cc480 2024-08-17T02:23:28.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.726+0000 7f23e7e00640 1 -- 172.21.15.2:0/1418989035 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d40327e0 con 0x7f23e80cc480 2024-08-17T02:23:28.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.727+0000 7f23ef000640 1 -- 172.21.15.2:0/1418989035 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f23e80cc480 msgr2=0x7f23e80cc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.727+0000 7f23ef000640 1 --2- 172.21.15.2:0/1418989035 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f23e80cc480 0x7f23e80cc850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f23d4009850 tx=0x7f23d40090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.727+0000 7f23ef000640 1 -- 172.21.15.2:0/1418989035 shutdown_connections 2024-08-17T02:23:28.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.727+0000 7f23ef000640 1 --2- 172.21.15.2:0/1418989035 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f23e80cc480 0x7f23e80cc850 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.727+0000 7f23ef000640 1 --2- 172.21.15.2:0/1418989035 >> v2:172.21.15.145:3300/0 conn(0x7f23e8158ad0 0x7f23e80ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.727+0000 7f23ef000640 1 -- 172.21.15.2:0/1418989035 >> 172.21.15.2:0/1418989035 conn(0x7f23e8087ad0 msgr2=0x7f23e806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:28.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.727+0000 7f23ef000640 1 -- 172.21.15.2:0/1418989035 shutdown_connections 2024-08-17T02:23:28.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.727+0000 7f23ef000640 1 -- 172.21.15.2:0/1418989035 wait complete. 2024-08-17T02:23:28.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.728+0000 7f23ef000640 1 Processor -- start 2024-08-17T02:23:28.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.729+0000 7f23ef000640 1 -- start start 2024-08-17T02:23:28.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.729+0000 7f23ef000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f23e80ca4d0 0x7f23e816d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:28.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.729+0000 7f23ef000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23e80cc480 0x7f23e80b5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:28.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.729+0000 7f23ef000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23e8158ad0 0x7f23e8153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:28.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.729+0000 7f23ef000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e80b5aa0 con 0x7f23e8158ad0 2024-08-17T02:23:28.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.729+0000 7f23ef000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e80b32b0 con 0x7f23e80cc480 2024-08-17T02:23:28.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.729+0000 7f23ef000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e80b2ca0 con 0x7f23e80ca4d0 2024-08-17T02:23:28.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.730+0000 7f23ed200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23e80cc480 0x7f23e80b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:28.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.730+0000 7f23edc00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f23e80ca4d0 0x7f23e816d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:28.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.730+0000 7f23edc00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f23e80ca4d0 0x7f23e816d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:55528/0 (socket says 172.21.15.2:55528) 2024-08-17T02:23:28.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.730+0000 7f23ed200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23e80cc480 0x7f23e80b5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:34048/0 (socket says 172.21.15.2:34048) 2024-08-17T02:23:28.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.730+0000 7f23ee600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23e8158ad0 0x7f23e8153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:28.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.730+0000 7f23edc00640 1 -- 172.21.15.2:0/1011859167 learned_addr learned my addr 172.21.15.2:0/1011859167 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:28.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.730+0000 7f23ed200640 1 -- 172.21.15.2:0/1011859167 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f23e80ca4d0 msgr2=0x7f23e816d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.730+0000 7f23ed200640 1 --2- 172.21.15.2:0/1011859167 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f23e80ca4d0 0x7f23e816d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.730+0000 7f23ed200640 1 -- 172.21.15.2:0/1011859167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23e8158ad0 msgr2=0x7f23e8153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.730+0000 7f23ed200640 1 --2- 172.21.15.2:0/1011859167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23e8158ad0 0x7f23e8153cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.730+0000 7f23ed200640 1 -- 172.21.15.2:0/1011859167 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d4009390 con 0x7f23e80cc480 2024-08-17T02:23:28.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.730+0000 7f23edc00640 1 --2- 172.21.15.2:0/1011859167 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f23e80ca4d0 0x7f23e816d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:28.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.731+0000 7f23ed200640 1 --2- 172.21.15.2:0/1011859167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23e80cc480 0x7f23e80b5560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f23d4031000 tx=0x7f23d4032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:28.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.731+0000 7f23e4c00640 1 -- 172.21.15.2:0/1011859167 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d4031de0 con 0x7f23e80cc480 2024-08-17T02:23:28.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.731+0000 7f23e4c00640 1 -- 172.21.15.2:0/1011859167 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d403d420 con 0x7f23e80cc480 2024-08-17T02:23:28.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.731+0000 7f23ef000640 1 -- 172.21.15.2:0/1011859167 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e8159040 con 0x7f23e80cc480 2024-08-17T02:23:28.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.731+0000 7f23e4c00640 1 -- 172.21.15.2:0/1011859167 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d403d7e0 con 0x7f23e80cc480 2024-08-17T02:23:28.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.731+0000 7f23ef000640 1 -- 172.21.15.2:0/1011859167 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e8159320 con 0x7f23e80cc480 2024-08-17T02:23:28.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.732+0000 7f23ef000640 1 -- 172.21.15.2:0/1011859167 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e8070720 con 0x7f23e80cc480 2024-08-17T02:23:28.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.733+0000 7f23e4c00640 1 -- 172.21.15.2:0/1011859167 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f23d4039040 con 0x7f23e80cc480 2024-08-17T02:23:28.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.734+0000 7f23e4c00640 1 --2- 172.21.15.2:0/1011859167 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f23c80650f0 0x7f23c80675a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:28.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.734+0000 7f23e4c00640 1 -- 172.21.15.2:0/1011859167 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f23d40a1ed0 con 0x7f23e80cc480 2024-08-17T02:23:28.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.734+0000 7f23edc00640 1 --2- 172.21.15.2:0/1011859167 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f23c80650f0 0x7f23c80675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:28.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.735+0000 7f23edc00640 1 --2- 172.21.15.2:0/1011859167 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f23c80650f0 0x7f23c80675a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f23e80640c0 tx=0x7f23dc0090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:28.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.739+0000 7f23e4c00640 1 -- 172.21.15.2:0/1011859167 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f23d4070470 con 0x7f23e80cc480 2024-08-17T02:23:28.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.926+0000 7f23ef000640 1 -- 172.21.15.2:0/1011859167 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f23e815b340 con 0x7f23e80cc480 2024-08-17T02:23:28.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.926+0000 7f23e4c00640 1 -- 172.21.15.2:0/1011859167 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f23d40420a0 con 0x7f23e80cc480 2024-08-17T02:23:28.927 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-17T02:23:28.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.929+0000 7f23ef000640 1 -- 172.21.15.2:0/1011859167 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f23c80650f0 msgr2=0x7f23c80675a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.929+0000 7f23ef000640 1 --2- 172.21.15.2:0/1011859167 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f23c80650f0 0x7f23c80675a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f23e80640c0 tx=0x7f23dc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.929+0000 7f23ef000640 1 -- 172.21.15.2:0/1011859167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23e80cc480 msgr2=0x7f23e80b5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.929+0000 7f23ef000640 1 --2- 172.21.15.2:0/1011859167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23e80cc480 0x7f23e80b5560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f23d4031000 tx=0x7f23d4032000 comp rx=0 tx=0).stop 2024-08-17T02:23:28.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.929+0000 7f23ef000640 1 -- 172.21.15.2:0/1011859167 shutdown_connections 2024-08-17T02:23:28.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.929+0000 7f23ef000640 1 --2- 172.21.15.2:0/1011859167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23e8158ad0 0x7f23e8153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.929+0000 7f23ef000640 1 --2- 172.21.15.2:0/1011859167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23e80cc480 0x7f23e80b5560 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.929+0000 7f23ef000640 1 --2- 172.21.15.2:0/1011859167 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f23c80650f0 0x7f23c80675a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.929+0000 7f23ef000640 1 --2- 172.21.15.2:0/1011859167 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f23e80ca4d0 0x7f23e816d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.929+0000 7f23ef000640 1 -- 172.21.15.2:0/1011859167 >> 172.21.15.2:0/1011859167 conn(0x7f23e8087ad0 msgr2=0x7f23e80b18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:28.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.929+0000 7f23ef000640 1 -- 172.21.15.2:0/1011859167 shutdown_connections 2024-08-17T02:23:28.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:28.929+0000 7f23ef000640 1 -- 172.21.15.2:0/1011859167 wait complete. 2024-08-17T02:23:28.944 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:23:29.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.094+0000 7feb42400640 1 Processor -- start 2024-08-17T02:23:29.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.094+0000 7feb42400640 1 -- start start 2024-08-17T02:23:29.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.096+0000 7feb42400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feb3c1590b0 0x7feb3c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:29.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.096+0000 7feb42400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7feb3c0acf10 0x7feb3c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:29.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.096+0000 7feb42400640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb3c15a4e0 con 0x7feb3c0afca0 2024-08-17T02:23:29.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.096+0000 7feb42400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb3c0b0980 con 0x7feb3c1590b0 2024-08-17T02:23:29.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.096+0000 7feb42400640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb3c0c92b0 con 0x7feb3c0acf10 2024-08-17T02:23:29.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.096+0000 7feb3be00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7feb3c0acf10 0x7feb3c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:29.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.096+0000 7feb3aa00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feb3c1590b0 0x7feb3c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:29.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.096+0000 7feb3b400640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7feb3c0afca0 0x7feb3c1589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:48298/0 (socket says 172.21.15.2:48298) 2024-08-17T02:23:29.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.096+0000 7feb3b400640 1 -- 172.21.15.2:0/2519909757 learned_addr learned my addr 172.21.15.2:0/2519909757 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:29.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.096+0000 7feb3be00640 1 -- 172.21.15.2:0/2519909757 >> v2:172.21.15.2:3300/0 conn(0x7feb3c1590b0 msgr2=0x7feb3c0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:29.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.096+0000 7feb3be00640 1 --2- 172.21.15.2:0/2519909757 >> v2:172.21.15.2:3300/0 conn(0x7feb3c1590b0 0x7feb3c0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:29.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.096+0000 7feb3be00640 1 -- 172.21.15.2:0/2519909757 >> v1:172.21.15.145:6789/0 conn(0x7feb3c0afca0 legacy=0x7feb3c1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:29.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.096+0000 7feb3be00640 1 -- 172.21.15.2:0/2519909757 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3c0ad480 con 0x7feb3c0acf10 2024-08-17T02:23:29.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.096+0000 7feb3a000640 1 -- 172.21.15.2:0/2519909757 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 696741067 0 0) 0x7feb2c001110 con 0x7feb3c0afca0 2024-08-17T02:23:29.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.096+0000 7feb3aa00640 1 --2- 172.21.15.2:0/2519909757 >> v2:172.21.15.2:3300/0 conn(0x7feb3c1590b0 0x7feb3c0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:29.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.097+0000 7feb3be00640 1 --2- 172.21.15.2:0/2519909757 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb3c0acf10 0x7feb3c159fa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0cb4a0 tx=0x7feb34009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5a95d1b0d9d7884 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:29.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.098+0000 7feb3a000640 1 -- 172.21.15.2:0/2519909757 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb34007550 con 0x7feb3c0acf10 2024-08-17T02:23:29.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.098+0000 7feb3a000640 1 -- 172.21.15.2:0/2519909757 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3402d050 con 0x7feb3c0acf10 2024-08-17T02:23:29.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.098+0000 7feb3a000640 1 -- 172.21.15.2:0/2519909757 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb340078e0 con 0x7feb3c0acf10 2024-08-17T02:23:29.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.098+0000 7feb42400640 1 -- 172.21.15.2:0/2519909757 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb3c0acf10 msgr2=0x7feb3c159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:29.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.098+0000 7feb42400640 1 --2- 172.21.15.2:0/2519909757 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb3c0acf10 0x7feb3c159fa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0cb4a0 tx=0x7feb34009780 comp rx=0 tx=0).stop 2024-08-17T02:23:29.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.098+0000 7feb42400640 1 -- 172.21.15.2:0/2519909757 shutdown_connections 2024-08-17T02:23:29.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.098+0000 7feb42400640 1 --2- 172.21.15.2:0/2519909757 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb3c0acf10 0x7feb3c159fa0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:29.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.098+0000 7feb42400640 1 --2- 172.21.15.2:0/2519909757 >> v2:172.21.15.2:3300/0 conn(0x7feb3c1590b0 0x7feb3c0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:29.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.098+0000 7feb42400640 1 -- 172.21.15.2:0/2519909757 >> 172.21.15.2:0/2519909757 conn(0x7feb3c066e60 msgr2=0x7feb3c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:29.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.098+0000 7feb42400640 1 -- 172.21.15.2:0/2519909757 shutdown_connections 2024-08-17T02:23:29.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.099+0000 7feb42400640 1 -- 172.21.15.2:0/2519909757 wait complete. 2024-08-17T02:23:29.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.100+0000 7feb42400640 1 Processor -- start 2024-08-17T02:23:29.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.100+0000 7feb42400640 1 -- start start 2024-08-17T02:23:29.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.101+0000 7feb42400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb3c0acf10 0x7feb3c150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:29.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.101+0000 7feb42400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb3c0afca0 0x7feb3c156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:29.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.101+0000 7feb42400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb3c1590b0 0x7feb3c156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:29.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.101+0000 7feb42400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c0c5520 con 0x7feb3c0afca0 2024-08-17T02:23:29.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.101+0000 7feb42400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c16a040 con 0x7feb3c1590b0 2024-08-17T02:23:29.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.101+0000 7feb42400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c0c4bf0 con 0x7feb3c0acf10 2024-08-17T02:23:29.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.101+0000 7feb3aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb3c0afca0 0x7feb3c156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:29.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.101+0000 7feb3b400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb3c0acf10 0x7feb3c150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:29.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.101+0000 7feb3aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb3c0afca0 0x7feb3c156620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34712/0 (socket says 172.21.15.2:34712) 2024-08-17T02:23:29.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.101+0000 7feb3aa00640 1 -- 172.21.15.2:0/2709949082 learned_addr learned my addr 172.21.15.2:0/2709949082 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:29.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.101+0000 7feb3be00640 1 --2- 172.21.15.2:0/2709949082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb3c1590b0 0x7feb3c156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:29.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.101+0000 7feb3aa00640 1 -- 172.21.15.2:0/2709949082 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb3c0acf10 msgr2=0x7feb3c150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:29.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.101+0000 7feb3aa00640 1 --2- 172.21.15.2:0/2709949082 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb3c0acf10 0x7feb3c150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:29.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.101+0000 7feb3aa00640 1 -- 172.21.15.2:0/2709949082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb3c1590b0 msgr2=0x7feb3c156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:29.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.101+0000 7feb3aa00640 1 --2- 172.21.15.2:0/2709949082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb3c1590b0 0x7feb3c156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:29.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.102+0000 7feb3aa00640 1 -- 172.21.15.2:0/2709949082 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb28009390 con 0x7feb3c0afca0 2024-08-17T02:23:29.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.102+0000 7feb3aa00640 1 --2- 172.21.15.2:0/2709949082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb3c0afca0 0x7feb3c156620 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7feb2800ec80 tx=0x7feb280090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:29.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.102+0000 7feb32a00640 1 -- 172.21.15.2:0/2709949082 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2800eec0 con 0x7feb3c0afca0 2024-08-17T02:23:29.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.102+0000 7feb32a00640 1 -- 172.21.15.2:0/2709949082 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2800cbc0 con 0x7feb3c0afca0 2024-08-17T02:23:29.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.102+0000 7feb32a00640 1 -- 172.21.15.2:0/2709949082 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb28013470 con 0x7feb3c0afca0 2024-08-17T02:23:29.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.102+0000 7feb42400640 1 -- 172.21.15.2:0/2709949082 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb34009a20 con 0x7feb3c0afca0 2024-08-17T02:23:29.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.102+0000 7feb42400640 1 -- 172.21.15.2:0/2709949082 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb3c0c51b0 con 0x7feb3c0afca0 2024-08-17T02:23:29.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.103+0000 7feb42400640 1 -- 172.21.15.2:0/2709949082 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3c063fb0 con 0x7feb3c0afca0 2024-08-17T02:23:29.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.104+0000 7feb32a00640 1 -- 172.21.15.2:0/2709949082 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7feb28013820 con 0x7feb3c0afca0 2024-08-17T02:23:29.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.105+0000 7feb32a00640 1 --2- 172.21.15.2:0/2709949082 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7feb1c0650c0 0x7feb1c067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:29.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.105+0000 7feb32a00640 1 -- 172.21.15.2:0/2709949082 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7feb280820c0 con 0x7feb3c0afca0 2024-08-17T02:23:29.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.105+0000 7feb3b400640 1 --2- 172.21.15.2:0/2709949082 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7feb1c0650c0 0x7feb1c067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:29.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.106+0000 7feb3b400640 1 --2- 172.21.15.2:0/2709949082 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7feb1c0650c0 0x7feb1c067570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feb3c158610 tx=0x7feb2c007ae0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:29.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.109+0000 7feb32a00640 1 -- 172.21.15.2:0/2709949082 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7feb28050660 con 0x7feb3c0afca0 2024-08-17T02:23:29.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.294+0000 7feb42400640 1 -- 172.21.15.2:0/2709949082 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7feb3c0cbe80 con 0x7feb3c0afca0 2024-08-17T02:23:29.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.295+0000 7feb32a00640 1 -- 172.21.15.2:0/2709949082 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7feb28017060 con 0x7feb3c0afca0 2024-08-17T02:23:29.295 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:29.295 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2024-08-17T02:23:29.295 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:23:29.295 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2024-08-17T02:23:29.295 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2024-08-17T02:23:29.295 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:23:29.296 INFO:teuthology.orchestra.run.smithi002.stdout:] 2024-08-17T02:23:29.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.297+0000 7feb42400640 1 -- 172.21.15.2:0/2709949082 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7feb1c0650c0 msgr2=0x7feb1c067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:29.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.297+0000 7feb42400640 1 --2- 172.21.15.2:0/2709949082 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7feb1c0650c0 0x7feb1c067570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feb3c158610 tx=0x7feb2c007ae0 comp rx=0 tx=0).stop 2024-08-17T02:23:29.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.297+0000 7feb42400640 1 -- 172.21.15.2:0/2709949082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb3c0afca0 msgr2=0x7feb3c156620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:29.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.297+0000 7feb42400640 1 --2- 172.21.15.2:0/2709949082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb3c0afca0 0x7feb3c156620 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7feb2800ec80 tx=0x7feb280090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:29.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.297+0000 7feb42400640 1 -- 172.21.15.2:0/2709949082 shutdown_connections 2024-08-17T02:23:29.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.297+0000 7feb42400640 1 --2- 172.21.15.2:0/2709949082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb3c1590b0 0x7feb3c156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:29.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.297+0000 7feb42400640 1 --2- 172.21.15.2:0/2709949082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb3c0afca0 0x7feb3c156620 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:29.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.297+0000 7feb42400640 1 --2- 172.21.15.2:0/2709949082 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7feb1c0650c0 0x7feb1c067570 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:29.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.297+0000 7feb42400640 1 --2- 172.21.15.2:0/2709949082 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb3c0acf10 0x7feb3c150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:29.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.297+0000 7feb42400640 1 -- 172.21.15.2:0/2709949082 >> 172.21.15.2:0/2709949082 conn(0x7feb3c066e60 msgr2=0x7feb3c067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:29.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.297+0000 7feb42400640 1 -- 172.21.15.2:0/2709949082 shutdown_connections 2024-08-17T02:23:29.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.297+0000 7feb42400640 1 -- 172.21.15.2:0/2709949082 wait complete. 2024-08-17T02:23:29.312 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:23:29.312 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:23:29.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.470+0000 7fbd49c00640 1 Processor -- start 2024-08-17T02:23:29.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.470+0000 7fbd49c00640 1 -- start start 2024-08-17T02:23:29.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.471+0000 7fbd49c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbd44158f80 0x7fbd440cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:29.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.471+0000 7fbd49c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd440cc9e0 con 0x7fbd44158bb0 2024-08-17T02:23:29.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.471+0000 7fbd49c00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd440cbdd0 con 0x7fbd440b1a70 2024-08-17T02:23:29.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.471+0000 7fbd49c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd440cc0b0 con 0x7fbd44158f80 2024-08-17T02:23:29.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.471+0000 7fbd42000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbd44158f80 0x7fbd440cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:29.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.471+0000 7fbd42a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbd44158bb0 0x7fbd440cb0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44720/0 (socket says 172.21.15.2:44720) 2024-08-17T02:23:29.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.471+0000 7fbd42a00640 1 -- 172.21.15.2:0/3410359444 learned_addr learned my addr 172.21.15.2:0/3410359444 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:29.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.472+0000 7fbd41600640 1 -- 172.21.15.2:0/3410359444 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926208052 0 0) 0x7fbd440cbdd0 con 0x7fbd440b1a70 2024-08-17T02:23:29.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.472+0000 7fbd42000640 1 -- 172.21.15.2:0/3410359444 >> v1:172.21.15.145:6789/0 conn(0x7fbd440b1a70 legacy=0x7fbd440b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:29.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.472+0000 7fbd42000640 1 -- 172.21.15.2:0/3410359444 >> v1:172.21.15.2:6789/0 conn(0x7fbd44158bb0 legacy=0x7fbd440cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:29.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.472+0000 7fbd42000640 1 -- 172.21.15.2:0/3410359444 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd440cc390 con 0x7fbd44158f80 2024-08-17T02:23:29.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.473+0000 7fbd42000640 1 --2- 172.21.15.2:0/3410359444 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbd44158f80 0x7fbd440cce70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009880 tx=0x7fbd300090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69de42e8d67e058b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:29.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.474+0000 7fbd41600640 1 -- 172.21.15.2:0/3410359444 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3002ace0 con 0x7fbd44158f80 2024-08-17T02:23:29.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.474+0000 7fbd41600640 1 -- 172.21.15.2:0/3410359444 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3002ae40 con 0x7fbd44158f80 2024-08-17T02:23:29.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.474+0000 7fbd41600640 1 -- 172.21.15.2:0/3410359444 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd30032670 con 0x7fbd44158f80 2024-08-17T02:23:29.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.474+0000 7fbd49c00640 1 -- 172.21.15.2:0/3410359444 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbd44158f80 msgr2=0x7fbd440cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.474+0000 7fbd49c00640 1 --2- 172.21.15.2:0/3410359444 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbd44158f80 0x7fbd440cce70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009880 tx=0x7fbd300090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.474+0000 7fbd49c00640 1 -- 172.21.15.2:0/3410359444 shutdown_connections 2024-08-17T02:23:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.474+0000 7fbd49c00640 1 --2- 172.21.15.2:0/3410359444 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbd44158f80 0x7fbd440cce70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.474+0000 7fbd49c00640 1 -- 172.21.15.2:0/3410359444 >> 172.21.15.2:0/3410359444 conn(0x7fbd4406e590 msgr2=0x7fbd4406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.474+0000 7fbd49c00640 1 -- 172.21.15.2:0/3410359444 shutdown_connections 2024-08-17T02:23:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.474+0000 7fbd49c00640 1 -- 172.21.15.2:0/3410359444 wait complete. 2024-08-17T02:23:29.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.476+0000 7fbd49c00640 1 Processor -- start 2024-08-17T02:23:29.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.476+0000 7fbd49c00640 1 -- start start 2024-08-17T02:23:29.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.477+0000 7fbd49c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbd440b1a70 0x7fbd44159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:29.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.477+0000 7fbd49c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd44158bb0 0x7fbd4416c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:29.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.477+0000 7fbd49c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbd44158f80 0x7fbd441491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:29.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.477+0000 7fbd49c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4415ac40 con 0x7fbd44158bb0 2024-08-17T02:23:29.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.477+0000 7fbd49c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd440c81e0 con 0x7fbd440b1a70 2024-08-17T02:23:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.477+0000 7fbd49c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4416cda0 con 0x7fbd44158f80 2024-08-17T02:23:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.477+0000 7fbd42000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd44158bb0 0x7fbd4416c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.477+0000 7fbd42a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbd440b1a70 0x7fbd44159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.477+0000 7fbd43400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbd44158f80 0x7fbd441491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.477+0000 7fbd42a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbd440b1a70 0x7fbd44159370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:34080/0 (socket says 172.21.15.2:34080) 2024-08-17T02:23:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.477+0000 7fbd42a00640 1 -- 172.21.15.2:0/2614944483 learned_addr learned my addr 172.21.15.2:0/2614944483 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.478+0000 7fbd42a00640 1 -- 172.21.15.2:0/2614944483 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbd44158f80 msgr2=0x7fbd441491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.478+0000 7fbd42a00640 1 --2- 172.21.15.2:0/2614944483 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbd44158f80 0x7fbd441491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.478+0000 7fbd42a00640 1 -- 172.21.15.2:0/2614944483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd44158bb0 msgr2=0x7fbd4416c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.478+0000 7fbd42a00640 1 --2- 172.21.15.2:0/2614944483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd44158bb0 0x7fbd4416c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.478+0000 7fbd42a00640 1 -- 172.21.15.2:0/2614944483 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd30009390 con 0x7fbd440b1a70 2024-08-17T02:23:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.478+0000 7fbd43400640 1 --2- 172.21.15.2:0/2614944483 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbd44158f80 0x7fbd441491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.478+0000 7fbd42a00640 1 --2- 172.21.15.2:0/2614944483 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbd440b1a70 0x7fbd44159370 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400c5c0 tx=0x7fbd34007ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.478+0000 7fbd3a000640 1 -- 172.21.15.2:0/2614944483 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd34005aa0 con 0x7fbd440b1a70 2024-08-17T02:23:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.478+0000 7fbd3a000640 1 -- 172.21.15.2:0/2614944483 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd34005c20 con 0x7fbd440b1a70 2024-08-17T02:23:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.478+0000 7fbd49c00640 1 -- 172.21.15.2:0/2614944483 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4416d080 con 0x7fbd440b1a70 2024-08-17T02:23:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.478+0000 7fbd3a000640 1 -- 172.21.15.2:0/2614944483 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd340070f0 con 0x7fbd440b1a70 2024-08-17T02:23:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.478+0000 7fbd49c00640 1 -- 172.21.15.2:0/2614944483 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd441496f0 con 0x7fbd440b1a70 2024-08-17T02:23:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.479+0000 7fbd49c00640 1 -- 172.21.15.2:0/2614944483 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd44063fb0 con 0x7fbd440b1a70 2024-08-17T02:23:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.480+0000 7fbd3a000640 1 -- 172.21.15.2:0/2614944483 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7fbd34007520 con 0x7fbd440b1a70 2024-08-17T02:23:29.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.481+0000 7fbd3a000640 1 --2- 172.21.15.2:0/2614944483 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbd240650c0 0x7fbd24067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:29.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.481+0000 7fbd3a000640 1 -- 172.21.15.2:0/2614944483 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbd34081260 con 0x7fbd440b1a70 2024-08-17T02:23:29.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.481+0000 7fbd42000640 1 --2- 172.21.15.2:0/2614944483 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbd240650c0 0x7fbd24067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:29.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.482+0000 7fbd42000640 1 --2- 172.21.15.2:0/2614944483 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbd240650c0 0x7fbd24067570 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbd30034000 tx=0x7fbd30032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:29.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.484+0000 7fbd3a000640 1 -- 172.21.15.2:0/2614944483 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbd3404f860 con 0x7fbd440b1a70 2024-08-17T02:23:29.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.668+0000 7fbd49c00640 1 -- 172.21.15.2:0/2614944483 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbd440cd150 con 0x7fbd440b1a70 2024-08-17T02:23:29.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.936+0000 7fbd3a000640 1 -- 172.21.15.2:0/2614944483 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbd34052e80 con 0x7fbd440b1a70 2024-08-17T02:23:29.936 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2024-08-17T02:23:29.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.940+0000 7fbd49c00640 1 -- 172.21.15.2:0/2614944483 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbd240650c0 msgr2=0x7fbd24067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:29.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.940+0000 7fbd49c00640 1 --2- 172.21.15.2:0/2614944483 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbd240650c0 0x7fbd24067570 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbd30034000 tx=0x7fbd30032000 comp rx=0 tx=0).stop 2024-08-17T02:23:29.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.940+0000 7fbd49c00640 1 -- 172.21.15.2:0/2614944483 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbd440b1a70 msgr2=0x7fbd44159370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:29.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.940+0000 7fbd49c00640 1 --2- 172.21.15.2:0/2614944483 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbd440b1a70 0x7fbd44159370 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400c5c0 tx=0x7fbd34007ee0 comp rx=0 tx=0).stop 2024-08-17T02:23:29.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.941+0000 7fbd49c00640 1 -- 172.21.15.2:0/2614944483 shutdown_connections 2024-08-17T02:23:29.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.941+0000 7fbd49c00640 1 --2- 172.21.15.2:0/2614944483 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbd240650c0 0x7fbd24067570 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:29.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.941+0000 7fbd49c00640 1 --2- 172.21.15.2:0/2614944483 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbd44158f80 0x7fbd441491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:29.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.941+0000 7fbd49c00640 1 --2- 172.21.15.2:0/2614944483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd44158bb0 0x7fbd4416c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:29.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.941+0000 7fbd49c00640 1 --2- 172.21.15.2:0/2614944483 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbd440b1a70 0x7fbd44159370 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:29.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.941+0000 7fbd49c00640 1 -- 172.21.15.2:0/2614944483 >> 172.21.15.2:0/2614944483 conn(0x7fbd4406e590 msgr2=0x7fbd44156c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:29.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.943+0000 7fbd49c00640 1 -- 172.21.15.2:0/2614944483 shutdown_connections 2024-08-17T02:23:29.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:29.944+0000 7fbd49c00640 1 -- 172.21.15.2:0/2614944483 wait complete. 2024-08-17T02:23:29.960 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:23:30.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.118+0000 7fc382c00640 1 Processor -- start 2024-08-17T02:23:30.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.118+0000 7fc382c00640 1 -- start start 2024-08-17T02:23:30.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.120+0000 7fc382c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc37c0aeae0 0x7fc37c0aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:30.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.120+0000 7fc382c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc37c0caf20 con 0x7fc37c0cfb40 2024-08-17T02:23:30.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.120+0000 7fc382c00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc37c0afe20 con 0x7fc37c0cf050 2024-08-17T02:23:30.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.120+0000 7fc382c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0b1560 con 0x7fc37c0aeae0 2024-08-17T02:23:30.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.120+0000 7fc380e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc37c0cfb40 0x7fc37c0ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44734/0 (socket says 172.21.15.2:44734) 2024-08-17T02:23:30.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.120+0000 7fc380e00640 1 -- 172.21.15.2:0/2286047083 learned_addr learned my addr 172.21.15.2:0/2286047083 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:30.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.120+0000 7fc381800640 1 --2- 172.21.15.2:0/2286047083 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc37c0aeae0 0x7fc37c0aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:30.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.120+0000 7fc37be00640 1 -- 172.21.15.2:0/2286047083 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115137777 0 0) 0x7fc37c0caf20 con 0x7fc37c0cfb40 2024-08-17T02:23:30.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.120+0000 7fc37be00640 1 -- 172.21.15.2:0/2286047083 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3640034e0 con 0x7fc37c0cfb40 2024-08-17T02:23:30.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.121+0000 7fc37be00640 1 -- 172.21.15.2:0/2286047083 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204809403 0 0) 0x7fc37c0afe20 con 0x7fc37c0cf050 2024-08-17T02:23:30.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.121+0000 7fc37be00640 1 -- 172.21.15.2:0/2286047083 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc37c0caf20 con 0x7fc37c0cf050 2024-08-17T02:23:30.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.121+0000 7fc37be00640 1 -- 172.21.15.2:0/2286047083 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1595903617 0 0) 0x7fc3640034e0 con 0x7fc37c0cfb40 2024-08-17T02:23:30.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.121+0000 7fc37be00640 1 -- 172.21.15.2:0/2286047083 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc37c0aeae0 msgr2=0x7fc37c0aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:30.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.121+0000 7fc37be00640 1 --2- 172.21.15.2:0/2286047083 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc37c0aeae0 0x7fc37c0aeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:30.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.121+0000 7fc37be00640 1 -- 172.21.15.2:0/2286047083 >> v1:172.21.15.145:6789/0 conn(0x7fc37c0cf050 legacy=0x7fc37c0b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:30.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.121+0000 7fc37be00640 1 -- 172.21.15.2:0/2286047083 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c0cf550 con 0x7fc37c0cfb40 2024-08-17T02:23:30.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.121+0000 7fc37be00640 1 -- 172.21.15.2:0/2286047083 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7fc368001470 con 0x7fc37c0cfb40 2024-08-17T02:23:30.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.121+0000 7fc381800640 1 --2- 172.21.15.2:0/2286047083 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc37c0aeae0 0x7fc37c0aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:30.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.121+0000 7fc37be00640 1 -- 172.21.15.2:0/2286047083 >> v1:172.21.15.2:6789/0 conn(0x7fc37c0cfb40 legacy=0x7fc37c0ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:30.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.121+0000 7fc37be00640 1 --2- 172.21.15.2:0/2286047083 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc37c0aeae0 0x7fc364003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:30.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.121+0000 7fc37be00640 1 --2- 172.21.15.2:0/2286047083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc364004120 0x7fc364004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:30.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.121+0000 7fc37be00640 1 --2- 172.21.15.2:0/2286047083 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc364004cc0 0x7fc364005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:30.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.121+0000 7fc37be00640 1 -- 172.21.15.2:0/2286047083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0b1560 con 0x7fc364004120 2024-08-17T02:23:30.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.121+0000 7fc37be00640 1 -- 172.21.15.2:0/2286047083 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36400bb60 con 0x7fc364004cc0 2024-08-17T02:23:30.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.121+0000 7fc37be00640 1 -- 172.21.15.2:0/2286047083 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36400bd20 con 0x7fc37c0aeae0 2024-08-17T02:23:30.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.121+0000 7fc380e00640 1 --2- 172.21.15.2:0/2286047083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc364004120 0x7fc364004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:30.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.121+0000 7fc382200640 1 --2- 172.21.15.2:0/2286047083 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc364004cc0 0x7fc364005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:30.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.121+0000 7fc381800640 1 --2- 172.21.15.2:0/2286047083 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc37c0aeae0 0x7fc364003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:30.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.121+0000 7fc380e00640 1 -- 172.21.15.2:0/2286047083 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc37c0aeae0 msgr2=0x7fc364003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:30.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.121+0000 7fc380e00640 1 --2- 172.21.15.2:0/2286047083 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc37c0aeae0 0x7fc364003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:30.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.121+0000 7fc380e00640 1 -- 172.21.15.2:0/2286047083 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc364004cc0 msgr2=0x7fc364005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:30.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.121+0000 7fc380e00640 1 --2- 172.21.15.2:0/2286047083 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc364004cc0 0x7fc364005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:30.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.121+0000 7fc380e00640 1 -- 172.21.15.2:0/2286047083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc370009390 con 0x7fc364004120 2024-08-17T02:23:30.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.122+0000 7fc380e00640 1 --2- 172.21.15.2:0/2286047083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc364004120 0x7fc364004780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc36800c190 tx=0x7fc368001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a136fd473d833e14 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:30.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.123+0000 7fc37be00640 1 -- 172.21.15.2:0/2286047083 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc368005960 con 0x7fc364004120 2024-08-17T02:23:30.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.123+0000 7fc37be00640 1 -- 172.21.15.2:0/2286047083 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36802d070 con 0x7fc364004120 2024-08-17T02:23:30.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.123+0000 7fc37be00640 1 -- 172.21.15.2:0/2286047083 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc368005b20 con 0x7fc364004120 2024-08-17T02:23:30.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.123+0000 7fc382c00640 1 -- 172.21.15.2:0/2286047083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc364004120 msgr2=0x7fc364004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:30.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.123+0000 7fc382c00640 1 --2- 172.21.15.2:0/2286047083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc364004120 0x7fc364004780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc36800c190 tx=0x7fc368001d40 comp rx=0 tx=0).stop 2024-08-17T02:23:30.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.123+0000 7fc382200640 1 -- 172.21.15.2:0/2286047083 reap_dead start 2024-08-17T02:23:30.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.123+0000 7fc382c00640 1 -- 172.21.15.2:0/2286047083 shutdown_connections 2024-08-17T02:23:30.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.123+0000 7fc382c00640 1 -- 172.21.15.2:0/2286047083 >> 172.21.15.2:0/2286047083 conn(0x7fc37c068470 msgr2=0x7fc37c068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:30.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.123+0000 7fc382c00640 1 -- 172.21.15.2:0/2286047083 shutdown_connections 2024-08-17T02:23:30.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.123+0000 7fc382c00640 1 -- 172.21.15.2:0/2286047083 wait complete. 2024-08-17T02:23:30.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.125+0000 7fc382c00640 1 Processor -- start 2024-08-17T02:23:30.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.125+0000 7fc382c00640 1 -- start start 2024-08-17T02:23:30.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.126+0000 7fc382c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc364004120 0x7fc37c0b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:30.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.126+0000 7fc382c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc37c0cdd30 0x7fc37c0ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:30.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.126+0000 7fc382c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc37c16c9e0 0x7fc37c16ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:30.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.126+0000 7fc382c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0c7d00 con 0x7fc364004120 2024-08-17T02:23:30.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.126+0000 7fc382c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0c7870 con 0x7fc37c16c9e0 2024-08-17T02:23:30.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.126+0000 7fc382c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0ce6c0 con 0x7fc37c0cdd30 2024-08-17T02:23:30.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.126+0000 7fc381800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc364004120 0x7fc37c0b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:30.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.126+0000 7fc381800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc364004120 0x7fc37c0b44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34732/0 (socket says 172.21.15.2:34732) 2024-08-17T02:23:30.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.126+0000 7fc381800640 1 -- 172.21.15.2:0/2559843949 learned_addr learned my addr 172.21.15.2:0/2559843949 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:30.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.126+0000 7fc382200640 1 --2- 172.21.15.2:0/2559843949 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc37c16c9e0 0x7fc37c16ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:30.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.126+0000 7fc380e00640 1 --2- 172.21.15.2:0/2559843949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc37c0cdd30 0x7fc37c0ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:30.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.126+0000 7fc381800640 1 -- 172.21.15.2:0/2559843949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc37c0cdd30 msgr2=0x7fc37c0ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:30.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.126+0000 7fc381800640 1 --2- 172.21.15.2:0/2559843949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc37c0cdd30 0x7fc37c0ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:30.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.126+0000 7fc381800640 1 -- 172.21.15.2:0/2559843949 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc37c16c9e0 msgr2=0x7fc37c16ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:30.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.126+0000 7fc381800640 1 --2- 172.21.15.2:0/2559843949 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc37c16c9e0 0x7fc37c16ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:30.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.126+0000 7fc381800640 1 -- 172.21.15.2:0/2559843949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c0c6c80 con 0x7fc364004120 2024-08-17T02:23:30.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.127+0000 7fc381800640 1 --2- 172.21.15.2:0/2559843949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc364004120 0x7fc37c0b44b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc370011da0 tx=0x7fc3700090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:30.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.127+0000 7fc378c00640 1 -- 172.21.15.2:0/2559843949 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37000fec0 con 0x7fc364004120 2024-08-17T02:23:30.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.127+0000 7fc378c00640 1 -- 172.21.15.2:0/2559843949 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc370011ea0 con 0x7fc364004120 2024-08-17T02:23:30.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.127+0000 7fc378c00640 1 -- 172.21.15.2:0/2559843949 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37001d690 con 0x7fc364004120 2024-08-17T02:23:30.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.127+0000 7fc382c00640 1 -- 172.21.15.2:0/2559843949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc37c0c6f40 con 0x7fc364004120 2024-08-17T02:23:30.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.127+0000 7fc382c00640 1 -- 172.21.15.2:0/2559843949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37c0c7500 con 0x7fc364004120 2024-08-17T02:23:30.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.128+0000 7fc382c00640 1 -- 172.21.15.2:0/2559843949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc37c070720 con 0x7fc364004120 2024-08-17T02:23:30.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.129+0000 7fc378c00640 1 -- 172.21.15.2:0/2559843949 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7fc37001da80 con 0x7fc364004120 2024-08-17T02:23:30.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.130+0000 7fc378c00640 1 --2- 172.21.15.2:0/2559843949 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc35c0650f0 0x7fc35c0675a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:30.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.130+0000 7fc378c00640 1 -- 172.21.15.2:0/2559843949 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fc370018070 con 0x7fc364004120 2024-08-17T02:23:30.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.130+0000 7fc380e00640 1 --2- 172.21.15.2:0/2559843949 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc35c0650f0 0x7fc35c0675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:30.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.131+0000 7fc380e00640 1 --2- 172.21.15.2:0/2559843949 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc35c0650f0 0x7fc35c0675a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc368032000 tx=0x7fc368033000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:30.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.134+0000 7fc378c00640 1 -- 172.21.15.2:0/2559843949 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc3700512c0 con 0x7fc364004120 2024-08-17T02:23:30.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.321+0000 7fc382c00640 1 -- 172.21.15.2:0/2559843949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc37c088850 con 0x7fc364004120 2024-08-17T02:23:30.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.944+0000 7fc378c00640 1 -- 172.21.15.2:0/2559843949 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc37001dd30 con 0x7fc364004120 2024-08-17T02:23:30.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.946+0000 7fc378c00640 1 -- 172.21.15.2:0/2559843949 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc3700512c0 con 0x7fc364004120 2024-08-17T02:23:30.947 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2024-08-17T02:23:30.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.953+0000 7fc382c00640 1 -- 172.21.15.2:0/2559843949 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc35c0650f0 msgr2=0x7fc35c0675a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:30.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.953+0000 7fc382c00640 1 --2- 172.21.15.2:0/2559843949 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc35c0650f0 0x7fc35c0675a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc368032000 tx=0x7fc368033000 comp rx=0 tx=0).stop 2024-08-17T02:23:30.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.953+0000 7fc382c00640 1 -- 172.21.15.2:0/2559843949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc364004120 msgr2=0x7fc37c0b44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:30.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.953+0000 7fc382c00640 1 --2- 172.21.15.2:0/2559843949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc364004120 0x7fc37c0b44b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc370011da0 tx=0x7fc3700090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:30.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.954+0000 7fc382c00640 1 -- 172.21.15.2:0/2559843949 shutdown_connections 2024-08-17T02:23:30.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.954+0000 7fc382c00640 1 --2- 172.21.15.2:0/2559843949 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc37c16c9e0 0x7fc37c16ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:30.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.954+0000 7fc382c00640 1 --2- 172.21.15.2:0/2559843949 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc35c0650f0 0x7fc35c0675a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:30.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.954+0000 7fc382c00640 1 --2- 172.21.15.2:0/2559843949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc37c0cdd30 0x7fc37c0ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:30.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.954+0000 7fc382c00640 1 --2- 172.21.15.2:0/2559843949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc364004120 0x7fc37c0b44b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:30.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.954+0000 7fc382c00640 1 -- 172.21.15.2:0/2559843949 >> 172.21.15.2:0/2559843949 conn(0x7fc37c068470 msgr2=0x7fc37c1585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:30.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.955+0000 7fc382c00640 1 -- 172.21.15.2:0/2559843949 shutdown_connections 2024-08-17T02:23:30.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:30.955+0000 7fc382c00640 1 -- 172.21.15.2:0/2559843949 wait complete. 2024-08-17T02:23:30.987 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:23:31.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.144+0000 7f3fd2a00640 1 Processor -- start 2024-08-17T02:23:31.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.144+0000 7f3fd2a00640 1 -- start start 2024-08-17T02:23:31.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.145+0000 7f3fd2a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fcc0aea20 0x7f3fcc0aee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:31.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.145+0000 7f3fd2a00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3fcc0ca8e0 0x7f3fcc0cad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:31.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.145+0000 7f3fd2a00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fcc0af370 con 0x7f3fcc158b90 2024-08-17T02:23:31.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.145+0000 7f3fd2a00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fcc0afd20 con 0x7f3fcc0ca8e0 2024-08-17T02:23:31.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.145+0000 7f3fd2a00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc0affe0 con 0x7f3fcc0aea20 2024-08-17T02:23:31.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.146+0000 7f3fcb400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fcc0aea20 0x7f3fcc0aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:31.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.146+0000 7f3fcbe00640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f3fcc158b90 0x7f3fcc0b1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:48336/0 (socket says 172.21.15.2:48336) 2024-08-17T02:23:31.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.146+0000 7f3fcbe00640 1 -- 172.21.15.2:0/3005855840 learned_addr learned my addr 172.21.15.2:0/3005855840 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:31.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.146+0000 7f3fd0a00640 1 --2- 172.21.15.2:0/3005855840 >> v2:172.21.15.145:3300/0 conn(0x7f3fcc0ca8e0 0x7f3fcc0cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:31.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.146+0000 7f3fcaa00640 1 -- 172.21.15.2:0/3005855840 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633545860 0 0) 0x7f3fcc0af370 con 0x7f3fcc158b90 2024-08-17T02:23:31.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.146+0000 7f3fcaa00640 1 -- 172.21.15.2:0/3005855840 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fb00034e0 con 0x7f3fcc158b90 2024-08-17T02:23:31.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.146+0000 7f3fcb400640 1 -- 172.21.15.2:0/3005855840 >> v2:172.21.15.145:3300/0 conn(0x7f3fcc0ca8e0 msgr2=0x7f3fcc0cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:31.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.146+0000 7f3fcb400640 1 --2- 172.21.15.2:0/3005855840 >> v2:172.21.15.145:3300/0 conn(0x7f3fcc0ca8e0 0x7f3fcc0cad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.146+0000 7f3fcb400640 1 -- 172.21.15.2:0/3005855840 >> v1:172.21.15.145:6789/0 conn(0x7f3fcc158b90 legacy=0x7f3fcc0b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:31.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.146+0000 7f3fcb400640 1 -- 172.21.15.2:0/3005855840 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fcc0b02c0 con 0x7f3fcc0aea20 2024-08-17T02:23:31.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.146+0000 7f3fd0a00640 1 --2- 172.21.15.2:0/3005855840 >> v2:172.21.15.145:3300/0 conn(0x7f3fcc0ca8e0 0x7f3fcc0cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:31.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.147+0000 7f3fcb400640 1 --2- 172.21.15.2:0/3005855840 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fcc0aea20 0x7f3fcc0aee30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8009850 tx=0x7f3fb80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62f895dcd08cd500 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:31.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.147+0000 7f3fcaa00640 1 -- 172.21.15.2:0/3005855840 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb802ad80 con 0x7f3fcc0aea20 2024-08-17T02:23:31.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.147+0000 7f3fcaa00640 1 -- 172.21.15.2:0/3005855840 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb8032440 con 0x7f3fcc0aea20 2024-08-17T02:23:31.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.147+0000 7f3fcaa00640 1 -- 172.21.15.2:0/3005855840 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8032820 con 0x7f3fcc0aea20 2024-08-17T02:23:31.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.148+0000 7f3fd2a00640 1 -- 172.21.15.2:0/3005855840 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fcc0aea20 msgr2=0x7f3fcc0aee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:31.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.148+0000 7f3fd2a00640 1 --2- 172.21.15.2:0/3005855840 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fcc0aea20 0x7f3fcc0aee30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8009850 tx=0x7f3fb80090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.148+0000 7f3fd2a00640 1 -- 172.21.15.2:0/3005855840 shutdown_connections 2024-08-17T02:23:31.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.148+0000 7f3fd2a00640 1 --2- 172.21.15.2:0/3005855840 >> v2:172.21.15.145:3300/0 conn(0x7f3fcc0ca8e0 0x7f3fcc0cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.148+0000 7f3fd2a00640 1 --2- 172.21.15.2:0/3005855840 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fcc0aea20 0x7f3fcc0aee30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.148+0000 7f3fd2a00640 1 -- 172.21.15.2:0/3005855840 >> 172.21.15.2:0/3005855840 conn(0x7f3fcc06e590 msgr2=0x7f3fcc06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:31.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.148+0000 7f3fd2a00640 1 -- 172.21.15.2:0/3005855840 shutdown_connections 2024-08-17T02:23:31.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.148+0000 7f3fd2a00640 1 -- 172.21.15.2:0/3005855840 wait complete. 2024-08-17T02:23:31.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.150+0000 7f3fd2a00640 1 Processor -- start 2024-08-17T02:23:31.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.150+0000 7f3fd2a00640 1 -- start start 2024-08-17T02:23:31.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.151+0000 7f3fd2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fcc0aea20 0x7f3fcc0c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:31.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.151+0000 7f3fd2a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fcc0ca8e0 0x7f3fcc15c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:31.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.151+0000 7f3fd2a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fcc158b90 0x7f3fcc158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:31.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.151+0000 7f3fd2a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc15cd60 con 0x7f3fcc0aea20 2024-08-17T02:23:31.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.151+0000 7f3fd2a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc15cf90 con 0x7f3fcc158b90 2024-08-17T02:23:31.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.151+0000 7f3fd2a00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc15d270 con 0x7f3fcc0ca8e0 2024-08-17T02:23:31.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.151+0000 7f3fcbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fcc0aea20 0x7f3fcc0c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:31.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.151+0000 7f3fcbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fcc0aea20 0x7f3fcc0c7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34738/0 (socket says 172.21.15.2:34738) 2024-08-17T02:23:31.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.151+0000 7f3fcbe00640 1 -- 172.21.15.2:0/307871212 learned_addr learned my addr 172.21.15.2:0/307871212 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:31.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.151+0000 7f3fd0a00640 1 --2- 172.21.15.2:0/307871212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fcc158b90 0x7f3fcc158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:31.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.151+0000 7f3fcb400640 1 --2- 172.21.15.2:0/307871212 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fcc0ca8e0 0x7f3fcc15c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:31.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.151+0000 7f3fcbe00640 1 -- 172.21.15.2:0/307871212 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fcc0ca8e0 msgr2=0x7f3fcc15c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:31.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.151+0000 7f3fcbe00640 1 --2- 172.21.15.2:0/307871212 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fcc0ca8e0 0x7f3fcc15c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.151+0000 7f3fcbe00640 1 -- 172.21.15.2:0/307871212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fcc158b90 msgr2=0x7f3fcc158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:31.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.151+0000 7f3fcbe00640 1 --2- 172.21.15.2:0/307871212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fcc158b90 0x7f3fcc158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.151+0000 7f3fcbe00640 1 -- 172.21.15.2:0/307871212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc4009a20 con 0x7f3fcc0aea20 2024-08-17T02:23:31.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.152+0000 7f3fcbe00640 1 --2- 172.21.15.2:0/307871212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fcc0aea20 0x7f3fcc0c7d60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00c5b0 tx=0x7f3fbc007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:31.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.152+0000 7f3fc3400640 1 -- 172.21.15.2:0/307871212 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc005b70 con 0x7f3fcc0aea20 2024-08-17T02:23:31.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.152+0000 7f3fc3400640 1 -- 172.21.15.2:0/307871212 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fbc005cf0 con 0x7f3fcc0aea20 2024-08-17T02:23:31.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.152+0000 7f3fc3400640 1 -- 172.21.15.2:0/307871212 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc007320 con 0x7f3fcc0aea20 2024-08-17T02:23:31.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.152+0000 7f3fd2a00640 1 -- 172.21.15.2:0/307871212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb8009390 con 0x7f3fcc0aea20 2024-08-17T02:23:31.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.152+0000 7f3fd2a00640 1 -- 172.21.15.2:0/307871212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fcc15d830 con 0x7f3fcc0aea20 2024-08-17T02:23:31.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.153+0000 7f3fd2a00640 1 -- 172.21.15.2:0/307871212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fcc0af340 con 0x7f3fcc0aea20 2024-08-17T02:23:31.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.154+0000 7f3fc3400640 1 -- 172.21.15.2:0/307871212 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3fbc01b3b0 con 0x7f3fcc0aea20 2024-08-17T02:23:31.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.155+0000 7f3fc3400640 1 --2- 172.21.15.2:0/307871212 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3fac065150 0x7f3fac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:31.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.155+0000 7f3fc3400640 1 -- 172.21.15.2:0/307871212 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f3fbc081920 con 0x7f3fcc0aea20 2024-08-17T02:23:31.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.156+0000 7f3fcb400640 1 --2- 172.21.15.2:0/307871212 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3fac065150 0x7f3fac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:31.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.156+0000 7f3fcb400640 1 --2- 172.21.15.2:0/307871212 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3fac065150 0x7f3fac067600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8034000 tx=0x7f3fb8032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:31.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.160+0000 7f3fc3400640 1 -- 172.21.15.2:0/307871212 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3fbc04fb10 con 0x7f3fcc0aea20 2024-08-17T02:23:31.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.377+0000 7f3fd2a00640 1 -- 172.21.15.2:0/307871212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3fcc063fb0 con 0x7f3fcc0aea20 2024-08-17T02:23:31.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.944+0000 7f3fc3400640 1 -- 172.21.15.2:0/307871212 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3fbc017020 con 0x7f3fcc0aea20 2024-08-17T02:23:31.945 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 2 and data pool 3 2024-08-17T02:23:31.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.955+0000 7f3fd2a00640 1 -- 172.21.15.2:0/307871212 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3fac065150 msgr2=0x7f3fac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:31.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.955+0000 7f3fd2a00640 1 --2- 172.21.15.2:0/307871212 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3fac065150 0x7f3fac067600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8034000 tx=0x7f3fb8032000 comp rx=0 tx=0).stop 2024-08-17T02:23:31.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.955+0000 7f3fd2a00640 1 -- 172.21.15.2:0/307871212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fcc0aea20 msgr2=0x7f3fcc0c7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:31.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.955+0000 7f3fd2a00640 1 --2- 172.21.15.2:0/307871212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fcc0aea20 0x7f3fcc0c7d60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00c5b0 tx=0x7f3fbc007d70 comp rx=0 tx=0).stop 2024-08-17T02:23:31.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.956+0000 7f3fd2a00640 1 -- 172.21.15.2:0/307871212 shutdown_connections 2024-08-17T02:23:31.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.956+0000 7f3fd2a00640 1 --2- 172.21.15.2:0/307871212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fcc158b90 0x7f3fcc158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.956+0000 7f3fd2a00640 1 --2- 172.21.15.2:0/307871212 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3fac065150 0x7f3fac067600 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.956+0000 7f3fd2a00640 1 --2- 172.21.15.2:0/307871212 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fcc0ca8e0 0x7f3fcc15c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.956+0000 7f3fd2a00640 1 --2- 172.21.15.2:0/307871212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fcc0aea20 0x7f3fcc0c7d60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.956+0000 7f3fd2a00640 1 -- 172.21.15.2:0/307871212 >> 172.21.15.2:0/307871212 conn(0x7f3fcc06e590 msgr2=0x7f3fcc0b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:31.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.957+0000 7f3fd2a00640 1 -- 172.21.15.2:0/307871212 shutdown_connections 2024-08-17T02:23:31.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:31.957+0000 7f3fd2a00640 1 -- 172.21.15.2:0/307871212 wait complete. 2024-08-17T02:23:31.993 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:32.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.146+0000 7faed8000640 1 Processor -- start 2024-08-17T02:23:32.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.146+0000 7faed8000640 1 -- start start 2024-08-17T02:23:32.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.147+0000 7faed8000640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7faed00afca0 0x7faed00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.148+0000 7faed8000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed00c92b0 con 0x7faed01590b0 2024-08-17T02:23:32.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.148+0000 7faed8000640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed00ad480 con 0x7faed00acf10 2024-08-17T02:23:32.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.148+0000 7faed8000640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed00b0980 con 0x7faed00afca0 2024-08-17T02:23:32.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.148+0000 7faed6000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7faed01590b0 0x7faed00c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44740/0 (socket says 172.21.15.2:44740) 2024-08-17T02:23:32.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.148+0000 7faed6000640 1 -- 172.21.15.2:0/1125224344 learned_addr learned my addr 172.21.15.2:0/1125224344 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:32.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.148+0000 7faed5600640 1 --2- 172.21.15.2:0/1125224344 >> v2:172.21.15.145:3300/0 conn(0x7faed00afca0 0x7faed00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.148+0000 7faecfe00640 1 -- 172.21.15.2:0/1125224344 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718235768 0 0) 0x7faed00c92b0 con 0x7faed01590b0 2024-08-17T02:23:32.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.148+0000 7faecfe00640 1 -- 172.21.15.2:0/1125224344 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeb80034e0 con 0x7faed01590b0 2024-08-17T02:23:32.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.148+0000 7faecfe00640 1 -- 172.21.15.2:0/1125224344 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1230231253 0 0) 0x7faed00ad480 con 0x7faed00acf10 2024-08-17T02:23:32.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.148+0000 7faecfe00640 1 -- 172.21.15.2:0/1125224344 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faed00c92b0 con 0x7faed00acf10 2024-08-17T02:23:32.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.148+0000 7faecfe00640 1 -- 172.21.15.2:0/1125224344 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 283391991 0 0) 0x7faeb80034e0 con 0x7faed01590b0 2024-08-17T02:23:32.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.149+0000 7faecfe00640 1 -- 172.21.15.2:0/1125224344 >> v2:172.21.15.145:3300/0 conn(0x7faed00afca0 msgr2=0x7faed00b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:32.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.149+0000 7faecfe00640 1 --2- 172.21.15.2:0/1125224344 >> v2:172.21.15.145:3300/0 conn(0x7faed00afca0 0x7faed00b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.149+0000 7faecfe00640 1 -- 172.21.15.2:0/1125224344 >> v1:172.21.15.145:6789/0 conn(0x7faed00acf10 legacy=0x7faed01589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.149+0000 7faecfe00640 1 -- 172.21.15.2:0/1125224344 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed00ad760 con 0x7faed01590b0 2024-08-17T02:23:32.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.149+0000 7faecfe00640 1 -- 172.21.15.2:0/1125224344 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7faec80017f0 con 0x7faed01590b0 2024-08-17T02:23:32.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.149+0000 7faecfe00640 1 -- 172.21.15.2:0/1125224344 >> v1:172.21.15.2:6789/0 conn(0x7faed01590b0 legacy=0x7faed00c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.149+0000 7faecfe00640 1 --2- 172.21.15.2:0/1125224344 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faeb8003bb0 0x7faeb8003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.149+0000 7faecfe00640 1 --2- 172.21.15.2:0/1125224344 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faeb8004780 0x7faeb8004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.149+0000 7faecfe00640 1 --2- 172.21.15.2:0/1125224344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeb8005180 0x7faeb800dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.149+0000 7faecfe00640 1 -- 172.21.15.2:0/1125224344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb800e2b0 con 0x7faeb8005180 2024-08-17T02:23:32.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.149+0000 7faecfe00640 1 -- 172.21.15.2:0/1125224344 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb800e3f0 con 0x7faeb8004780 2024-08-17T02:23:32.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.149+0000 7faecfe00640 1 -- 172.21.15.2:0/1125224344 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb800e580 con 0x7faeb8003bb0 2024-08-17T02:23:32.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.149+0000 7faed6000640 1 --2- 172.21.15.2:0/1125224344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeb8005180 0x7faeb800dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.149+0000 7faed5600640 1 --2- 172.21.15.2:0/1125224344 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faeb8003bb0 0x7faeb8003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.149+0000 7faed4c00640 1 --2- 172.21.15.2:0/1125224344 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faeb8004780 0x7faeb8004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.149+0000 7faed6000640 1 -- 172.21.15.2:0/1125224344 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faeb8003bb0 msgr2=0x7faeb8003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:32.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.149+0000 7faed6000640 1 --2- 172.21.15.2:0/1125224344 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faeb8003bb0 0x7faeb8003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.149+0000 7faed6000640 1 -- 172.21.15.2:0/1125224344 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faeb8004780 msgr2=0x7faeb8004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:32.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.149+0000 7faed6000640 1 --2- 172.21.15.2:0/1125224344 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faeb8004780 0x7faeb8004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.149+0000 7faed6000640 1 -- 172.21.15.2:0/1125224344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb80034e0 con 0x7faeb8005180 2024-08-17T02:23:32.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.150+0000 7faed6000640 1 -- 172.21.15.2:0/1125224344 reap_dead start 2024-08-17T02:23:32.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.150+0000 7faed6000640 1 --2- 172.21.15.2:0/1125224344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeb8005180 0x7faeb800dbe0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faec800a800 tx=0x7faed00c9220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5b6bcff89c61c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:32.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.151+0000 7faecfe00640 1 -- 172.21.15.2:0/1125224344 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec8033070 con 0x7faeb8005180 2024-08-17T02:23:32.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.151+0000 7faecfe00640 1 -- 172.21.15.2:0/1125224344 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec80071c0 con 0x7faeb8005180 2024-08-17T02:23:32.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.151+0000 7faecfe00640 1 -- 172.21.15.2:0/1125224344 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec80075a0 con 0x7faeb8005180 2024-08-17T02:23:32.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.151+0000 7faed8000640 1 -- 172.21.15.2:0/1125224344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeb8005180 msgr2=0x7faeb800dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.151+0000 7faed8000640 1 --2- 172.21.15.2:0/1125224344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeb8005180 0x7faeb800dbe0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faec800a800 tx=0x7faed00c9220 comp rx=0 tx=0).stop 2024-08-17T02:23:32.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.151+0000 7faed8000640 1 -- 172.21.15.2:0/1125224344 shutdown_connections 2024-08-17T02:23:32.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.151+0000 7faed8000640 1 --2- 172.21.15.2:0/1125224344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeb8005180 0x7faeb800dbe0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.151+0000 7faed8000640 1 -- 172.21.15.2:0/1125224344 >> 172.21.15.2:0/1125224344 conn(0x7faed0066e60 msgr2=0x7faed0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:32.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.151+0000 7faed8000640 1 -- 172.21.15.2:0/1125224344 shutdown_connections 2024-08-17T02:23:32.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.151+0000 7faed8000640 1 -- 172.21.15.2:0/1125224344 wait complete. 2024-08-17T02:23:32.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.153+0000 7faed8000640 1 Processor -- start 2024-08-17T02:23:32.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.153+0000 7faed8000640 1 -- start start 2024-08-17T02:23:32.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.154+0000 7faed8000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faeb8005180 0x7faed015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.154+0000 7faed8000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faed014dc90 0x7faed014f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.154+0000 7faed8000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faed014fd80 0x7faed014c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.154+0000 7faed8000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed015b470 con 0x7faed014dc90 2024-08-17T02:23:32.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.154+0000 7faed8000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed015a930 con 0x7faed014fd80 2024-08-17T02:23:32.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.154+0000 7faed8000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed015abd0 con 0x7faeb8005180 2024-08-17T02:23:32.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.154+0000 7faed4c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faed014dc90 0x7faed014f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.154+0000 7faed4c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faed014dc90 0x7faed014f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34758/0 (socket says 172.21.15.2:34758) 2024-08-17T02:23:32.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.154+0000 7faed4c00640 1 -- 172.21.15.2:0/502961254 learned_addr learned my addr 172.21.15.2:0/502961254 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:32.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.154+0000 7faed4c00640 1 -- 172.21.15.2:0/502961254 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faeb8005180 msgr2=0x7faed015a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.154+0000 7faed4c00640 1 --2- 172.21.15.2:0/502961254 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faeb8005180 0x7faed015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.154+0000 7faed4c00640 1 -- 172.21.15.2:0/502961254 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faed014fd80 msgr2=0x7faed014c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.154+0000 7faed4c00640 1 --2- 172.21.15.2:0/502961254 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faed014fd80 0x7faed014c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.154+0000 7faed4c00640 1 -- 172.21.15.2:0/502961254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed015aeb0 con 0x7faed014dc90 2024-08-17T02:23:32.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.155+0000 7faed4c00640 1 --2- 172.21.15.2:0/502961254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faed014dc90 0x7faed014f840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faebc002ac0 tx=0x7faebc007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:32.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.155+0000 7faeccc00640 1 -- 172.21.15.2:0/502961254 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc00fa70 con 0x7faed014dc90 2024-08-17T02:23:32.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.155+0000 7faeccc00640 1 -- 172.21.15.2:0/502961254 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc00fbd0 con 0x7faed014dc90 2024-08-17T02:23:32.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.155+0000 7faeccc00640 1 -- 172.21.15.2:0/502961254 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc007050 con 0x7faed014dc90 2024-08-17T02:23:32.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.155+0000 7faed8000640 1 -- 172.21.15.2:0/502961254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed015b190 con 0x7faed014dc90 2024-08-17T02:23:32.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.155+0000 7faed8000640 1 -- 172.21.15.2:0/502961254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed014c6b0 con 0x7faed014dc90 2024-08-17T02:23:32.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.156+0000 7faed8000640 1 -- 172.21.15.2:0/502961254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed0063fb0 con 0x7faed014dc90 2024-08-17T02:23:32.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.157+0000 7faeccc00640 1 -- 172.21.15.2:0/502961254 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7faebc0073c0 con 0x7faed014dc90 2024-08-17T02:23:32.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.158+0000 7faeccc00640 1 --2- 172.21.15.2:0/502961254 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7faeb0065180 0x7faeb0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.158+0000 7faeccc00640 1 -- 172.21.15.2:0/502961254 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faebc082820 con 0x7faed014dc90 2024-08-17T02:23:32.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.158+0000 7faed5600640 1 --2- 172.21.15.2:0/502961254 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7faeb0065180 0x7faeb0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.159+0000 7faed5600640 1 --2- 172.21.15.2:0/502961254 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7faeb0065180 0x7faeb0067630 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faec4006e20 tx=0x7faec40090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:32.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.162+0000 7faeccc00640 1 -- 172.21.15.2:0/502961254 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7faebc050840 con 0x7faed014dc90 2024-08-17T02:23:32.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.345+0000 7faed8000640 1 -- 172.21.15.2:0/502961254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faed0067b70 con 0x7faed014dc90 2024-08-17T02:23:32.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.346+0000 7faeccc00640 1 -- 172.21.15.2:0/502961254 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15315 (secure 0 0 0) 0x7faebc053e60 con 0x7faed014dc90 2024-08-17T02:23:32.346 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:32.346 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:23:31.378324+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:29.708835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:30.361908+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:32.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.348+0000 7faed8000640 1 -- 172.21.15.2:0/502961254 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7faeb0065180 msgr2=0x7faeb0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.348+0000 7faed8000640 1 --2- 172.21.15.2:0/502961254 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7faeb0065180 0x7faeb0067630 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faec4006e20 tx=0x7faec40090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.348+0000 7faed8000640 1 -- 172.21.15.2:0/502961254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faed014dc90 msgr2=0x7faed014f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.348+0000 7faed8000640 1 --2- 172.21.15.2:0/502961254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faed014dc90 0x7faed014f840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faebc002ac0 tx=0x7faebc007ca0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.348+0000 7faed8000640 1 -- 172.21.15.2:0/502961254 shutdown_connections 2024-08-17T02:23:32.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.348+0000 7faed8000640 1 --2- 172.21.15.2:0/502961254 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faed014fd80 0x7faed014c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.348+0000 7faed8000640 1 --2- 172.21.15.2:0/502961254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faed014dc90 0x7faed014f840 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.348+0000 7faed8000640 1 --2- 172.21.15.2:0/502961254 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7faeb0065180 0x7faeb0067630 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.348+0000 7faed8000640 1 --2- 172.21.15.2:0/502961254 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faeb8005180 0x7faed015a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.348+0000 7faed8000640 1 -- 172.21.15.2:0/502961254 >> 172.21.15.2:0/502961254 conn(0x7faed0066e60 msgr2=0x7faed006b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.348+0000 7faed8000640 1 -- 172.21.15.2:0/502961254 shutdown_connections 2024-08-17T02:23:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.348+0000 7faed8000640 1 -- 172.21.15.2:0/502961254 wait complete. 2024-08-17T02:23:32.363 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:32.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.513+0000 7fafa2800640 1 Processor -- start 2024-08-17T02:23:32.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.513+0000 7fafa2800640 1 -- start start 2024-08-17T02:23:32.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.515+0000 7fafa2800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf9c0afca0 0x7faf9c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.515+0000 7fafa2800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf9c0acf10 0x7faf9c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.515+0000 7fafa2800640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7faf9c1589a0 0x7faf9c158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.515+0000 7fafa2800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf9c0b0980 con 0x7faf9c0acf10 2024-08-17T02:23:32.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.515+0000 7fafa2800640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf9c15a4e0 con 0x7faf9c1589a0 2024-08-17T02:23:32.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.515+0000 7fafa2800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c0c92b0 con 0x7faf9c0afca0 2024-08-17T02:23:32.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.515+0000 7faf93e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf9c0acf10 0x7faf9c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.515+0000 7faf93e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf9c0acf10 0x7faf9c159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34760/0 (socket says 172.21.15.2:34760) 2024-08-17T02:23:32.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.515+0000 7faf93e00640 1 -- 172.21.15.2:0/2053827922 learned_addr learned my addr 172.21.15.2:0/2053827922 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:32.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.515+0000 7faf9be00640 1 --2- 172.21.15.2:0/2053827922 >> v2:172.21.15.145:3300/0 conn(0x7faf9c1589a0 0x7faf9c158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.515+0000 7faf9b400640 1 --2- 172.21.15.2:0/2053827922 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf9c0afca0 0x7faf9c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.515+0000 7faf93e00640 1 -- 172.21.15.2:0/2053827922 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf9c0afca0 msgr2=0x7faf9c0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:32.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.515+0000 7faf93e00640 1 --2- 172.21.15.2:0/2053827922 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf9c0afca0 0x7faf9c0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.515+0000 7faf93e00640 1 -- 172.21.15.2:0/2053827922 >> v2:172.21.15.145:3300/0 conn(0x7faf9c1589a0 msgr2=0x7faf9c158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:32.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.515+0000 7faf93e00640 1 --2- 172.21.15.2:0/2053827922 >> v2:172.21.15.145:3300/0 conn(0x7faf9c1589a0 0x7faf9c158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.515+0000 7faf93e00640 1 -- 172.21.15.2:0/2053827922 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c159360 con 0x7faf9c0acf10 2024-08-17T02:23:32.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.516+0000 7faf93e00640 1 --2- 172.21.15.2:0/2053827922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf9c0acf10 0x7faf9c159fa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faf8400bbc0 tx=0x7faf8400b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb434d0791eb64f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:32.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.517+0000 7faf9aa00640 1 -- 172.21.15.2:0/2053827922 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84032620 con 0x7faf9c0acf10 2024-08-17T02:23:32.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.517+0000 7faf9aa00640 1 -- 172.21.15.2:0/2053827922 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8402e040 con 0x7faf9c0acf10 2024-08-17T02:23:32.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.517+0000 7faf9aa00640 1 -- 172.21.15.2:0/2053827922 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf840329f0 con 0x7faf9c0acf10 2024-08-17T02:23:32.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.517+0000 7fafa2800640 1 -- 172.21.15.2:0/2053827922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf9c0acf10 msgr2=0x7faf9c159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.517+0000 7fafa2800640 1 --2- 172.21.15.2:0/2053827922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf9c0acf10 0x7faf9c159fa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faf8400bbc0 tx=0x7faf8400b460 comp rx=0 tx=0).stop 2024-08-17T02:23:32.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.517+0000 7fafa2800640 1 -- 172.21.15.2:0/2053827922 shutdown_connections 2024-08-17T02:23:32.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.517+0000 7fafa2800640 1 --2- 172.21.15.2:0/2053827922 >> v2:172.21.15.145:3300/0 conn(0x7faf9c1589a0 0x7faf9c158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.517+0000 7fafa2800640 1 --2- 172.21.15.2:0/2053827922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf9c0acf10 0x7faf9c159fa0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.517+0000 7fafa2800640 1 --2- 172.21.15.2:0/2053827922 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf9c0afca0 0x7faf9c0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.517+0000 7fafa2800640 1 -- 172.21.15.2:0/2053827922 >> 172.21.15.2:0/2053827922 conn(0x7faf9c066e60 msgr2=0x7faf9c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:32.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.517+0000 7fafa2800640 1 -- 172.21.15.2:0/2053827922 shutdown_connections 2024-08-17T02:23:32.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.518+0000 7fafa2800640 1 -- 172.21.15.2:0/2053827922 wait complete. 2024-08-17T02:23:32.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.519+0000 7fafa2800640 1 Processor -- start 2024-08-17T02:23:32.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.519+0000 7fafa2800640 1 -- start start 2024-08-17T02:23:32.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.520+0000 7fafa2800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf9c0acf10 0x7faf9c168ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.520+0000 7fafa2800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf9c0afca0 0x7faf9c0c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.520+0000 7fafa2800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf9c1589a0 0x7faf9c16bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.520+0000 7fafa2800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c0c4bf0 con 0x7faf9c0afca0 2024-08-17T02:23:32.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.520+0000 7fafa2800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c169430 con 0x7faf9c0acf10 2024-08-17T02:23:32.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.520+0000 7fafa2800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c0c7440 con 0x7faf9c1589a0 2024-08-17T02:23:32.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.520+0000 7faf93e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf9c0afca0 0x7faf9c0c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.520+0000 7faf93e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf9c0afca0 0x7faf9c0c6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34762/0 (socket says 172.21.15.2:34762) 2024-08-17T02:23:32.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.520+0000 7faf93e00640 1 -- 172.21.15.2:0/3058676056 learned_addr learned my addr 172.21.15.2:0/3058676056 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:32.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.520+0000 7faf9b400640 1 --2- 172.21.15.2:0/3058676056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf9c0acf10 0x7faf9c168ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.520+0000 7faf9be00640 1 --2- 172.21.15.2:0/3058676056 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf9c1589a0 0x7faf9c16bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.520+0000 7faf93e00640 1 -- 172.21.15.2:0/3058676056 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf9c1589a0 msgr2=0x7faf9c16bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.520+0000 7faf93e00640 1 --2- 172.21.15.2:0/3058676056 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf9c1589a0 0x7faf9c16bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.520+0000 7faf93e00640 1 -- 172.21.15.2:0/3058676056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf9c0acf10 msgr2=0x7faf9c168ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.520+0000 7faf93e00640 1 --2- 172.21.15.2:0/3058676056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf9c0acf10 0x7faf9c168ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.520+0000 7faf93e00640 1 -- 172.21.15.2:0/3058676056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8400b700 con 0x7faf9c0afca0 2024-08-17T02:23:32.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.521+0000 7faf93e00640 1 --2- 172.21.15.2:0/3058676056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf9c0afca0 0x7faf9c0c6f00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faf8400b4a0 tx=0x7faf8403a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:32.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.521+0000 7faf92a00640 1 -- 172.21.15.2:0/3058676056 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84032e20 con 0x7faf9c0afca0 2024-08-17T02:23:32.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.521+0000 7faf92a00640 1 -- 172.21.15.2:0/3058676056 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8403ba80 con 0x7faf9c0afca0 2024-08-17T02:23:32.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.521+0000 7faf92a00640 1 -- 172.21.15.2:0/3058676056 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8403be40 con 0x7faf9c0afca0 2024-08-17T02:23:32.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.521+0000 7fafa2800640 1 -- 172.21.15.2:0/3058676056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf9c169640 con 0x7faf9c0afca0 2024-08-17T02:23:32.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.521+0000 7fafa2800640 1 -- 172.21.15.2:0/3058676056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9c169ee0 con 0x7faf9c0afca0 2024-08-17T02:23:32.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.522+0000 7fafa2800640 1 -- 172.21.15.2:0/3058676056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf9c0c4d60 con 0x7faf9c0afca0 2024-08-17T02:23:32.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.523+0000 7faf92a00640 1 -- 172.21.15.2:0/3058676056 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7faf8403c430 con 0x7faf9c0afca0 2024-08-17T02:23:32.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.524+0000 7faf92a00640 1 --2- 172.21.15.2:0/3058676056 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7faf78065220 0x7faf780676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.524+0000 7faf92a00640 1 -- 172.21.15.2:0/3058676056 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faf84042030 con 0x7faf9c0afca0 2024-08-17T02:23:32.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.524+0000 7faf9b400640 1 --2- 172.21.15.2:0/3058676056 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7faf78065220 0x7faf780676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.525+0000 7faf9b400640 1 --2- 172.21.15.2:0/3058676056 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7faf78065220 0x7faf780676d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faf9c154190 tx=0x7faf8c0090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:32.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.528+0000 7faf92a00640 1 -- 172.21.15.2:0/3058676056 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7faf9c0c4d60 con 0x7faf9c0afca0 2024-08-17T02:23:32.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.709+0000 7fafa2800640 1 -- 172.21.15.2:0/3058676056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf9c0c4d30 con 0x7faf9c0afca0 2024-08-17T02:23:32.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.710+0000 7faf92a00640 1 -- 172.21.15.2:0/3058676056 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15315 (secure 0 0 0) 0x7faf84036090 con 0x7faf9c0afca0 2024-08-17T02:23:32.710 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:32.710 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:23:31.378324+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:29.708835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:30.361908+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.712+0000 7fafa2800640 1 -- 172.21.15.2:0/3058676056 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7faf78065220 msgr2=0x7faf780676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.712+0000 7fafa2800640 1 --2- 172.21.15.2:0/3058676056 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7faf78065220 0x7faf780676d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faf9c154190 tx=0x7faf8c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.712+0000 7fafa2800640 1 -- 172.21.15.2:0/3058676056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf9c0afca0 msgr2=0x7faf9c0c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.712+0000 7fafa2800640 1 --2- 172.21.15.2:0/3058676056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf9c0afca0 0x7faf9c0c6f00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faf8400b4a0 tx=0x7faf8403a000 comp rx=0 tx=0).stop 2024-08-17T02:23:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.712+0000 7fafa2800640 1 -- 172.21.15.2:0/3058676056 shutdown_connections 2024-08-17T02:23:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.712+0000 7fafa2800640 1 --2- 172.21.15.2:0/3058676056 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7faf78065220 0x7faf780676d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.712+0000 7fafa2800640 1 --2- 172.21.15.2:0/3058676056 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf9c1589a0 0x7faf9c16bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.712+0000 7fafa2800640 1 --2- 172.21.15.2:0/3058676056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf9c0afca0 0x7faf9c0c6f00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.712+0000 7fafa2800640 1 --2- 172.21.15.2:0/3058676056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf9c0acf10 0x7faf9c168ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.712+0000 7fafa2800640 1 -- 172.21.15.2:0/3058676056 >> 172.21.15.2:0/3058676056 conn(0x7faf9c066e60 msgr2=0x7faf9c152440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:32.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.712+0000 7fafa2800640 1 -- 172.21.15.2:0/3058676056 shutdown_connections 2024-08-17T02:23:32.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.712+0000 7fafa2800640 1 -- 172.21.15.2:0/3058676056 wait complete. 2024-08-17T02:23:32.727 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:23:32.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.880+0000 7f2f33400640 1 Processor -- start 2024-08-17T02:23:32.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.881+0000 7f2f33400640 1 -- start start 2024-08-17T02:23:32.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.882+0000 7f2f33400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2f2c0afca0 0x7f2f2c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.882+0000 7f2f33400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2f2c0acf10 0x7f2f2c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.882+0000 7f2f33400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f2c1589a0 0x7f2f2c158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.882+0000 7f2f33400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2c0b0980 con 0x7f2f2c0acf10 2024-08-17T02:23:32.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.882+0000 7f2f33400640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2c15a4e0 con 0x7f2f2c0afca0 2024-08-17T02:23:32.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.882+0000 7f2f33400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c0c92b0 con 0x7f2f2c1589a0 2024-08-17T02:23:32.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.882+0000 7f2f2be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2f2c0acf10 0x7f2f2c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.882+0000 7f2f2be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2f2c0acf10 0x7f2f2c159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34772/0 (socket says 172.21.15.2:34772) 2024-08-17T02:23:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.882+0000 7f2f2be00640 1 -- 172.21.15.2:0/298777979 learned_addr learned my addr 172.21.15.2:0/298777979 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.882+0000 7f2f30a00640 1 --2- 172.21.15.2:0/298777979 >> v2:172.21.15.145:3300/0 conn(0x7f2f2c0afca0 0x7f2f2c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.882+0000 7f2f31400640 1 --2- 172.21.15.2:0/298777979 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f2c1589a0 0x7f2f2c158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.883+0000 7f2f2be00640 1 -- 172.21.15.2:0/298777979 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f2c1589a0 msgr2=0x7f2f2c158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.883+0000 7f2f2be00640 1 --2- 172.21.15.2:0/298777979 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f2c1589a0 0x7f2f2c158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.883+0000 7f2f2be00640 1 -- 172.21.15.2:0/298777979 >> v2:172.21.15.145:3300/0 conn(0x7f2f2c0afca0 msgr2=0x7f2f2c0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.883+0000 7f2f2be00640 1 --2- 172.21.15.2:0/298777979 >> v2:172.21.15.145:3300/0 conn(0x7f2f2c0afca0 0x7f2f2c0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.883+0000 7f2f2be00640 1 -- 172.21.15.2:0/298777979 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c159360 con 0x7f2f2c0acf10 2024-08-17T02:23:32.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.884+0000 7f2f2be00640 1 --2- 172.21.15.2:0/298777979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f2c0acf10 0x7f2f2c159fa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c067e40 tx=0x7f2f180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e883aa3b162f26b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:32.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.884+0000 7f2f2b400640 1 -- 172.21.15.2:0/298777979 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1802add0 con 0x7f2f2c0acf10 2024-08-17T02:23:32.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.884+0000 7f2f2b400640 1 -- 172.21.15.2:0/298777979 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f18032440 con 0x7f2f2c0acf10 2024-08-17T02:23:32.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.884+0000 7f2f2b400640 1 -- 172.21.15.2:0/298777979 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f18032820 con 0x7f2f2c0acf10 2024-08-17T02:23:32.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.884+0000 7f2f33400640 1 -- 172.21.15.2:0/298777979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f2c0acf10 msgr2=0x7f2f2c159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.884+0000 7f2f33400640 1 --2- 172.21.15.2:0/298777979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f2c0acf10 0x7f2f2c159fa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c067e40 tx=0x7f2f180091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.885+0000 7f2f33400640 1 -- 172.21.15.2:0/298777979 shutdown_connections 2024-08-17T02:23:32.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.885+0000 7f2f33400640 1 --2- 172.21.15.2:0/298777979 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f2c1589a0 0x7f2f2c158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.885+0000 7f2f33400640 1 --2- 172.21.15.2:0/298777979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f2c0acf10 0x7f2f2c159fa0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.885+0000 7f2f33400640 1 --2- 172.21.15.2:0/298777979 >> v2:172.21.15.145:3300/0 conn(0x7f2f2c0afca0 0x7f2f2c0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.885+0000 7f2f33400640 1 -- 172.21.15.2:0/298777979 >> 172.21.15.2:0/298777979 conn(0x7f2f2c066e60 msgr2=0x7f2f2c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:32.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.885+0000 7f2f33400640 1 -- 172.21.15.2:0/298777979 shutdown_connections 2024-08-17T02:23:32.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.885+0000 7f2f33400640 1 -- 172.21.15.2:0/298777979 wait complete. 2024-08-17T02:23:32.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.886+0000 7f2f33400640 1 Processor -- start 2024-08-17T02:23:32.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.886+0000 7f2f33400640 1 -- start start 2024-08-17T02:23:32.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.887+0000 7f2f33400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f2c0acf10 0x7f2f2c15b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.887+0000 7f2f33400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f2c0afca0 0x7f2f2c13f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.887+0000 7f2f33400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f2c1589a0 0x7f2f2c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.887+0000 7f2f33400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c0c70a0 con 0x7f2f2c0afca0 2024-08-17T02:23:32.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.887+0000 7f2f33400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c15d310 con 0x7f2f2c1589a0 2024-08-17T02:23:32.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.887+0000 7f2f33400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c0c6d70 con 0x7f2f2c0acf10 2024-08-17T02:23:32.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.887+0000 7f2f2be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f2c0afca0 0x7f2f2c13f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.887+0000 7f2f2be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f2c0afca0 0x7f2f2c13f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34778/0 (socket says 172.21.15.2:34778) 2024-08-17T02:23:32.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.887+0000 7f2f2be00640 1 -- 172.21.15.2:0/2015743848 learned_addr learned my addr 172.21.15.2:0/2015743848 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:32.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.888+0000 7f2f30a00640 1 --2- 172.21.15.2:0/2015743848 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f2c0acf10 0x7f2f2c15b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.888+0000 7f2f31400640 1 --2- 172.21.15.2:0/2015743848 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f2c1589a0 0x7f2f2c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.888+0000 7f2f2be00640 1 -- 172.21.15.2:0/2015743848 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f2c0acf10 msgr2=0x7f2f2c15b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.888+0000 7f2f2be00640 1 --2- 172.21.15.2:0/2015743848 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f2c0acf10 0x7f2f2c15b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.888+0000 7f2f2be00640 1 -- 172.21.15.2:0/2015743848 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f2c1589a0 msgr2=0x7f2f2c152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.888+0000 7f2f2be00640 1 --2- 172.21.15.2:0/2015743848 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f2c1589a0 0x7f2f2c152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.888+0000 7f2f2be00640 1 -- 172.21.15.2:0/2015743848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f18009450 con 0x7f2f2c0afca0 2024-08-17T02:23:32.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.888+0000 7f2f2be00640 1 --2- 172.21.15.2:0/2015743848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f2c0afca0 0x7f2f2c13f3d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009940 tx=0x7f2f18032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:32.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.888+0000 7f2f1fe00640 1 -- 172.21.15.2:0/2015743848 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f18031ae0 con 0x7f2f2c0afca0 2024-08-17T02:23:32.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.888+0000 7f2f1fe00640 1 -- 172.21.15.2:0/2015743848 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f18031c60 con 0x7f2f2c0afca0 2024-08-17T02:23:32.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.889+0000 7f2f1fe00640 1 -- 172.21.15.2:0/2015743848 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1803d670 con 0x7f2f2c0afca0 2024-08-17T02:23:32.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.889+0000 7f2f33400640 1 -- 172.21.15.2:0/2015743848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f2c15d580 con 0x7f2f2c0afca0 2024-08-17T02:23:32.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.889+0000 7f2f33400640 1 -- 172.21.15.2:0/2015743848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2c15ae30 con 0x7f2f2c0afca0 2024-08-17T02:23:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.890+0000 7f2f33400640 1 -- 172.21.15.2:0/2015743848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f2c0c7250 con 0x7f2f2c0afca0 2024-08-17T02:23:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.890+0000 7f2f1fe00640 1 -- 172.21.15.2:0/2015743848 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2f18039040 con 0x7f2f2c0afca0 2024-08-17T02:23:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.891+0000 7f2f1fe00640 1 --2- 172.21.15.2:0/2015743848 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2f0c065150 0x7f2f0c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.891+0000 7f2f1fe00640 1 -- 172.21.15.2:0/2015743848 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2f180a2510 con 0x7f2f2c0afca0 2024-08-17T02:23:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.891+0000 7f2f30a00640 1 --2- 172.21.15.2:0/2015743848 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2f0c065150 0x7f2f0c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.892+0000 7f2f30a00640 1 --2- 172.21.15.2:0/2015743848 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2f0c065150 0x7f2f0c067600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c06ed70 tx=0x7f2f200090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:32.895+0000 7f2f1fe00640 1 -- 172.21.15.2:0/2015743848 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2f2c0c7250 con 0x7f2f2c0afca0 2024-08-17T02:23:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:33.119+0000 7f2f33400640 1 -- 172.21.15.2:0/2015743848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2f2c0c71e0 con 0x7f2f2c0afca0 2024-08-17T02:23:33.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:33.968+0000 7f2f1fe00640 1 -- 172.21.15.2:0/2015743848 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2f180705e0 con 0x7f2f2c0afca0 2024-08-17T02:23:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:33.971+0000 7f2f33400640 1 -- 172.21.15.2:0/2015743848 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2f0c065150 msgr2=0x7f2f0c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:33.971+0000 7f2f33400640 1 --2- 172.21.15.2:0/2015743848 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2f0c065150 0x7f2f0c067600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c06ed70 tx=0x7f2f200090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:33.971+0000 7f2f33400640 1 -- 172.21.15.2:0/2015743848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f2c0afca0 msgr2=0x7f2f2c13f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:33.971+0000 7f2f33400640 1 --2- 172.21.15.2:0/2015743848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f2c0afca0 0x7f2f2c13f3d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009940 tx=0x7f2f18032000 comp rx=0 tx=0).stop 2024-08-17T02:23:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:33.971+0000 7f2f33400640 1 -- 172.21.15.2:0/2015743848 shutdown_connections 2024-08-17T02:23:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:33.971+0000 7f2f33400640 1 --2- 172.21.15.2:0/2015743848 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f2c1589a0 0x7f2f2c152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:33.971+0000 7f2f33400640 1 --2- 172.21.15.2:0/2015743848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f2c0afca0 0x7f2f2c13f3d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:33.971+0000 7f2f33400640 1 --2- 172.21.15.2:0/2015743848 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2f0c065150 0x7f2f0c067600 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:33.971+0000 7f2f33400640 1 --2- 172.21.15.2:0/2015743848 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f2c0acf10 0x7f2f2c15b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:33.971+0000 7f2f33400640 1 -- 172.21.15.2:0/2015743848 >> 172.21.15.2:0/2015743848 conn(0x7f2f2c066e60 msgr2=0x7f2f2c0c9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:33.972+0000 7f2f33400640 1 -- 172.21.15.2:0/2015743848 shutdown_connections 2024-08-17T02:23:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:33.972+0000 7f2f33400640 1 -- 172.21.15.2:0/2015743848 wait complete. 2024-08-17T02:23:33.989 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:23:34.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.148+0000 7fc31a000640 1 Processor -- start 2024-08-17T02:23:34.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.148+0000 7fc31a000640 1 -- start start 2024-08-17T02:23:34.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.150+0000 7fc31a000640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc3140b1850 0x7fc3140b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:34.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.150+0000 7fc31a000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3140d0650 0x7fc3140ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:34.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.150+0000 7fc31a000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc3141585a0 0x7fc314158a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:34.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.150+0000 7fc31a000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3140ce9b0 con 0x7fc3141585a0 2024-08-17T02:23:34.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.150+0000 7fc31a000640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3140cec90 con 0x7fc3140b1850 2024-08-17T02:23:34.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.150+0000 7fc31a000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3140cef70 con 0x7fc3140d0650 2024-08-17T02:23:34.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.150+0000 7fc319600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc3141585a0 0x7fc314158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:34.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.150+0000 7fc319600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc3141585a0 0x7fc314158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34788/0 (socket says 172.21.15.2:34788) 2024-08-17T02:23:34.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.150+0000 7fc319600640 1 -- 172.21.15.2:0/1443692736 learned_addr learned my addr 172.21.15.2:0/1443692736 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:34.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.150+0000 7fc313e00640 1 --2- 172.21.15.2:0/1443692736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3140d0650 0x7fc3140ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:34.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.150+0000 7fc318c00640 1 --2- 172.21.15.2:0/1443692736 >> v2:172.21.15.145:3300/0 conn(0x7fc3140b1850 0x7fc3140b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:34.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.150+0000 7fc319600640 1 -- 172.21.15.2:0/1443692736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3140d0650 msgr2=0x7fc3140ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:34.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.150+0000 7fc319600640 1 --2- 172.21.15.2:0/1443692736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3140d0650 0x7fc3140ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:34.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.150+0000 7fc319600640 1 -- 172.21.15.2:0/1443692736 >> v2:172.21.15.145:3300/0 conn(0x7fc3140b1850 msgr2=0x7fc3140b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:34.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.150+0000 7fc319600640 1 --2- 172.21.15.2:0/1443692736 >> v2:172.21.15.145:3300/0 conn(0x7fc3140b1850 0x7fc3140b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:34.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.150+0000 7fc319600640 1 -- 172.21.15.2:0/1443692736 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3140cf250 con 0x7fc3141585a0 2024-08-17T02:23:34.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.151+0000 7fc319600640 1 --2- 172.21.15.2:0/1443692736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3141585a0 0x7fc314158a20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc314088960 tx=0x7fc30c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf152785af7ecdc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:34.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.152+0000 7fc313400640 1 -- 172.21.15.2:0/1443692736 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c031400 con 0x7fc3141585a0 2024-08-17T02:23:34.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.152+0000 7fc313400640 1 -- 172.21.15.2:0/1443692736 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c02d050 con 0x7fc3141585a0 2024-08-17T02:23:34.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.152+0000 7fc313400640 1 -- 172.21.15.2:0/1443692736 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c0317d0 con 0x7fc3141585a0 2024-08-17T02:23:34.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.152+0000 7fc31a000640 1 -- 172.21.15.2:0/1443692736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3141585a0 msgr2=0x7fc314158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:34.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.152+0000 7fc31a000640 1 --2- 172.21.15.2:0/1443692736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3141585a0 0x7fc314158a20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc314088960 tx=0x7fc30c009840 comp rx=0 tx=0).stop 2024-08-17T02:23:34.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.152+0000 7fc31a000640 1 -- 172.21.15.2:0/1443692736 shutdown_connections 2024-08-17T02:23:34.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.152+0000 7fc31a000640 1 --2- 172.21.15.2:0/1443692736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3141585a0 0x7fc314158a20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.152+0000 7fc31a000640 1 --2- 172.21.15.2:0/1443692736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3140d0650 0x7fc3140ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.152+0000 7fc31a000640 1 --2- 172.21.15.2:0/1443692736 >> v2:172.21.15.145:3300/0 conn(0x7fc3140b1850 0x7fc3140b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.152+0000 7fc31a000640 1 -- 172.21.15.2:0/1443692736 >> 172.21.15.2:0/1443692736 conn(0x7fc31406e590 msgr2=0x7fc31406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.152+0000 7fc31a000640 1 -- 172.21.15.2:0/1443692736 shutdown_connections 2024-08-17T02:23:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.152+0000 7fc31a000640 1 -- 172.21.15.2:0/1443692736 wait complete. 2024-08-17T02:23:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.154+0000 7fc31a000640 1 Processor -- start 2024-08-17T02:23:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.154+0000 7fc31a000640 1 -- start start 2024-08-17T02:23:34.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.155+0000 7fc31a000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3140b1850 0x7fc31415c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:34.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.155+0000 7fc31a000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3140d0650 0x7fc3141578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:34.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.155+0000 7fc31a000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3141585a0 0x7fc3140c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:34.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.155+0000 7fc31a000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31415c530 con 0x7fc3140d0650 2024-08-17T02:23:34.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.155+0000 7fc31a000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31415b920 con 0x7fc3141585a0 2024-08-17T02:23:34.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.155+0000 7fc31a000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31415bc00 con 0x7fc3140b1850 2024-08-17T02:23:34.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.155+0000 7fc313e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3140d0650 0x7fc3141578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:34.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.155+0000 7fc313e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3140d0650 0x7fc3141578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34804/0 (socket says 172.21.15.2:34804) 2024-08-17T02:23:34.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.155+0000 7fc313e00640 1 -- 172.21.15.2:0/2963217831 learned_addr learned my addr 172.21.15.2:0/2963217831 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:34.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.155+0000 7fc318c00640 1 --2- 172.21.15.2:0/2963217831 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3140b1850 0x7fc31415c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:34.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.155+0000 7fc319600640 1 --2- 172.21.15.2:0/2963217831 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3141585a0 0x7fc3140c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:34.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.155+0000 7fc313e00640 1 -- 172.21.15.2:0/2963217831 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3140b1850 msgr2=0x7fc31415c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:34.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.155+0000 7fc313e00640 1 --2- 172.21.15.2:0/2963217831 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3140b1850 0x7fc31415c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:34.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.156+0000 7fc313e00640 1 -- 172.21.15.2:0/2963217831 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3141585a0 msgr2=0x7fc3140c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:34.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.156+0000 7fc313e00640 1 --2- 172.21.15.2:0/2963217831 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3141585a0 0x7fc3140c5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:34.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.156+0000 7fc313e00640 1 -- 172.21.15.2:0/2963217831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c009ae0 con 0x7fc3140d0650 2024-08-17T02:23:34.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.156+0000 7fc318c00640 1 --2- 172.21.15.2:0/2963217831 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3140b1850 0x7fc31415c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:34.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.156+0000 7fc313e00640 1 --2- 172.21.15.2:0/2963217831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3140d0650 0x7fc3141578b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc30000d890 tx=0x7fc300008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:34.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.156+0000 7fc307e00640 1 -- 172.21.15.2:0/2963217831 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30000de20 con 0x7fc3140d0650 2024-08-17T02:23:34.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.156+0000 7fc307e00640 1 -- 172.21.15.2:0/2963217831 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30000b8d0 con 0x7fc3140d0650 2024-08-17T02:23:34.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.156+0000 7fc307e00640 1 -- 172.21.15.2:0/2963217831 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30000bc70 con 0x7fc3140d0650 2024-08-17T02:23:34.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.156+0000 7fc31a000640 1 -- 172.21.15.2:0/2963217831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31415bee0 con 0x7fc3140d0650 2024-08-17T02:23:34.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.156+0000 7fc31a000640 1 -- 172.21.15.2:0/2963217831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31415cf00 con 0x7fc3140d0650 2024-08-17T02:23:34.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.157+0000 7fc31a000640 1 -- 172.21.15.2:0/2963217831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc314070720 con 0x7fc3140d0650 2024-08-17T02:23:34.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.158+0000 7fc307e00640 1 -- 172.21.15.2:0/2963217831 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc300014640 con 0x7fc3140d0650 2024-08-17T02:23:34.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.159+0000 7fc307e00640 1 --2- 172.21.15.2:0/2963217831 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc2f4065150 0x7fc2f4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:34.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.159+0000 7fc307e00640 1 -- 172.21.15.2:0/2963217831 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc300082b20 con 0x7fc3140d0650 2024-08-17T02:23:34.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.159+0000 7fc318c00640 1 --2- 172.21.15.2:0/2963217831 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc2f4065150 0x7fc2f4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:34.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.160+0000 7fc318c00640 1 --2- 172.21.15.2:0/2963217831 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc2f4065150 0x7fc2f4067600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc30800bbb0 tx=0x7fc308008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:34.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.163+0000 7fc307e00640 1 -- 172.21.15.2:0/2963217831 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc300050b40 con 0x7fc3140d0650 2024-08-17T02:23:34.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.382+0000 7fc31a000640 1 -- 172.21.15.2:0/2963217831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc314068140 con 0x7fc3140d0650 2024-08-17T02:23:34.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.978+0000 7fc307e00640 1 -- 172.21.15.2:0/2963217831 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc300054160 con 0x7fc3140d0650 2024-08-17T02:23:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.980+0000 7fc31a000640 1 -- 172.21.15.2:0/2963217831 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc2f4065150 msgr2=0x7fc2f4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.981+0000 7fc31a000640 1 --2- 172.21.15.2:0/2963217831 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc2f4065150 0x7fc2f4067600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc30800bbb0 tx=0x7fc308008040 comp rx=0 tx=0).stop 2024-08-17T02:23:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.981+0000 7fc31a000640 1 -- 172.21.15.2:0/2963217831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3140d0650 msgr2=0x7fc3141578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.981+0000 7fc31a000640 1 --2- 172.21.15.2:0/2963217831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3140d0650 0x7fc3141578b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc30000d890 tx=0x7fc300008040 comp rx=0 tx=0).stop 2024-08-17T02:23:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.981+0000 7fc31a000640 1 -- 172.21.15.2:0/2963217831 shutdown_connections 2024-08-17T02:23:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.981+0000 7fc31a000640 1 --2- 172.21.15.2:0/2963217831 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3141585a0 0x7fc3140c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.981+0000 7fc31a000640 1 --2- 172.21.15.2:0/2963217831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3140d0650 0x7fc3141578b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.981+0000 7fc31a000640 1 --2- 172.21.15.2:0/2963217831 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc2f4065150 0x7fc2f4067600 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.981+0000 7fc31a000640 1 --2- 172.21.15.2:0/2963217831 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3140b1850 0x7fc31415c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.981+0000 7fc31a000640 1 -- 172.21.15.2:0/2963217831 >> 172.21.15.2:0/2963217831 conn(0x7fc31406e590 msgr2=0x7fc314143070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.981+0000 7fc31a000640 1 -- 172.21.15.2:0/2963217831 shutdown_connections 2024-08-17T02:23:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:34.981+0000 7fc31a000640 1 -- 172.21.15.2:0/2963217831 wait complete. 2024-08-17T02:23:35.000 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:23:35.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.156+0000 7fc8c6a00640 1 Processor -- start 2024-08-17T02:23:35.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.156+0000 7fc8c6a00640 1 -- start start 2024-08-17T02:23:35.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.157+0000 7fc8c6a00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc8c00aee60 0x7fc8c00caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.157+0000 7fc8c6a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c00afd20 con 0x7fc8c0158b90 2024-08-17T02:23:35.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.157+0000 7fc8c6a00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c00affe0 con 0x7fc8c00aea20 2024-08-17T02:23:35.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.157+0000 7fc8c6a00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c00b02c0 con 0x7fc8c00aee60 2024-08-17T02:23:35.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.157+0000 7fc8bfe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc8c0158b90 0x7fc8c00b1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35972/0 (socket says 172.21.15.2:35972) 2024-08-17T02:23:35.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.157+0000 7fc8bfe00640 1 -- 172.21.15.2:0/498135169 learned_addr learned my addr 172.21.15.2:0/498135169 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:35.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.158+0000 7fc8c4a00640 1 --2- 172.21.15.2:0/498135169 >> v2:172.21.15.145:3300/0 conn(0x7fc8c00aee60 0x7fc8c00caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:35.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.158+0000 7fc8bea00640 1 -- 172.21.15.2:0/498135169 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2970565432 0 0) 0x7fc8c00afd20 con 0x7fc8c0158b90 2024-08-17T02:23:35.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.158+0000 7fc8bea00640 1 -- 172.21.15.2:0/498135169 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8a40034e0 con 0x7fc8c0158b90 2024-08-17T02:23:35.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.158+0000 7fc8bea00640 1 -- 172.21.15.2:0/498135169 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3065553390 0 0) 0x7fc8c00affe0 con 0x7fc8c00aea20 2024-08-17T02:23:35.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.158+0000 7fc8bea00640 1 -- 172.21.15.2:0/498135169 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8c00afd20 con 0x7fc8c00aea20 2024-08-17T02:23:35.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.158+0000 7fc8bea00640 1 -- 172.21.15.2:0/498135169 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4253849480 0 0) 0x7fc8a40034e0 con 0x7fc8c0158b90 2024-08-17T02:23:35.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.158+0000 7fc8bea00640 1 -- 172.21.15.2:0/498135169 >> v2:172.21.15.145:3300/0 conn(0x7fc8c00aee60 msgr2=0x7fc8c00caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:35.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.158+0000 7fc8bea00640 1 --2- 172.21.15.2:0/498135169 >> v2:172.21.15.145:3300/0 conn(0x7fc8c00aee60 0x7fc8c00caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.158+0000 7fc8bea00640 1 -- 172.21.15.2:0/498135169 >> v1:172.21.15.145:6789/0 conn(0x7fc8c00aea20 legacy=0x7fc8c00ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.158+0000 7fc8bea00640 1 -- 172.21.15.2:0/498135169 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c00ca3c0 con 0x7fc8c0158b90 2024-08-17T02:23:35.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.158+0000 7fc8bea00640 1 -- 172.21.15.2:0/498135169 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7fc8b0001490 con 0x7fc8c0158b90 2024-08-17T02:23:35.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.158+0000 7fc8bea00640 1 -- 172.21.15.2:0/498135169 >> v1:172.21.15.2:6789/0 conn(0x7fc8c0158b90 legacy=0x7fc8c00b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.158+0000 7fc8bea00640 1 --2- 172.21.15.2:0/498135169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8a4003bb0 0x7fc8a4003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.158+0000 7fc8bea00640 1 --2- 172.21.15.2:0/498135169 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8a4004780 0x7fc8a4004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.158+0000 7fc8bea00640 1 --2- 172.21.15.2:0/498135169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a4005180 0x7fc8a400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.158+0000 7fc8bea00640 1 -- 172.21.15.2:0/498135169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c00b02c0 con 0x7fc8a4005180 2024-08-17T02:23:35.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.158+0000 7fc8bea00640 1 -- 172.21.15.2:0/498135169 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a400c0a0 con 0x7fc8a4003bb0 2024-08-17T02:23:35.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.158+0000 7fc8bea00640 1 -- 172.21.15.2:0/498135169 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a400c230 con 0x7fc8a4004780 2024-08-17T02:23:35.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.158+0000 7fc8c4a00640 1 --2- 172.21.15.2:0/498135169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a4005180 0x7fc8a400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:35.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.158+0000 7fc8bfe00640 1 --2- 172.21.15.2:0/498135169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8a4003bb0 0x7fc8a4003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:35.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.159+0000 7fc8bf400640 1 --2- 172.21.15.2:0/498135169 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8a4004780 0x7fc8a4004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:35.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.159+0000 7fc8c4a00640 1 -- 172.21.15.2:0/498135169 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8a4004780 msgr2=0x7fc8a4004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:35.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.159+0000 7fc8c4a00640 1 --2- 172.21.15.2:0/498135169 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8a4004780 0x7fc8a4004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.159+0000 7fc8c4a00640 1 -- 172.21.15.2:0/498135169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8a4003bb0 msgr2=0x7fc8a4003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:35.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.159+0000 7fc8c4a00640 1 --2- 172.21.15.2:0/498135169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8a4003bb0 0x7fc8a4003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.159+0000 7fc8c4a00640 1 -- 172.21.15.2:0/498135169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a40034e0 con 0x7fc8a4005180 2024-08-17T02:23:35.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.160+0000 7fc8c4a00640 1 -- 172.21.15.2:0/498135169 reap_dead start 2024-08-17T02:23:35.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.160+0000 7fc8c4a00640 1 --2- 172.21.15.2:0/498135169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a4005180 0x7fc8a400b9d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800e240 tx=0x7fc8b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93d022cc3c27335 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:35.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.160+0000 7fc8bea00640 1 -- 172.21.15.2:0/498135169 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8030440 con 0x7fc8a4005180 2024-08-17T02:23:35.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.160+0000 7fc8bea00640 1 -- 172.21.15.2:0/498135169 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b800f040 con 0x7fc8a4005180 2024-08-17T02:23:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.160+0000 7fc8bea00640 1 -- 172.21.15.2:0/498135169 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b80305e0 con 0x7fc8a4005180 2024-08-17T02:23:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.161+0000 7fc8c6a00640 1 -- 172.21.15.2:0/498135169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a4005180 msgr2=0x7fc8a400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.161+0000 7fc8c6a00640 1 --2- 172.21.15.2:0/498135169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a4005180 0x7fc8a400b9d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800e240 tx=0x7fc8b800b040 comp rx=0 tx=0).stop 2024-08-17T02:23:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.161+0000 7fc8c6a00640 1 -- 172.21.15.2:0/498135169 shutdown_connections 2024-08-17T02:23:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.161+0000 7fc8c6a00640 1 --2- 172.21.15.2:0/498135169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a4005180 0x7fc8a400b9d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.161+0000 7fc8c6a00640 1 -- 172.21.15.2:0/498135169 >> 172.21.15.2:0/498135169 conn(0x7fc8c006e590 msgr2=0x7fc8c006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.161+0000 7fc8c6a00640 1 -- 172.21.15.2:0/498135169 shutdown_connections 2024-08-17T02:23:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.161+0000 7fc8c6a00640 1 -- 172.21.15.2:0/498135169 wait complete. 2024-08-17T02:23:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.162+0000 7fc8c6a00640 1 Processor -- start 2024-08-17T02:23:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.162+0000 7fc8c6a00640 1 -- start start 2024-08-17T02:23:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.163+0000 7fc8c6a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8a4005180 0x7fc8c0155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.163+0000 7fc8c6a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8c00c7cf0 0x7fc8c00c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.163+0000 7fc8c6a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8c0159e50 0x7fc8c015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.163+0000 7fc8c6a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c015a800 con 0x7fc8c0159e50 2024-08-17T02:23:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.163+0000 7fc8c6a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c0169cc0 con 0x7fc8a4005180 2024-08-17T02:23:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.163+0000 7fc8c6a00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c0159090 con 0x7fc8c00c7cf0 2024-08-17T02:23:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.163+0000 7fc8c4a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8c0159e50 0x7fc8c015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.163+0000 7fc8c4a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8c0159e50 0x7fc8c015a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53642/0 (socket says 172.21.15.2:53642) 2024-08-17T02:23:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.163+0000 7fc8c4a00640 1 -- 172.21.15.2:0/2819364937 learned_addr learned my addr 172.21.15.2:0/2819364937 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.163+0000 7fc8bfe00640 1 --2- 172.21.15.2:0/2819364937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8a4005180 0x7fc8c0155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.163+0000 7fc8bf400640 1 --2- 172.21.15.2:0/2819364937 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8c00c7cf0 0x7fc8c00c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.164+0000 7fc8c4a00640 1 -- 172.21.15.2:0/2819364937 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8c00c7cf0 msgr2=0x7fc8c00c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.164+0000 7fc8c4a00640 1 --2- 172.21.15.2:0/2819364937 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8c00c7cf0 0x7fc8c00c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.164+0000 7fc8c4a00640 1 -- 172.21.15.2:0/2819364937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8a4005180 msgr2=0x7fc8c0155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.164+0000 7fc8c4a00640 1 --2- 172.21.15.2:0/2819364937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8a4005180 0x7fc8c0155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.164+0000 7fc8c4a00640 1 -- 172.21.15.2:0/2819364937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c0159370 con 0x7fc8c0159e50 2024-08-17T02:23:35.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.164+0000 7fc8c4a00640 1 --2- 172.21.15.2:0/2819364937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8c0159e50 0x7fc8c015a2c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8009bf0 tx=0x7fc8b8035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:35.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.164+0000 7fc8b7400640 1 -- 172.21.15.2:0/2819364937 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b803f070 con 0x7fc8c0159e50 2024-08-17T02:23:35.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.164+0000 7fc8b7400640 1 -- 172.21.15.2:0/2819364937 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b8039680 con 0x7fc8c0159e50 2024-08-17T02:23:35.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.164+0000 7fc8c6a00640 1 -- 172.21.15.2:0/2819364937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c0159650 con 0x7fc8c0159e50 2024-08-17T02:23:35.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.164+0000 7fc8b7400640 1 -- 172.21.15.2:0/2819364937 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8039a40 con 0x7fc8c0159e50 2024-08-17T02:23:35.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.164+0000 7fc8c6a00640 1 -- 172.21.15.2:0/2819364937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c0156370 con 0x7fc8c0159e50 2024-08-17T02:23:35.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.166+0000 7fc8c6a00640 1 -- 172.21.15.2:0/2819364937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c0159b50 con 0x7fc8c0159e50 2024-08-17T02:23:35.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.166+0000 7fc8b7400640 1 -- 172.21.15.2:0/2819364937 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc8b8003020 con 0x7fc8c0159e50 2024-08-17T02:23:35.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.167+0000 7fc8b7400640 1 --2- 172.21.15.2:0/2819364937 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc8a0065150 0x7fc8a0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.167+0000 7fc8b7400640 1 -- 172.21.15.2:0/2819364937 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc8b80a2c20 con 0x7fc8c0159e50 2024-08-17T02:23:35.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.167+0000 7fc8bfe00640 1 --2- 172.21.15.2:0/2819364937 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc8a0065150 0x7fc8a0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:35.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.168+0000 7fc8bfe00640 1 --2- 172.21.15.2:0/2819364937 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc8a0065150 0x7fc8a0067600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0001120 tx=0x7fc8c00ca2b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:35.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.171+0000 7fc8b7400640 1 -- 172.21.15.2:0/2819364937 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc8b8070cf0 con 0x7fc8c0159e50 2024-08-17T02:23:35.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.389+0000 7fc8c6a00640 1 -- 172.21.15.2:0/2819364937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8c0063fb0 con 0x7fc8c0159e50 2024-08-17T02:23:35.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.389+0000 7fc8b7400640 1 -- 172.21.15.2:0/2819364937 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7fc8b8074310 con 0x7fc8c0159e50 2024-08-17T02:23:35.390 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:35.390 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/88006300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":88006300},{"type":"v1","addr":"172.21.15.2:6835","nonce":88006300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3374741059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3374741059},{"type":"v1","addr":"172.21.15.2:6833","nonce":3374741059}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/3494373963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":3494373963},{"type":"v1","addr":"172.21.15.145:6837","nonce":3494373963}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:31.378654+0000","modified":"2024-08-17T02:23:34.968351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6836/3984927211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3984927211},{"type":"v1","addr":"172.21.15.145:6836","nonce":3984927211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:23:35.390 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2024-08-17T02:23:35.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.391+0000 7fc8c6a00640 1 -- 172.21.15.2:0/2819364937 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc8a0065150 msgr2=0x7fc8a0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.391+0000 7fc8c6a00640 1 --2- 172.21.15.2:0/2819364937 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc8a0065150 0x7fc8a0067600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0001120 tx=0x7fc8c00ca2b0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.391+0000 7fc8c6a00640 1 -- 172.21.15.2:0/2819364937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8c0159e50 msgr2=0x7fc8c015a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.391+0000 7fc8c6a00640 1 --2- 172.21.15.2:0/2819364937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8c0159e50 0x7fc8c015a2c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8009bf0 tx=0x7fc8b8035000 comp rx=0 tx=0).stop 2024-08-17T02:23:35.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.391+0000 7fc8c6a00640 1 -- 172.21.15.2:0/2819364937 shutdown_connections 2024-08-17T02:23:35.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.391+0000 7fc8c6a00640 1 --2- 172.21.15.2:0/2819364937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8c0159e50 0x7fc8c015a2c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.391+0000 7fc8c6a00640 1 --2- 172.21.15.2:0/2819364937 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc8a0065150 0x7fc8a0067600 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.391+0000 7fc8c6a00640 1 --2- 172.21.15.2:0/2819364937 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8c00c7cf0 0x7fc8c00c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.391+0000 7fc8c6a00640 1 --2- 172.21.15.2:0/2819364937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8a4005180 0x7fc8c0155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.391+0000 7fc8c6a00640 1 -- 172.21.15.2:0/2819364937 >> 172.21.15.2:0/2819364937 conn(0x7fc8c006e590 msgr2=0x7fc8c00b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:35.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.392+0000 7fc8c6a00640 1 -- 172.21.15.2:0/2819364937 shutdown_connections 2024-08-17T02:23:35.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.392+0000 7fc8c6a00640 1 -- 172.21.15.2:0/2819364937 wait complete. 2024-08-17T02:23:35.406 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:35.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.556+0000 7f5d84800640 1 Processor -- start 2024-08-17T02:23:35.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.556+0000 7f5d84800640 1 -- start start 2024-08-17T02:23:35.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.557+0000 7f5d84800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5d7c0ca050 0x7f5d7c156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.557+0000 7f5d84800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7c0cb160 con 0x7f5d7c0ad960 2024-08-17T02:23:35.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.557+0000 7f5d84800640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7c0b0d10 con 0x7f5d7c0add30 2024-08-17T02:23:35.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.557+0000 7f5d84800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d7c0ca550 con 0x7f5d7c0ca050 2024-08-17T02:23:35.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.558+0000 7f5d81e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5d7c0ad960 0x7f5d7c156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35978/0 (socket says 172.21.15.2:35978) 2024-08-17T02:23:35.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.558+0000 7f5d81e00640 1 -- 172.21.15.2:0/3829071056 learned_addr learned my addr 172.21.15.2:0/3829071056 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:35.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.558+0000 7f5d81400640 1 --2- 172.21.15.2:0/3829071056 >> v2:172.21.15.2:3300/0 conn(0x7f5d7c0ca050 0x7f5d7c156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:35.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.558+0000 7f5d81400640 1 -- 172.21.15.2:0/3829071056 >> v1:172.21.15.145:6789/0 conn(0x7f5d7c0add30 legacy=0x7f5d7c0aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.558+0000 7f5d81400640 1 -- 172.21.15.2:0/3829071056 >> v1:172.21.15.2:6789/0 conn(0x7f5d7c0ad960 legacy=0x7f5d7c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.558+0000 7f5d81400640 1 -- 172.21.15.2:0/3829071056 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7c0ca830 con 0x7f5d7c0ca050 2024-08-17T02:23:35.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.559+0000 7f5d81400640 1 --2- 172.21.15.2:0/3829071056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d7c0ca050 0x7f5d7c156b30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009850 tx=0x7f5d6c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f60b1c54d13328 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:35.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.559+0000 7f5d80a00640 1 -- 172.21.15.2:0/3829071056 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c032440 con 0x7f5d7c0ca050 2024-08-17T02:23:35.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.560+0000 7f5d80a00640 1 -- 172.21.15.2:0/3829071056 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6c0325a0 con 0x7f5d7c0ca050 2024-08-17T02:23:35.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.560+0000 7f5d80a00640 1 -- 172.21.15.2:0/3829071056 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c032980 con 0x7f5d7c0ca050 2024-08-17T02:23:35.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.560+0000 7f5d84800640 1 -- 172.21.15.2:0/3829071056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d7c0ca050 msgr2=0x7f5d7c156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.560+0000 7f5d84800640 1 --2- 172.21.15.2:0/3829071056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d7c0ca050 0x7f5d7c156b30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009850 tx=0x7f5d6c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.560+0000 7f5d84800640 1 -- 172.21.15.2:0/3829071056 shutdown_connections 2024-08-17T02:23:35.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.560+0000 7f5d84800640 1 --2- 172.21.15.2:0/3829071056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d7c0ca050 0x7f5d7c156b30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.560+0000 7f5d84800640 1 -- 172.21.15.2:0/3829071056 >> 172.21.15.2:0/3829071056 conn(0x7f5d7c066e60 msgr2=0x7f5d7c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:35.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.560+0000 7f5d84800640 1 -- 172.21.15.2:0/3829071056 shutdown_connections 2024-08-17T02:23:35.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.560+0000 7f5d84800640 1 -- 172.21.15.2:0/3829071056 wait complete. 2024-08-17T02:23:35.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.562+0000 7f5d84800640 1 Processor -- start 2024-08-17T02:23:35.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.562+0000 7f5d84800640 1 -- start start 2024-08-17T02:23:35.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.563+0000 7f5d84800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5d7c0ad960 0x7f5d7c145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.563+0000 7f5d84800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5d7c0add30 0x7f5d7c0ac730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.563+0000 7f5d84800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d7c0ca050 0x7f5d7c0acc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.563+0000 7f5d84800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c16a9e0 con 0x7f5d7c0ca050 2024-08-17T02:23:35.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.563+0000 7f5d84800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c16d360 con 0x7f5d7c0add30 2024-08-17T02:23:35.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.563+0000 7f5d84800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c16a390 con 0x7f5d7c0ad960 2024-08-17T02:23:35.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.563+0000 7f5d82800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d7c0ca050 0x7f5d7c0acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:35.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.563+0000 7f5d81e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5d7c0ad960 0x7f5d7c145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:35.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.563+0000 7f5d82800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d7c0ca050 0x7f5d7c0acc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53654/0 (socket says 172.21.15.2:53654) 2024-08-17T02:23:35.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.563+0000 7f5d82800640 1 -- 172.21.15.2:0/3220319018 learned_addr learned my addr 172.21.15.2:0/3220319018 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:35.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.563+0000 7f5d81400640 1 --2- 172.21.15.2:0/3220319018 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5d7c0add30 0x7f5d7c0ac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:35.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.563+0000 7f5d82800640 1 -- 172.21.15.2:0/3220319018 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5d7c0ad960 msgr2=0x7f5d7c145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.563+0000 7f5d82800640 1 --2- 172.21.15.2:0/3220319018 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5d7c0ad960 0x7f5d7c145540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.563+0000 7f5d82800640 1 -- 172.21.15.2:0/3220319018 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5d7c0add30 msgr2=0x7f5d7c0ac730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.563+0000 7f5d82800640 1 --2- 172.21.15.2:0/3220319018 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5d7c0add30 0x7f5d7c0ac730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.563+0000 7f5d82800640 1 -- 172.21.15.2:0/3220319018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c009390 con 0x7f5d7c0ca050 2024-08-17T02:23:35.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.564+0000 7f5d82800640 1 --2- 172.21.15.2:0/3220319018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d7c0ca050 0x7f5d7c0acc70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800c860 tx=0x7f5d78001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:35.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.564+0000 7f5d75600640 1 -- 172.21.15.2:0/3220319018 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7800ce50 con 0x7f5d7c0ca050 2024-08-17T02:23:35.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.564+0000 7f5d75600640 1 -- 172.21.15.2:0/3220319018 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7800a850 con 0x7f5d7c0ca050 2024-08-17T02:23:35.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.564+0000 7f5d75600640 1 -- 172.21.15.2:0/3220319018 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7800ac10 con 0x7f5d7c0ca050 2024-08-17T02:23:35.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.564+0000 7f5d84800640 1 -- 172.21.15.2:0/3220319018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d7c16a670 con 0x7f5d7c0ca050 2024-08-17T02:23:35.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.564+0000 7f5d84800640 1 -- 172.21.15.2:0/3220319018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7c145a80 con 0x7f5d7c0ca050 2024-08-17T02:23:35.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.565+0000 7f5d84800640 1 -- 172.21.15.2:0/3220319018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d7c16ab50 con 0x7f5d7c0ca050 2024-08-17T02:23:35.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.566+0000 7f5d75600640 1 -- 172.21.15.2:0/3220319018 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5d78012630 con 0x7f5d7c0ca050 2024-08-17T02:23:35.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.567+0000 7f5d75600640 1 --2- 172.21.15.2:0/3220319018 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5d60065150 0x7f5d60067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.567+0000 7f5d75600640 1 -- 172.21.15.2:0/3220319018 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5d780825e0 con 0x7f5d7c0ca050 2024-08-17T02:23:35.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.567+0000 7f5d81e00640 1 --2- 172.21.15.2:0/3220319018 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5d60065150 0x7f5d60067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:35.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.568+0000 7f5d81e00640 1 --2- 172.21.15.2:0/3220319018 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5d60065150 0x7f5d60067600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c06a860 tx=0x7f5d70007e20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:35.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.570+0000 7f5d75600640 1 -- 172.21.15.2:0/3220319018 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5d780506b0 con 0x7f5d7c0ca050 2024-08-17T02:23:35.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.752+0000 7f5d84800640 1 -- 172.21.15.2:0/3220319018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d7c063fb0 con 0x7f5d7c0ca050 2024-08-17T02:23:35.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.753+0000 7f5d75600640 1 -- 172.21.15.2:0/3220319018 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f5d78053cd0 con 0x7f5d7c0ca050 2024-08-17T02:23:35.753 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:35.753 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:23:32.955197+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:29.708835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:30.361908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:35.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.755+0000 7f5d84800640 1 -- 172.21.15.2:0/3220319018 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5d60065150 msgr2=0x7f5d60067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.755+0000 7f5d84800640 1 --2- 172.21.15.2:0/3220319018 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5d60065150 0x7f5d60067600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c06a860 tx=0x7f5d70007e20 comp rx=0 tx=0).stop 2024-08-17T02:23:35.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.755+0000 7f5d84800640 1 -- 172.21.15.2:0/3220319018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d7c0ca050 msgr2=0x7f5d7c0acc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.755+0000 7f5d84800640 1 --2- 172.21.15.2:0/3220319018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d7c0ca050 0x7f5d7c0acc70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800c860 tx=0x7f5d78001690 comp rx=0 tx=0).stop 2024-08-17T02:23:35.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.755+0000 7f5d84800640 1 -- 172.21.15.2:0/3220319018 shutdown_connections 2024-08-17T02:23:35.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.755+0000 7f5d84800640 1 --2- 172.21.15.2:0/3220319018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d7c0ca050 0x7f5d7c0acc70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.755+0000 7f5d84800640 1 --2- 172.21.15.2:0/3220319018 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5d7c0add30 0x7f5d7c0ac730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.755+0000 7f5d84800640 1 --2- 172.21.15.2:0/3220319018 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5d60065150 0x7f5d60067600 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.755+0000 7f5d84800640 1 --2- 172.21.15.2:0/3220319018 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5d7c0ad960 0x7f5d7c145540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.755+0000 7f5d84800640 1 -- 172.21.15.2:0/3220319018 >> 172.21.15.2:0/3220319018 conn(0x7f5d7c066e60 msgr2=0x7f5d7c155380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:35.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.755+0000 7f5d84800640 1 -- 172.21.15.2:0/3220319018 shutdown_connections 2024-08-17T02:23:35.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.755+0000 7f5d84800640 1 -- 172.21.15.2:0/3220319018 wait complete. 2024-08-17T02:23:35.770 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:23:35.771 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:23:35.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.922+0000 7f8dd7000640 1 Processor -- start 2024-08-17T02:23:35.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.922+0000 7f8dd7000640 1 -- start start 2024-08-17T02:23:35.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.923+0000 7f8dd7000640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8dd00ca050 0x7f8dd0156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.923+0000 7f8dd7000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8dd00add30 0x7f8dd015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.923+0000 7f8dd7000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd015b5e0 con 0x7f8dd00ad960 2024-08-17T02:23:35.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.923+0000 7f8dd7000640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd00cb160 con 0x7f8dd00ca050 2024-08-17T02:23:35.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.923+0000 7f8dd7000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd00b0d10 con 0x7f8dd00add30 2024-08-17T02:23:35.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.923+0000 7f8dcfe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8dd00ad960 0x7f8dd0156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35984/0 (socket says 172.21.15.2:35984) 2024-08-17T02:23:35.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.923+0000 7f8dcfe00640 1 -- 172.21.15.2:0/3117639515 learned_addr learned my addr 172.21.15.2:0/3117639515 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:35.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.924+0000 7f8dd5000640 1 --2- 172.21.15.2:0/3117639515 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8dd00add30 0x7f8dd015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:35.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.924+0000 7f8dcf400640 1 --2- 172.21.15.2:0/3117639515 >> v2:172.21.15.145:3300/0 conn(0x7f8dd00ca050 0x7f8dd0156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:35.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.924+0000 7f8dcea00640 1 -- 172.21.15.2:0/3117639515 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862298392 0 0) 0x7f8dc0001110 con 0x7f8dd00ad960 2024-08-17T02:23:35.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.924+0000 7f8dcea00640 1 -- 172.21.15.2:0/3117639515 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8db40034e0 con 0x7f8dd00ad960 2024-08-17T02:23:35.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.924+0000 7f8dd5000640 1 -- 172.21.15.2:0/3117639515 >> v2:172.21.15.145:3300/0 conn(0x7f8dd00ca050 msgr2=0x7f8dd0156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:35.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.924+0000 7f8dd5000640 1 --2- 172.21.15.2:0/3117639515 >> v2:172.21.15.145:3300/0 conn(0x7f8dd00ca050 0x7f8dd0156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.924+0000 7f8dd5000640 1 -- 172.21.15.2:0/3117639515 >> v1:172.21.15.2:6789/0 conn(0x7f8dd00ad960 legacy=0x7f8dd0156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.924+0000 7f8dd5000640 1 -- 172.21.15.2:0/3117639515 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd00ca550 con 0x7f8dd00add30 2024-08-17T02:23:35.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.925+0000 7f8dd5000640 1 --2- 172.21.15.2:0/3117639515 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8dd00add30 0x7f8dd015b0a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8009e60 tx=0x7f8dc8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8964a62038514fb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:35.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.925+0000 7f8dcea00640 1 -- 172.21.15.2:0/3117639515 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8007550 con 0x7f8dd00add30 2024-08-17T02:23:35.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.926+0000 7f8dcea00640 1 -- 172.21.15.2:0/3117639515 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc802d050 con 0x7f8dd00add30 2024-08-17T02:23:35.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.926+0000 7f8dcea00640 1 -- 172.21.15.2:0/3117639515 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc80078c0 con 0x7f8dd00add30 2024-08-17T02:23:35.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.926+0000 7f8dd7000640 1 -- 172.21.15.2:0/3117639515 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8dd00add30 msgr2=0x7f8dd015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.926+0000 7f8dd7000640 1 --2- 172.21.15.2:0/3117639515 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8dd00add30 0x7f8dd015b0a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8009e60 tx=0x7f8dc8009780 comp rx=0 tx=0).stop 2024-08-17T02:23:35.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.926+0000 7f8dd7000640 1 -- 172.21.15.2:0/3117639515 shutdown_connections 2024-08-17T02:23:35.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.926+0000 7f8dd7000640 1 --2- 172.21.15.2:0/3117639515 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8dd00add30 0x7f8dd015b0a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.926+0000 7f8dd7000640 1 --2- 172.21.15.2:0/3117639515 >> v2:172.21.15.145:3300/0 conn(0x7f8dd00ca050 0x7f8dd0156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.926+0000 7f8dd7000640 1 -- 172.21.15.2:0/3117639515 >> 172.21.15.2:0/3117639515 conn(0x7f8dd0066e60 msgr2=0x7f8dd0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:35.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.926+0000 7f8dd7000640 1 -- 172.21.15.2:0/3117639515 shutdown_connections 2024-08-17T02:23:35.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.926+0000 7f8dd7000640 1 -- 172.21.15.2:0/3117639515 wait complete. 2024-08-17T02:23:35.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.928+0000 7f8dd7000640 1 Processor -- start 2024-08-17T02:23:35.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.928+0000 7f8dd7000640 1 -- start start 2024-08-17T02:23:35.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.929+0000 7f8dd7000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8dd00ad960 0x7f8dd01455b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.929+0000 7f8dd7000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dd00add30 0x7f8dd0157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.929+0000 7f8dd7000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8dd00ca050 0x7f8dd00a9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.929+0000 7f8dd7000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd0169d10 con 0x7f8dd00add30 2024-08-17T02:23:35.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.929+0000 7f8dd7000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd0168ee0 con 0x7f8dd00ad960 2024-08-17T02:23:35.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.929+0000 7f8dd7000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd0169140 con 0x7f8dd00ca050 2024-08-17T02:23:35.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.929+0000 7f8dcf400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dd00add30 0x7f8dd0157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:35.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.929+0000 7f8dcf400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dd00add30 0x7f8dd0157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53664/0 (socket says 172.21.15.2:53664) 2024-08-17T02:23:35.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.929+0000 7f8dcf400640 1 -- 172.21.15.2:0/1262786163 learned_addr learned my addr 172.21.15.2:0/1262786163 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:35.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.929+0000 7f8dcfe00640 1 --2- 172.21.15.2:0/1262786163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8dd00ad960 0x7f8dd01455b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:35.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.929+0000 7f8dd5000640 1 --2- 172.21.15.2:0/1262786163 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8dd00ca050 0x7f8dd00a9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:35.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.929+0000 7f8dcf400640 1 -- 172.21.15.2:0/1262786163 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8dd00ca050 msgr2=0x7f8dd00a9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.929+0000 7f8dcf400640 1 --2- 172.21.15.2:0/1262786163 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8dd00ca050 0x7f8dd00a9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.929+0000 7f8dcf400640 1 -- 172.21.15.2:0/1262786163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8dd00ad960 msgr2=0x7f8dd01455b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.929+0000 7f8dcf400640 1 --2- 172.21.15.2:0/1262786163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8dd00ad960 0x7f8dd01455b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.929+0000 7f8dcf400640 1 -- 172.21.15.2:0/1262786163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc8009a20 con 0x7f8dd00add30 2024-08-17T02:23:35.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.930+0000 7f8dcf400640 1 --2- 172.21.15.2:0/1262786163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dd00add30 0x7f8dd0157100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00e900 tx=0x7f8dbc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:35.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.930+0000 7f8dc7400640 1 -- 172.21.15.2:0/1262786163 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc00c8e0 con 0x7f8dd00add30 2024-08-17T02:23:35.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.930+0000 7f8dc7400640 1 -- 172.21.15.2:0/1262786163 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dbc00ca40 con 0x7f8dd00add30 2024-08-17T02:23:35.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.930+0000 7f8dc7400640 1 -- 172.21.15.2:0/1262786163 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc00cde0 con 0x7f8dd00add30 2024-08-17T02:23:35.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.930+0000 7f8dd7000640 1 -- 172.21.15.2:0/1262786163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd01693e0 con 0x7f8dd00add30 2024-08-17T02:23:35.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.930+0000 7f8dd7000640 1 -- 172.21.15.2:0/1262786163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd01699a0 con 0x7f8dd00add30 2024-08-17T02:23:35.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.931+0000 7f8dd7000640 1 -- 172.21.15.2:0/1262786163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd0063fb0 con 0x7f8dd00add30 2024-08-17T02:23:35.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.932+0000 7f8dc7400640 1 -- 172.21.15.2:0/1262786163 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8dbc013680 con 0x7f8dd00add30 2024-08-17T02:23:35.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.933+0000 7f8dc7400640 1 --2- 172.21.15.2:0/1262786163 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8db0065150 0x7f8db0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.933+0000 7f8dc7400640 1 -- 172.21.15.2:0/1262786163 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8dbc082660 con 0x7f8dd00add30 2024-08-17T02:23:35.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.933+0000 7f8dcfe00640 1 --2- 172.21.15.2:0/1262786163 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8db0065150 0x7f8db0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:35.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.934+0000 7f8dcfe00640 1 --2- 172.21.15.2:0/1262786163 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8db0065150 0x7f8db0067600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0001270 tx=0x7f8dc0000bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:35.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:35.937+0000 7f8dc7400640 1 -- 172.21.15.2:0/1262786163 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8dbc050730 con 0x7f8dd00add30 2024-08-17T02:23:36.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.115+0000 7f8dd7000640 1 -- 172.21.15.2:0/1262786163 --> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8dd0169e50 con 0x7f8db0065150 2024-08-17T02:23:36.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.124+0000 7f8dc7400640 1 -- 172.21.15.2:0/1262786163 <== mgr.4108 v2:172.21.15.145:6832/36841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264619 (secure 0 0 0) 0x7f8dd0169e50 con 0x7f8db0065150 2024-08-17T02:23:36.128 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:36.129 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-17T02:23:36.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.128+0000 7f8dd7000640 1 -- 172.21.15.2:0/1262786163 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8db0065150 msgr2=0x7f8db0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:36.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.128+0000 7f8dd7000640 1 --2- 172.21.15.2:0/1262786163 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8db0065150 0x7f8db0067600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0001270 tx=0x7f8dc0000bc0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.128+0000 7f8dd7000640 1 -- 172.21.15.2:0/1262786163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dd00add30 msgr2=0x7f8dd0157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:36.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.128+0000 7f8dd7000640 1 --2- 172.21.15.2:0/1262786163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dd00add30 0x7f8dd0157100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00e900 tx=0x7f8dbc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.128+0000 7f8dd7000640 1 -- 172.21.15.2:0/1262786163 shutdown_connections 2024-08-17T02:23:36.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.128+0000 7f8dd7000640 1 --2- 172.21.15.2:0/1262786163 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8db0065150 0x7f8db0067600 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.128+0000 7f8dd7000640 1 --2- 172.21.15.2:0/1262786163 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8dd00ca050 0x7f8dd00a9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.128+0000 7f8dd7000640 1 --2- 172.21.15.2:0/1262786163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dd00add30 0x7f8dd0157100 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.128+0000 7f8dd7000640 1 --2- 172.21.15.2:0/1262786163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8dd00ad960 0x7f8dd01455b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.128+0000 7f8dd7000640 1 -- 172.21.15.2:0/1262786163 >> 172.21.15.2:0/1262786163 conn(0x7f8dd0066e60 msgr2=0x7f8dd0154630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:36.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.128+0000 7f8dd7000640 1 -- 172.21.15.2:0/1262786163 shutdown_connections 2024-08-17T02:23:36.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.128+0000 7f8dd7000640 1 -- 172.21.15.2:0/1262786163 wait complete. 2024-08-17T02:23:36.143 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-08-17T02:23:36.051136+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398628,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576092,"statfs":{"total":773094113280,"available":770637918208,"internally_reserved":0,"allocated":2990080,"data_stored":1787916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.110549"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.976573+0000","last_change":"2024-08-17T02:23:31.975398+0000","last_active":"2024-08-17T02:23:31.976573+0000","last_peered":"2024-08-17T02:23:31.976573+0000","last_clean":"2024-08-17T02:23:31.976573+0000","last_became_active":"2024-08-17T02:23:31.974455+0000","last_became_peered":"2024-08-17T02:23:31.974455+0000","last_unstale":"2024-08-17T02:23:31.976573+0000","last_undegraded":"2024-08-17T02:23:31.976573+0000","last_fullsized":"2024-08-17T02:23:31.976573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:42:58.072658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.975890+0000","last_change":"2024-08-17T02:23:31.971947+0000","last_active":"2024-08-17T02:23:31.975890+0000","last_peered":"2024-08-17T02:23:31.975890+0000","last_clean":"2024-08-17T02:23:31.975890+0000","last_became_active":"2024-08-17T02:23:31.971544+0000","last_became_peered":"2024-08-17T02:23:31.971544+0000","last_unstale":"2024-08-17T02:23:31.975890+0000","last_undegraded":"2024-08-17T02:23:31.975890+0000","last_fullsized":"2024-08-17T02:23:31.975890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:43.020526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.976567+0000","last_change":"2024-08-17T02:23:31.967149+0000","last_active":"2024-08-17T02:23:31.976567+0000","last_peered":"2024-08-17T02:23:31.976567+0000","last_clean":"2024-08-17T02:23:31.976567+0000","last_became_active":"2024-08-17T02:23:31.966332+0000","last_became_peered":"2024-08-17T02:23:31.966332+0000","last_unstale":"2024-08-17T02:23:31.976567+0000","last_undegraded":"2024-08-17T02:23:31.976567+0000","last_fullsized":"2024-08-17T02:23:31.976567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:11:26.255794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.986850+0000","last_change":"2024-08-17T02:23:31.972259+0000","last_active":"2024-08-17T02:23:31.986850+0000","last_peered":"2024-08-17T02:23:31.986850+0000","last_clean":"2024-08-17T02:23:31.986850+0000","last_became_active":"2024-08-17T02:23:31.972071+0000","last_became_peered":"2024-08-17T02:23:31.972071+0000","last_unstale":"2024-08-17T02:23:31.986850+0000","last_undegraded":"2024-08-17T02:23:31.986850+0000","last_fullsized":"2024-08-17T02:23:31.986850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:50:55.354947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.970412+0000","last_change":"2024-08-17T02:23:31.966422+0000","last_active":"2024-08-17T02:23:31.970412+0000","last_peered":"2024-08-17T02:23:31.970412+0000","last_clean":"2024-08-17T02:23:31.970412+0000","last_became_active":"2024-08-17T02:23:31.966173+0000","last_became_peered":"2024-08-17T02:23:31.966173+0000","last_unstale":"2024-08-17T02:23:31.970412+0000","last_undegraded":"2024-08-17T02:23:31.970412+0000","last_fullsized":"2024-08-17T02:23:31.970412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:07:31.568338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983924+0000","last_change":"2024-08-17T02:23:31.966700+0000","last_active":"2024-08-17T02:23:31.983924+0000","last_peered":"2024-08-17T02:23:31.983924+0000","last_clean":"2024-08-17T02:23:31.983924+0000","last_became_active":"2024-08-17T02:23:31.965880+0000","last_became_peered":"2024-08-17T02:23:31.965880+0000","last_unstale":"2024-08-17T02:23:31.983924+0000","last_undegraded":"2024-08-17T02:23:31.983924+0000","last_fullsized":"2024-08-17T02:23:31.983924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:42:58.072658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.970145+0000","last_change":"2024-08-17T02:23:31.963777+0000","last_active":"2024-08-17T02:23:31.970145+0000","last_peered":"2024-08-17T02:23:31.970145+0000","last_clean":"2024-08-17T02:23:31.970145+0000","last_became_active":"2024-08-17T02:23:31.963602+0000","last_became_peered":"2024-08-17T02:23:31.963602+0000","last_unstale":"2024-08-17T02:23:31.970145+0000","last_undegraded":"2024-08-17T02:23:31.970145+0000","last_fullsized":"2024-08-17T02:23:31.970145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:05:46.608052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.987327+0000","last_change":"2024-08-17T02:23:31.986488+0000","last_active":"2024-08-17T02:23:31.987327+0000","last_peered":"2024-08-17T02:23:31.987327+0000","last_clean":"2024-08-17T02:23:31.987327+0000","last_became_active":"2024-08-17T02:23:31.986199+0000","last_became_peered":"2024-08-17T02:23:31.986199+0000","last_unstale":"2024-08-17T02:23:31.987327+0000","last_undegraded":"2024-08-17T02:23:31.987327+0000","last_fullsized":"2024-08-17T02:23:31.987327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:27:58.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985276+0000","last_change":"2024-08-17T02:23:31.982345+0000","last_active":"2024-08-17T02:23:31.985276+0000","last_peered":"2024-08-17T02:23:31.985276+0000","last_clean":"2024-08-17T02:23:31.985276+0000","last_became_active":"2024-08-17T02:23:31.982054+0000","last_became_peered":"2024-08-17T02:23:31.982054+0000","last_unstale":"2024-08-17T02:23:31.985276+0000","last_undegraded":"2024-08-17T02:23:31.985276+0000","last_fullsized":"2024-08-17T02:23:31.985276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:38.802352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985840+0000","last_change":"2024-08-17T02:23:31.984335+0000","last_active":"2024-08-17T02:23:31.985840+0000","last_peered":"2024-08-17T02:23:31.985840+0000","last_clean":"2024-08-17T02:23:31.985840+0000","last_became_active":"2024-08-17T02:23:31.984069+0000","last_became_peered":"2024-08-17T02:23:31.984069+0000","last_unstale":"2024-08-17T02:23:31.985840+0000","last_undegraded":"2024-08-17T02:23:31.985840+0000","last_fullsized":"2024-08-17T02:23:31.985840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:42:34.434625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.988620+0000","last_change":"2024-08-17T02:23:31.987422+0000","last_active":"2024-08-17T02:23:31.988620+0000","last_peered":"2024-08-17T02:23:31.988620+0000","last_clean":"2024-08-17T02:23:31.988620+0000","last_became_active":"2024-08-17T02:23:31.987106+0000","last_became_peered":"2024-08-17T02:23:31.987106+0000","last_unstale":"2024-08-17T02:23:31.988620+0000","last_undegraded":"2024-08-17T02:23:31.988620+0000","last_fullsized":"2024-08-17T02:23:31.988620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:11:26.255794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983816+0000","last_change":"2024-08-17T02:23:31.976682+0000","last_active":"2024-08-17T02:23:31.983816+0000","last_peered":"2024-08-17T02:23:31.983816+0000","last_clean":"2024-08-17T02:23:31.983816+0000","last_became_active":"2024-08-17T02:23:31.976445+0000","last_became_peered":"2024-08-17T02:23:31.976445+0000","last_unstale":"2024-08-17T02:23:31.983816+0000","last_undegraded":"2024-08-17T02:23:31.983816+0000","last_fullsized":"2024-08-17T02:23:31.983816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:55:04.972521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983681+0000","last_change":"2024-08-17T02:23:31.963968+0000","last_active":"2024-08-17T02:23:31.983681+0000","last_peered":"2024-08-17T02:23:31.983681+0000","last_clean":"2024-08-17T02:23:31.983681+0000","last_became_active":"2024-08-17T02:23:31.963710+0000","last_became_peered":"2024-08-17T02:23:31.963710+0000","last_unstale":"2024-08-17T02:23:31.983681+0000","last_undegraded":"2024-08-17T02:23:31.983681+0000","last_fullsized":"2024-08-17T02:23:31.983681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:06.432367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.977187+0000","last_change":"2024-08-17T02:23:31.970021+0000","last_active":"2024-08-17T02:23:31.977187+0000","last_peered":"2024-08-17T02:23:31.977187+0000","last_clean":"2024-08-17T02:23:31.977187+0000","last_became_active":"2024-08-17T02:23:31.969518+0000","last_became_peered":"2024-08-17T02:23:31.969518+0000","last_unstale":"2024-08-17T02:23:31.977187+0000","last_undegraded":"2024-08-17T02:23:31.977187+0000","last_fullsized":"2024-08-17T02:23:31.977187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:25:23.210871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983062+0000","last_change":"2024-08-17T02:23:31.980168+0000","last_active":"2024-08-17T02:23:31.983062+0000","last_peered":"2024-08-17T02:23:31.983062+0000","last_clean":"2024-08-17T02:23:31.983062+0000","last_became_active":"2024-08-17T02:23:31.979853+0000","last_became_peered":"2024-08-17T02:23:31.979853+0000","last_unstale":"2024-08-17T02:23:31.983062+0000","last_undegraded":"2024-08-17T02:23:31.983062+0000","last_fullsized":"2024-08-17T02:23:31.983062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:10.516503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985764+0000","last_change":"2024-08-17T02:23:31.968007+0000","last_active":"2024-08-17T02:23:31.985764+0000","last_peered":"2024-08-17T02:23:31.985764+0000","last_clean":"2024-08-17T02:23:31.985764+0000","last_became_active":"2024-08-17T02:23:31.967725+0000","last_became_peered":"2024-08-17T02:23:31.967725+0000","last_unstale":"2024-08-17T02:23:31.985764+0000","last_undegraded":"2024-08-17T02:23:31.985764+0000","last_fullsized":"2024-08-17T02:23:31.985764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:07:31.568338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.986784+0000","last_change":"2024-08-17T02:23:31.967123+0000","last_active":"2024-08-17T02:23:31.986784+0000","last_peered":"2024-08-17T02:23:31.986784+0000","last_clean":"2024-08-17T02:23:31.986784+0000","last_became_active":"2024-08-17T02:23:31.966871+0000","last_became_peered":"2024-08-17T02:23:31.966871+0000","last_unstale":"2024-08-17T02:23:31.986784+0000","last_undegraded":"2024-08-17T02:23:31.986784+0000","last_fullsized":"2024-08-17T02:23:31.986784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:58.965182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.966662+0000","last_change":"2024-08-17T02:23:31.964474+0000","last_active":"2024-08-17T02:23:31.966662+0000","last_peered":"2024-08-17T02:23:31.966662+0000","last_clean":"2024-08-17T02:23:31.966662+0000","last_became_active":"2024-08-17T02:23:31.964075+0000","last_became_peered":"2024-08-17T02:23:31.964075+0000","last_unstale":"2024-08-17T02:23:31.966662+0000","last_undegraded":"2024-08-17T02:23:31.966662+0000","last_fullsized":"2024-08-17T02:23:31.966662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:57.546866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.970203+0000","last_change":"2024-08-17T02:23:31.965304+0000","last_active":"2024-08-17T02:23:31.970203+0000","last_peered":"2024-08-17T02:23:31.970203+0000","last_clean":"2024-08-17T02:23:31.970203+0000","last_became_active":"2024-08-17T02:23:31.964834+0000","last_became_peered":"2024-08-17T02:23:31.964834+0000","last_unstale":"2024-08-17T02:23:31.970203+0000","last_undegraded":"2024-08-17T02:23:31.970203+0000","last_fullsized":"2024-08-17T02:23:31.970203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:51.027128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.982736+0000","last_change":"2024-08-17T02:23:31.981469+0000","last_active":"2024-08-17T02:23:31.982736+0000","last_peered":"2024-08-17T02:23:31.982736+0000","last_clean":"2024-08-17T02:23:31.982736+0000","last_became_active":"2024-08-17T02:23:31.981200+0000","last_became_peered":"2024-08-17T02:23:31.981200+0000","last_unstale":"2024-08-17T02:23:31.982736+0000","last_undegraded":"2024-08-17T02:23:31.982736+0000","last_fullsized":"2024-08-17T02:23:31.982736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:43.020526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.977261+0000","last_change":"2024-08-17T02:23:31.965936+0000","last_active":"2024-08-17T02:23:31.977261+0000","last_peered":"2024-08-17T02:23:31.977261+0000","last_clean":"2024-08-17T02:23:31.977261+0000","last_became_active":"2024-08-17T02:23:31.965076+0000","last_became_peered":"2024-08-17T02:23:31.965076+0000","last_unstale":"2024-08-17T02:23:31.977261+0000","last_undegraded":"2024-08-17T02:23:31.977261+0000","last_fullsized":"2024-08-17T02:23:31.977261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:39.645299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983907+0000","last_change":"2024-08-17T02:23:31.964668+0000","last_active":"2024-08-17T02:23:31.983907+0000","last_peered":"2024-08-17T02:23:31.983907+0000","last_clean":"2024-08-17T02:23:31.983907+0000","last_became_active":"2024-08-17T02:23:31.964419+0000","last_became_peered":"2024-08-17T02:23:31.964419+0000","last_unstale":"2024-08-17T02:23:31.983907+0000","last_undegraded":"2024-08-17T02:23:31.983907+0000","last_fullsized":"2024-08-17T02:23:31.983907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:37.211325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985700+0000","last_change":"2024-08-17T02:23:31.984594+0000","last_active":"2024-08-17T02:23:31.985700+0000","last_peered":"2024-08-17T02:23:31.985700+0000","last_clean":"2024-08-17T02:23:31.985700+0000","last_became_active":"2024-08-17T02:23:31.984322+0000","last_became_peered":"2024-08-17T02:23:31.984322+0000","last_unstale":"2024-08-17T02:23:31.985700+0000","last_undegraded":"2024-08-17T02:23:31.985700+0000","last_fullsized":"2024-08-17T02:23:31.985700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:37.211325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985777+0000","last_change":"2024-08-17T02:23:31.974171+0000","last_active":"2024-08-17T02:23:31.985777+0000","last_peered":"2024-08-17T02:23:31.985777+0000","last_clean":"2024-08-17T02:23:31.985777+0000","last_became_active":"2024-08-17T02:23:31.973932+0000","last_became_peered":"2024-08-17T02:23:31.973932+0000","last_unstale":"2024-08-17T02:23:31.985777+0000","last_undegraded":"2024-08-17T02:23:31.985777+0000","last_fullsized":"2024-08-17T02:23:31.985777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:06.432367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985116+0000","last_change":"2024-08-17T02:23:31.977090+0000","last_active":"2024-08-17T02:23:31.985116+0000","last_peered":"2024-08-17T02:23:31.985116+0000","last_clean":"2024-08-17T02:23:31.985116+0000","last_became_active":"2024-08-17T02:23:31.976653+0000","last_became_peered":"2024-08-17T02:23:31.976653+0000","last_unstale":"2024-08-17T02:23:31.985116+0000","last_undegraded":"2024-08-17T02:23:31.985116+0000","last_fullsized":"2024-08-17T02:23:31.985116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:38.802352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.966162+0000","last_change":"2024-08-17T02:23:31.962013+0000","last_active":"2024-08-17T02:23:31.966162+0000","last_peered":"2024-08-17T02:23:31.966162+0000","last_clean":"2024-08-17T02:23:31.966162+0000","last_became_active":"2024-08-17T02:23:31.961662+0000","last_became_peered":"2024-08-17T02:23:31.961662+0000","last_unstale":"2024-08-17T02:23:31.966162+0000","last_undegraded":"2024-08-17T02:23:31.966162+0000","last_fullsized":"2024-08-17T02:23:31.966162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:07:14.545767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.967130+0000","last_change":"2024-08-17T02:23:31.963911+0000","last_active":"2024-08-17T02:23:31.967130+0000","last_peered":"2024-08-17T02:23:31.967130+0000","last_clean":"2024-08-17T02:23:31.967130+0000","last_became_active":"2024-08-17T02:23:31.963534+0000","last_became_peered":"2024-08-17T02:23:31.963534+0000","last_unstale":"2024-08-17T02:23:31.967130+0000","last_undegraded":"2024-08-17T02:23:31.967130+0000","last_fullsized":"2024-08-17T02:23:31.967130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:11:26.255794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985361+0000","last_change":"2024-08-17T02:23:31.977370+0000","last_active":"2024-08-17T02:23:31.985361+0000","last_peered":"2024-08-17T02:23:31.985361+0000","last_clean":"2024-08-17T02:23:31.985361+0000","last_became_active":"2024-08-17T02:23:31.976692+0000","last_became_peered":"2024-08-17T02:23:31.976692+0000","last_unstale":"2024-08-17T02:23:31.985361+0000","last_undegraded":"2024-08-17T02:23:31.985361+0000","last_fullsized":"2024-08-17T02:23:31.985361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:39.645299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.977272+0000","last_change":"2024-08-17T02:23:31.966212+0000","last_active":"2024-08-17T02:23:31.977272+0000","last_peered":"2024-08-17T02:23:31.977272+0000","last_clean":"2024-08-17T02:23:31.977272+0000","last_became_active":"2024-08-17T02:23:31.965470+0000","last_became_peered":"2024-08-17T02:23:31.965470+0000","last_unstale":"2024-08-17T02:23:31.977272+0000","last_undegraded":"2024-08-17T02:23:31.977272+0000","last_fullsized":"2024-08-17T02:23:31.977272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:06.432367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983877+0000","last_change":"2024-08-17T02:23:31.964525+0000","last_active":"2024-08-17T02:23:31.983877+0000","last_peered":"2024-08-17T02:23:31.983877+0000","last_clean":"2024-08-17T02:23:31.983877+0000","last_became_active":"2024-08-17T02:23:31.963132+0000","last_became_peered":"2024-08-17T02:23:31.963132+0000","last_unstale":"2024-08-17T02:23:31.983877+0000","last_undegraded":"2024-08-17T02:23:31.983877+0000","last_fullsized":"2024-08-17T02:23:31.983877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:30.415547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983642+0000","last_change":"2024-08-17T02:23:31.982370+0000","last_active":"2024-08-17T02:23:31.983642+0000","last_peered":"2024-08-17T02:23:31.983642+0000","last_clean":"2024-08-17T02:23:31.983642+0000","last_became_active":"2024-08-17T02:23:31.982169+0000","last_became_peered":"2024-08-17T02:23:31.982169+0000","last_unstale":"2024-08-17T02:23:31.983642+0000","last_undegraded":"2024-08-17T02:23:31.983642+0000","last_fullsized":"2024-08-17T02:23:31.983642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:02.185169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.980609+0000","last_change":"2024-08-17T02:23:31.978196+0000","last_active":"2024-08-17T02:23:31.980609+0000","last_peered":"2024-08-17T02:23:31.980609+0000","last_clean":"2024-08-17T02:23:31.980609+0000","last_became_active":"2024-08-17T02:23:31.977913+0000","last_became_peered":"2024-08-17T02:23:31.977913+0000","last_unstale":"2024-08-17T02:23:31.980609+0000","last_undegraded":"2024-08-17T02:23:31.980609+0000","last_fullsized":"2024-08-17T02:23:31.980609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:37.211325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.980234+0000","last_change":"2024-08-17T02:23:31.975460+0000","last_active":"2024-08-17T02:23:31.980234+0000","last_peered":"2024-08-17T02:23:31.980234+0000","last_clean":"2024-08-17T02:23:31.980234+0000","last_became_active":"2024-08-17T02:23:31.972459+0000","last_became_peered":"2024-08-17T02:23:31.972459+0000","last_unstale":"2024-08-17T02:23:31.980234+0000","last_undegraded":"2024-08-17T02:23:31.980234+0000","last_fullsized":"2024-08-17T02:23:31.980234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:02.185169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983707+0000","last_change":"2024-08-17T02:23:30.979772+0000","last_active":"2024-08-17T02:23:31.983707+0000","last_peered":"2024-08-17T02:23:31.983707+0000","last_clean":"2024-08-17T02:23:31.983707+0000","last_became_active":"2024-08-17T02:23:30.979520+0000","last_became_peered":"2024-08-17T02:23:30.979520+0000","last_unstale":"2024-08-17T02:23:31.983707+0000","last_undegraded":"2024-08-17T02:23:31.983707+0000","last_fullsized":"2024-08-17T02:23:31.983707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:28.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.981114+0000","last_change":"2024-08-17T02:23:31.973462+0000","last_active":"2024-08-17T02:23:31.981114+0000","last_peered":"2024-08-17T02:23:31.981114+0000","last_clean":"2024-08-17T02:23:31.981114+0000","last_became_active":"2024-08-17T02:23:31.973180+0000","last_became_peered":"2024-08-17T02:23:31.973180+0000","last_unstale":"2024-08-17T02:23:31.981114+0000","last_undegraded":"2024-08-17T02:23:31.981114+0000","last_fullsized":"2024-08-17T02:23:31.981114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:43.020526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985474+0000","last_change":"2024-08-17T02:23:30.974773+0000","last_active":"2024-08-17T02:23:31.985474+0000","last_peered":"2024-08-17T02:23:31.985474+0000","last_clean":"2024-08-17T02:23:31.985474+0000","last_became_active":"2024-08-17T02:23:30.974578+0000","last_became_peered":"2024-08-17T02:23:30.974578+0000","last_unstale":"2024-08-17T02:23:31.985474+0000","last_undegraded":"2024-08-17T02:23:31.985474+0000","last_fullsized":"2024-08-17T02:23:31.985474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:55:03.969746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.956993+0000","last_change":"2024-08-17T02:23:30.968559+0000","last_active":"2024-08-17T02:23:31.956993+0000","last_peered":"2024-08-17T02:23:31.956993+0000","last_clean":"2024-08-17T02:23:31.956993+0000","last_became_active":"2024-08-17T02:23:30.968312+0000","last_became_peered":"2024-08-17T02:23:30.968312+0000","last_unstale":"2024-08-17T02:23:31.956993+0000","last_undegraded":"2024-08-17T02:23:31.956993+0000","last_fullsized":"2024-08-17T02:23:31.956993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:01.947289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.982474+0000","last_change":"2024-08-17T02:23:31.962531+0000","last_active":"2024-08-17T02:23:31.982474+0000","last_peered":"2024-08-17T02:23:31.982474+0000","last_clean":"2024-08-17T02:23:31.982474+0000","last_became_active":"2024-08-17T02:23:31.962242+0000","last_became_peered":"2024-08-17T02:23:31.962242+0000","last_unstale":"2024-08-17T02:23:31.982474+0000","last_undegraded":"2024-08-17T02:23:31.982474+0000","last_fullsized":"2024-08-17T02:23:31.982474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:11:26.255794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.952106+0000","last_change":"2024-08-17T02:23:30.972145+0000","last_active":"2024-08-17T02:23:31.952106+0000","last_peered":"2024-08-17T02:23:31.952106+0000","last_clean":"2024-08-17T02:23:31.952106+0000","last_became_active":"2024-08-17T02:23:30.969098+0000","last_became_peered":"2024-08-17T02:23:30.969098+0000","last_unstale":"2024-08-17T02:23:31.952106+0000","last_undegraded":"2024-08-17T02:23:31.952106+0000","last_fullsized":"2024-08-17T02:23:31.952106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:20.670802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.967039+0000","last_change":"2024-08-17T02:23:31.963819+0000","last_active":"2024-08-17T02:23:31.967039+0000","last_peered":"2024-08-17T02:23:31.967039+0000","last_clean":"2024-08-17T02:23:31.967039+0000","last_became_active":"2024-08-17T02:23:31.963535+0000","last_became_peered":"2024-08-17T02:23:31.963535+0000","last_unstale":"2024-08-17T02:23:31.967039+0000","last_undegraded":"2024-08-17T02:23:31.967039+0000","last_fullsized":"2024-08-17T02:23:31.967039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:42:34.434625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.965666+0000","last_change":"2024-08-17T02:23:30.970927+0000","last_active":"2024-08-17T02:23:31.965666+0000","last_peered":"2024-08-17T02:23:31.965666+0000","last_clean":"2024-08-17T02:23:31.965666+0000","last_became_active":"2024-08-17T02:23:30.970635+0000","last_became_peered":"2024-08-17T02:23:30.970635+0000","last_unstale":"2024-08-17T02:23:31.965666+0000","last_undegraded":"2024-08-17T02:23:31.965666+0000","last_fullsized":"2024-08-17T02:23:31.965666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:20.670802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983562+0000","last_change":"2024-08-17T02:23:31.962830+0000","last_active":"2024-08-17T02:23:31.983562+0000","last_peered":"2024-08-17T02:23:31.983562+0000","last_clean":"2024-08-17T02:23:31.983562+0000","last_became_active":"2024-08-17T02:23:31.962559+0000","last_became_peered":"2024-08-17T02:23:31.962559+0000","last_unstale":"2024-08-17T02:23:31.983562+0000","last_undegraded":"2024-08-17T02:23:31.983562+0000","last_fullsized":"2024-08-17T02:23:31.983562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:10.516503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.949546+0000","last_change":"2024-08-17T02:23:30.970596+0000","last_active":"2024-08-17T02:23:31.949546+0000","last_peered":"2024-08-17T02:23:31.949546+0000","last_clean":"2024-08-17T02:23:31.949546+0000","last_became_active":"2024-08-17T02:23:30.970344+0000","last_became_peered":"2024-08-17T02:23:30.970344+0000","last_unstale":"2024-08-17T02:23:31.949546+0000","last_undegraded":"2024-08-17T02:23:31.949546+0000","last_fullsized":"2024-08-17T02:23:31.949546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:55:03.969746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.984046+0000","last_change":"2024-08-17T02:23:31.982745+0000","last_active":"2024-08-17T02:23:31.984046+0000","last_peered":"2024-08-17T02:23:31.984046+0000","last_clean":"2024-08-17T02:23:31.984046+0000","last_became_active":"2024-08-17T02:23:31.980074+0000","last_became_peered":"2024-08-17T02:23:31.980074+0000","last_unstale":"2024-08-17T02:23:31.984046+0000","last_undegraded":"2024-08-17T02:23:31.984046+0000","last_fullsized":"2024-08-17T02:23:31.984046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:10.516503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.987068+0000","last_change":"2024-08-17T02:23:30.976633+0000","last_active":"2024-08-17T02:23:31.987068+0000","last_peered":"2024-08-17T02:23:31.987068+0000","last_clean":"2024-08-17T02:23:31.987068+0000","last_became_active":"2024-08-17T02:23:30.976281+0000","last_became_peered":"2024-08-17T02:23:30.976281+0000","last_unstale":"2024-08-17T02:23:31.987068+0000","last_undegraded":"2024-08-17T02:23:31.987068+0000","last_fullsized":"2024-08-17T02:23:31.987068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:40.754285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983904+0000","last_change":"2024-08-17T02:23:31.977353+0000","last_active":"2024-08-17T02:23:31.983904+0000","last_peered":"2024-08-17T02:23:31.983904+0000","last_clean":"2024-08-17T02:23:31.983904+0000","last_became_active":"2024-08-17T02:23:31.976904+0000","last_became_peered":"2024-08-17T02:23:31.976904+0000","last_unstale":"2024-08-17T02:23:31.983904+0000","last_undegraded":"2024-08-17T02:23:31.983904+0000","last_fullsized":"2024-08-17T02:23:31.983904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:02.950063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.989041+0000","last_change":"2024-08-17T02:23:30.975577+0000","last_active":"2024-08-17T02:23:31.989041+0000","last_peered":"2024-08-17T02:23:31.989041+0000","last_clean":"2024-08-17T02:23:31.989041+0000","last_became_active":"2024-08-17T02:23:30.975345+0000","last_became_peered":"2024-08-17T02:23:30.975345+0000","last_unstale":"2024-08-17T02:23:31.989041+0000","last_undegraded":"2024-08-17T02:23:31.989041+0000","last_fullsized":"2024-08-17T02:23:31.989041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:40.754285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.970187+0000","last_change":"2024-08-17T02:23:31.965120+0000","last_active":"2024-08-17T02:23:31.970187+0000","last_peered":"2024-08-17T02:23:31.970187+0000","last_clean":"2024-08-17T02:23:31.970187+0000","last_became_active":"2024-08-17T02:23:31.964587+0000","last_became_peered":"2024-08-17T02:23:31.964587+0000","last_unstale":"2024-08-17T02:23:31.970187+0000","last_undegraded":"2024-08-17T02:23:31.970187+0000","last_fullsized":"2024-08-17T02:23:31.970187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:39:53.991015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985350+0000","last_change":"2024-08-17T02:23:30.972844+0000","last_active":"2024-08-17T02:23:31.985350+0000","last_peered":"2024-08-17T02:23:31.985350+0000","last_clean":"2024-08-17T02:23:31.985350+0000","last_became_active":"2024-08-17T02:23:30.972369+0000","last_became_peered":"2024-08-17T02:23:30.972369+0000","last_unstale":"2024-08-17T02:23:31.985350+0000","last_undegraded":"2024-08-17T02:23:31.985350+0000","last_fullsized":"2024-08-17T02:23:31.985350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:36:25.509573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.977171+0000","last_change":"2024-08-17T02:23:31.963289+0000","last_active":"2024-08-17T02:23:31.977171+0000","last_peered":"2024-08-17T02:23:31.977171+0000","last_clean":"2024-08-17T02:23:31.977171+0000","last_became_active":"2024-08-17T02:23:31.962870+0000","last_became_peered":"2024-08-17T02:23:31.962870+0000","last_unstale":"2024-08-17T02:23:31.977171+0000","last_undegraded":"2024-08-17T02:23:31.977171+0000","last_fullsized":"2024-08-17T02:23:31.977171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:03:52.570659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.948335+0000","last_change":"2024-08-17T02:23:30.973479+0000","last_active":"2024-08-17T02:23:31.948335+0000","last_peered":"2024-08-17T02:23:31.948335+0000","last_clean":"2024-08-17T02:23:31.948335+0000","last_became_active":"2024-08-17T02:23:30.973209+0000","last_became_peered":"2024-08-17T02:23:30.973209+0000","last_unstale":"2024-08-17T02:23:31.948335+0000","last_undegraded":"2024-08-17T02:23:31.948335+0000","last_fullsized":"2024-08-17T02:23:31.948335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:28.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.974767+0000","last_change":"2024-08-17T02:23:31.973100+0000","last_active":"2024-08-17T02:23:31.974767+0000","last_peered":"2024-08-17T02:23:31.974767+0000","last_clean":"2024-08-17T02:23:31.974767+0000","last_became_active":"2024-08-17T02:23:31.972794+0000","last_became_peered":"2024-08-17T02:23:31.972794+0000","last_unstale":"2024-08-17T02:23:31.974767+0000","last_undegraded":"2024-08-17T02:23:31.974767+0000","last_fullsized":"2024-08-17T02:23:31.974767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:58.965182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.954123+0000","last_change":"2024-08-17T02:23:30.970722+0000","last_active":"2024-08-17T02:23:31.954123+0000","last_peered":"2024-08-17T02:23:31.954123+0000","last_clean":"2024-08-17T02:23:31.954123+0000","last_became_active":"2024-08-17T02:23:30.970468+0000","last_became_peered":"2024-08-17T02:23:30.970468+0000","last_unstale":"2024-08-17T02:23:31.954123+0000","last_undegraded":"2024-08-17T02:23:31.954123+0000","last_fullsized":"2024-08-17T02:23:31.954123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:28.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.980626+0000","last_change":"2024-08-17T02:23:31.978226+0000","last_active":"2024-08-17T02:23:31.980626+0000","last_peered":"2024-08-17T02:23:31.980626+0000","last_clean":"2024-08-17T02:23:31.980626+0000","last_became_active":"2024-08-17T02:23:31.977930+0000","last_became_peered":"2024-08-17T02:23:31.977930+0000","last_unstale":"2024-08-17T02:23:31.980626+0000","last_undegraded":"2024-08-17T02:23:31.980626+0000","last_fullsized":"2024-08-17T02:23:31.980626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:10.516503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.979877+0000","last_change":"2024-08-17T02:23:30.965657+0000","last_active":"2024-08-17T02:23:31.979877+0000","last_peered":"2024-08-17T02:23:31.979877+0000","last_clean":"2024-08-17T02:23:31.979877+0000","last_became_active":"2024-08-17T02:23:30.965304+0000","last_became_peered":"2024-08-17T02:23:30.965304+0000","last_unstale":"2024-08-17T02:23:31.979877+0000","last_undegraded":"2024-08-17T02:23:31.979877+0000","last_fullsized":"2024-08-17T02:23:31.979877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:01.947289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.982558+0000","last_change":"2024-08-17T02:23:31.981260+0000","last_active":"2024-08-17T02:23:31.982558+0000","last_peered":"2024-08-17T02:23:31.982558+0000","last_clean":"2024-08-17T02:23:31.982558+0000","last_became_active":"2024-08-17T02:23:31.980747+0000","last_became_peered":"2024-08-17T02:23:31.980747+0000","last_unstale":"2024-08-17T02:23:31.982558+0000","last_undegraded":"2024-08-17T02:23:31.982558+0000","last_fullsized":"2024-08-17T02:23:31.982558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:30.415547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.984093+0000","last_change":"2024-08-17T02:23:30.968562+0000","last_active":"2024-08-17T02:23:31.984093+0000","last_peered":"2024-08-17T02:23:31.984093+0000","last_clean":"2024-08-17T02:23:31.984093+0000","last_became_active":"2024-08-17T02:23:30.968264+0000","last_became_peered":"2024-08-17T02:23:30.968264+0000","last_unstale":"2024-08-17T02:23:31.984093+0000","last_undegraded":"2024-08-17T02:23:31.984093+0000","last_fullsized":"2024-08-17T02:23:31.984093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:48:44.495463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.974695+0000","last_change":"2024-08-17T02:23:31.972997+0000","last_active":"2024-08-17T02:23:31.974695+0000","last_peered":"2024-08-17T02:23:31.974695+0000","last_clean":"2024-08-17T02:23:31.974695+0000","last_became_active":"2024-08-17T02:23:31.972782+0000","last_became_peered":"2024-08-17T02:23:31.972782+0000","last_unstale":"2024-08-17T02:23:31.974695+0000","last_undegraded":"2024-08-17T02:23:31.974695+0000","last_fullsized":"2024-08-17T02:23:31.974695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:50:55.354947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985261+0000","last_change":"2024-08-17T02:23:30.973992+0000","last_active":"2024-08-17T02:23:31.985261+0000","last_peered":"2024-08-17T02:23:31.985261+0000","last_clean":"2024-08-17T02:23:31.985261+0000","last_became_active":"2024-08-17T02:23:30.973677+0000","last_became_peered":"2024-08-17T02:23:30.973677+0000","last_unstale":"2024-08-17T02:23:31.985261+0000","last_undegraded":"2024-08-17T02:23:31.985261+0000","last_fullsized":"2024-08-17T02:23:31.985261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:28.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.976099+0000","last_change":"2024-08-17T02:23:31.973617+0000","last_active":"2024-08-17T02:23:31.976099+0000","last_peered":"2024-08-17T02:23:31.976099+0000","last_clean":"2024-08-17T02:23:31.976099+0000","last_became_active":"2024-08-17T02:23:31.973290+0000","last_became_peered":"2024-08-17T02:23:31.973290+0000","last_unstale":"2024-08-17T02:23:31.976099+0000","last_undegraded":"2024-08-17T02:23:31.976099+0000","last_fullsized":"2024-08-17T02:23:31.976099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:06.432367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.977182+0000","last_change":"2024-08-17T02:23:30.968994+0000","last_active":"2024-08-17T02:23:31.977182+0000","last_peered":"2024-08-17T02:23:31.977182+0000","last_clean":"2024-08-17T02:23:31.977182+0000","last_became_active":"2024-08-17T02:23:30.968655+0000","last_became_peered":"2024-08-17T02:23:30.968655+0000","last_unstale":"2024-08-17T02:23:31.977182+0000","last_undegraded":"2024-08-17T02:23:31.977182+0000","last_fullsized":"2024-08-17T02:23:31.977182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:20.670802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.986832+0000","last_change":"2024-08-17T02:23:31.968122+0000","last_active":"2024-08-17T02:23:31.986832+0000","last_peered":"2024-08-17T02:23:31.986832+0000","last_clean":"2024-08-17T02:23:31.986832+0000","last_became_active":"2024-08-17T02:23:31.967900+0000","last_became_peered":"2024-08-17T02:23:31.967900+0000","last_unstale":"2024-08-17T02:23:31.986832+0000","last_undegraded":"2024-08-17T02:23:31.986832+0000","last_fullsized":"2024-08-17T02:23:31.986832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:51.027128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.950822+0000","last_change":"2024-08-17T02:23:30.958979+0000","last_active":"2024-08-17T02:23:31.950822+0000","last_peered":"2024-08-17T02:23:31.950822+0000","last_clean":"2024-08-17T02:23:31.950822+0000","last_became_active":"2024-08-17T02:23:30.958685+0000","last_became_peered":"2024-08-17T02:23:30.958685+0000","last_unstale":"2024-08-17T02:23:31.950822+0000","last_undegraded":"2024-08-17T02:23:31.950822+0000","last_fullsized":"2024-08-17T02:23:31.950822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:20.670802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985565+0000","last_change":"2024-08-17T02:23:31.983473+0000","last_active":"2024-08-17T02:23:31.985565+0000","last_peered":"2024-08-17T02:23:31.985565+0000","last_clean":"2024-08-17T02:23:31.985565+0000","last_became_active":"2024-08-17T02:23:31.983267+0000","last_became_peered":"2024-08-17T02:23:31.983267+0000","last_unstale":"2024-08-17T02:23:31.985565+0000","last_undegraded":"2024-08-17T02:23:31.985565+0000","last_fullsized":"2024-08-17T02:23:31.985565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:43.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.949384+0000","last_change":"2024-08-17T02:23:27.953699+0000","last_active":"2024-08-17T02:23:31.949384+0000","last_peered":"2024-08-17T02:23:31.949384+0000","last_clean":"2024-08-17T02:23:31.949384+0000","last_became_active":"2024-08-17T02:23:27.952879+0000","last_became_peered":"2024-08-17T02:23:27.952879+0000","last_unstale":"2024-08-17T02:23:31.949384+0000","last_undegraded":"2024-08-17T02:23:31.949384+0000","last_fullsized":"2024-08-17T02:23:31.949384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:26.811202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:26.811202+0000","last_clean_scrub_stamp":"2024-08-17T02:23:26.811202+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:48.565059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.946954+0000","last_change":"2024-08-17T02:23:30.951704+0000","last_active":"2024-08-17T02:23:31.946954+0000","last_peered":"2024-08-17T02:23:31.946954+0000","last_clean":"2024-08-17T02:23:31.946954+0000","last_became_active":"2024-08-17T02:23:30.951462+0000","last_became_peered":"2024-08-17T02:23:30.951462+0000","last_unstale":"2024-08-17T02:23:31.946954+0000","last_undegraded":"2024-08-17T02:23:31.946954+0000","last_fullsized":"2024-08-17T02:23:31.946954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:01.947289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985590+0000","last_change":"2024-08-17T02:23:31.982162+0000","last_active":"2024-08-17T02:23:31.985590+0000","last_peered":"2024-08-17T02:23:31.985590+0000","last_clean":"2024-08-17T02:23:31.985590+0000","last_became_active":"2024-08-17T02:23:31.981826+0000","last_became_peered":"2024-08-17T02:23:31.981826+0000","last_unstale":"2024-08-17T02:23:31.985590+0000","last_undegraded":"2024-08-17T02:23:31.985590+0000","last_fullsized":"2024-08-17T02:23:31.985590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:07:31.568338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.949295+0000","last_change":"2024-08-17T02:23:30.960984+0000","last_active":"2024-08-17T02:23:31.949295+0000","last_peered":"2024-08-17T02:23:31.949295+0000","last_clean":"2024-08-17T02:23:31.949295+0000","last_became_active":"2024-08-17T02:23:30.960649+0000","last_became_peered":"2024-08-17T02:23:30.960649+0000","last_unstale":"2024-08-17T02:23:31.949295+0000","last_undegraded":"2024-08-17T02:23:31.949295+0000","last_fullsized":"2024-08-17T02:23:31.949295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:55:03.969746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983295+0000","last_change":"2024-08-17T02:23:31.980993+0000","last_active":"2024-08-17T02:23:31.983295+0000","last_peered":"2024-08-17T02:23:31.983295+0000","last_clean":"2024-08-17T02:23:31.983295+0000","last_became_active":"2024-08-17T02:23:31.980759+0000","last_became_peered":"2024-08-17T02:23:31.980759+0000","last_unstale":"2024-08-17T02:23:31.983295+0000","last_undegraded":"2024-08-17T02:23:31.983295+0000","last_fullsized":"2024-08-17T02:23:31.983295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:55.653301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.950251+0000","last_change":"2024-08-17T02:23:30.962851+0000","last_active":"2024-08-17T02:23:31.950251+0000","last_peered":"2024-08-17T02:23:31.950251+0000","last_clean":"2024-08-17T02:23:31.950251+0000","last_became_active":"2024-08-17T02:23:30.962554+0000","last_became_peered":"2024-08-17T02:23:30.962554+0000","last_unstale":"2024-08-17T02:23:31.950251+0000","last_undegraded":"2024-08-17T02:23:31.950251+0000","last_fullsized":"2024-08-17T02:23:31.950251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:36:25.509573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.960964+0000","last_change":"2024-08-17T02:23:31.957810+0000","last_active":"2024-08-17T02:23:31.960964+0000","last_peered":"2024-08-17T02:23:31.960964+0000","last_clean":"2024-08-17T02:23:31.960964+0000","last_became_active":"2024-08-17T02:23:31.957542+0000","last_became_peered":"2024-08-17T02:23:31.957542+0000","last_unstale":"2024-08-17T02:23:31.960964+0000","last_undegraded":"2024-08-17T02:23:31.960964+0000","last_fullsized":"2024-08-17T02:23:31.960964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:55.653301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.948429+0000","last_change":"2024-08-17T02:23:30.964915+0000","last_active":"2024-08-17T02:23:31.948429+0000","last_peered":"2024-08-17T02:23:31.948429+0000","last_clean":"2024-08-17T02:23:31.948429+0000","last_became_active":"2024-08-17T02:23:30.964673+0000","last_became_peered":"2024-08-17T02:23:30.964673+0000","last_unstale":"2024-08-17T02:23:31.948429+0000","last_undegraded":"2024-08-17T02:23:31.948429+0000","last_fullsized":"2024-08-17T02:23:31.948429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:40.754285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.976470+0000","last_change":"2024-08-17T02:23:31.971758+0000","last_active":"2024-08-17T02:23:31.976470+0000","last_peered":"2024-08-17T02:23:31.976470+0000","last_clean":"2024-08-17T02:23:31.976470+0000","last_became_active":"2024-08-17T02:23:31.971467+0000","last_became_peered":"2024-08-17T02:23:31.971467+0000","last_unstale":"2024-08-17T02:23:31.976470+0000","last_undegraded":"2024-08-17T02:23:31.976470+0000","last_fullsized":"2024-08-17T02:23:31.976470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:36.029248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.945915+0000","last_change":"2024-08-17T02:23:30.959168+0000","last_active":"2024-08-17T02:23:31.945915+0000","last_peered":"2024-08-17T02:23:31.945915+0000","last_clean":"2024-08-17T02:23:31.945915+0000","last_became_active":"2024-08-17T02:23:30.958720+0000","last_became_peered":"2024-08-17T02:23:30.958720+0000","last_unstale":"2024-08-17T02:23:31.945915+0000","last_undegraded":"2024-08-17T02:23:31.945915+0000","last_fullsized":"2024-08-17T02:23:31.945915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:35.026473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983315+0000","last_change":"2024-08-17T02:23:31.964694+0000","last_active":"2024-08-17T02:23:31.983315+0000","last_peered":"2024-08-17T02:23:31.983315+0000","last_clean":"2024-08-17T02:23:31.983315+0000","last_became_active":"2024-08-17T02:23:31.963180+0000","last_became_peered":"2024-08-17T02:23:31.963180+0000","last_unstale":"2024-08-17T02:23:31.983315+0000","last_undegraded":"2024-08-17T02:23:31.983315+0000","last_fullsized":"2024-08-17T02:23:31.983315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:39.645299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.949003+0000","last_change":"2024-08-17T02:23:30.961092+0000","last_active":"2024-08-17T02:23:31.949003+0000","last_peered":"2024-08-17T02:23:31.949003+0000","last_clean":"2024-08-17T02:23:31.949003+0000","last_became_active":"2024-08-17T02:23:30.960812+0000","last_became_peered":"2024-08-17T02:23:30.960812+0000","last_unstale":"2024-08-17T02:23:31.949003+0000","last_undegraded":"2024-08-17T02:23:31.949003+0000","last_fullsized":"2024-08-17T02:23:31.949003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:40.754285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.966415+0000","last_change":"2024-08-17T02:23:31.961035+0000","last_active":"2024-08-17T02:23:31.966415+0000","last_peered":"2024-08-17T02:23:31.966415+0000","last_clean":"2024-08-17T02:23:31.966415+0000","last_became_active":"2024-08-17T02:23:31.960738+0000","last_became_peered":"2024-08-17T02:23:31.960738+0000","last_unstale":"2024-08-17T02:23:31.966415+0000","last_undegraded":"2024-08-17T02:23:31.966415+0000","last_fullsized":"2024-08-17T02:23:31.966415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:27:58.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.946096+0000","last_change":"2024-08-17T02:23:30.962881+0000","last_active":"2024-08-17T02:23:31.946096+0000","last_peered":"2024-08-17T02:23:31.946096+0000","last_clean":"2024-08-17T02:23:31.946096+0000","last_became_active":"2024-08-17T02:23:30.962620+0000","last_became_peered":"2024-08-17T02:23:30.962620+0000","last_unstale":"2024-08-17T02:23:31.946096+0000","last_undegraded":"2024-08-17T02:23:31.946096+0000","last_fullsized":"2024-08-17T02:23:31.946096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:55:03.969746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.982546+0000","last_change":"2024-08-17T02:23:31.962220+0000","last_active":"2024-08-17T02:23:31.982546+0000","last_peered":"2024-08-17T02:23:31.982546+0000","last_clean":"2024-08-17T02:23:31.982546+0000","last_became_active":"2024-08-17T02:23:31.961166+0000","last_became_peered":"2024-08-17T02:23:31.961166+0000","last_unstale":"2024-08-17T02:23:31.982546+0000","last_undegraded":"2024-08-17T02:23:31.982546+0000","last_fullsized":"2024-08-17T02:23:31.982546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:43.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.976607+0000","last_change":"2024-08-17T02:23:30.966054+0000","last_active":"2024-08-17T02:23:31.976607+0000","last_peered":"2024-08-17T02:23:31.976607+0000","last_clean":"2024-08-17T02:23:31.976607+0000","last_became_active":"2024-08-17T02:23:30.965784+0000","last_became_peered":"2024-08-17T02:23:30.965784+0000","last_unstale":"2024-08-17T02:23:31.976607+0000","last_undegraded":"2024-08-17T02:23:31.976607+0000","last_fullsized":"2024-08-17T02:23:31.976607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:01.947289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.976523+0000","last_change":"2024-08-17T02:23:31.965797+0000","last_active":"2024-08-17T02:23:31.976523+0000","last_peered":"2024-08-17T02:23:31.976523+0000","last_clean":"2024-08-17T02:23:31.976523+0000","last_became_active":"2024-08-17T02:23:31.965545+0000","last_became_peered":"2024-08-17T02:23:31.965545+0000","last_unstale":"2024-08-17T02:23:31.976523+0000","last_undegraded":"2024-08-17T02:23:31.976523+0000","last_fullsized":"2024-08-17T02:23:31.976523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:45:56.326425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.949197+0000","last_change":"2024-08-17T02:23:30.965869+0000","last_active":"2024-08-17T02:23:31.949197+0000","last_peered":"2024-08-17T02:23:31.949197+0000","last_clean":"2024-08-17T02:23:31.949197+0000","last_became_active":"2024-08-17T02:23:30.965608+0000","last_became_peered":"2024-08-17T02:23:30.965608+0000","last_unstale":"2024-08-17T02:23:31.949197+0000","last_undegraded":"2024-08-17T02:23:31.949197+0000","last_fullsized":"2024-08-17T02:23:31.949197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:35.026473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983948+0000","last_change":"2024-08-17T02:23:31.978413+0000","last_active":"2024-08-17T02:23:31.983948+0000","last_peered":"2024-08-17T02:23:31.983948+0000","last_clean":"2024-08-17T02:23:31.983948+0000","last_became_active":"2024-08-17T02:23:31.978007+0000","last_became_peered":"2024-08-17T02:23:31.978007+0000","last_unstale":"2024-08-17T02:23:31.983948+0000","last_undegraded":"2024-08-17T02:23:31.983948+0000","last_fullsized":"2024-08-17T02:23:31.983948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:41.757059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.945306+0000","last_change":"2024-08-17T02:23:30.964876+0000","last_active":"2024-08-17T02:23:31.945306+0000","last_peered":"2024-08-17T02:23:31.945306+0000","last_clean":"2024-08-17T02:23:31.945306+0000","last_became_active":"2024-08-17T02:23:30.964624+0000","last_became_peered":"2024-08-17T02:23:30.964624+0000","last_unstale":"2024-08-17T02:23:31.945306+0000","last_undegraded":"2024-08-17T02:23:31.945306+0000","last_fullsized":"2024-08-17T02:23:31.945306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:28.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.982454+0000","last_change":"2024-08-17T02:23:31.962150+0000","last_active":"2024-08-17T02:23:31.982454+0000","last_peered":"2024-08-17T02:23:31.982454+0000","last_clean":"2024-08-17T02:23:31.982454+0000","last_became_active":"2024-08-17T02:23:31.961854+0000","last_became_peered":"2024-08-17T02:23:31.961854+0000","last_unstale":"2024-08-17T02:23:31.982454+0000","last_undegraded":"2024-08-17T02:23:31.982454+0000","last_fullsized":"2024-08-17T02:23:31.982454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:03:52.570659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.945619+0000","last_change":"2024-08-17T02:23:30.973512+0000","last_active":"2024-08-17T02:23:31.945619+0000","last_peered":"2024-08-17T02:23:31.945619+0000","last_clean":"2024-08-17T02:23:31.945619+0000","last_became_active":"2024-08-17T02:23:30.973240+0000","last_became_peered":"2024-08-17T02:23:30.973240+0000","last_unstale":"2024-08-17T02:23:31.945619+0000","last_undegraded":"2024-08-17T02:23:31.945619+0000","last_fullsized":"2024-08-17T02:23:31.945619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:01.947289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985519+0000","last_change":"2024-08-17T02:23:31.978338+0000","last_active":"2024-08-17T02:23:31.985519+0000","last_peered":"2024-08-17T02:23:31.985519+0000","last_clean":"2024-08-17T02:23:31.985519+0000","last_became_active":"2024-08-17T02:23:31.978044+0000","last_became_peered":"2024-08-17T02:23:31.978044+0000","last_unstale":"2024-08-17T02:23:31.985519+0000","last_undegraded":"2024-08-17T02:23:31.985519+0000","last_fullsized":"2024-08-17T02:23:31.985519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:10.516503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.973244+0000","last_change":"2024-08-17T02:23:30.965867+0000","last_active":"2024-08-17T02:23:31.973244+0000","last_peered":"2024-08-17T02:23:31.973244+0000","last_clean":"2024-08-17T02:23:31.973244+0000","last_became_active":"2024-08-17T02:23:30.965564+0000","last_became_peered":"2024-08-17T02:23:30.965564+0000","last_unstale":"2024-08-17T02:23:31.973244+0000","last_undegraded":"2024-08-17T02:23:31.973244+0000","last_fullsized":"2024-08-17T02:23:31.973244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:01.182394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983652+0000","last_change":"2024-08-17T02:23:31.982027+0000","last_active":"2024-08-17T02:23:31.983652+0000","last_peered":"2024-08-17T02:23:31.983652+0000","last_clean":"2024-08-17T02:23:31.983652+0000","last_became_active":"2024-08-17T02:23:31.981722+0000","last_became_peered":"2024-08-17T02:23:31.981722+0000","last_unstale":"2024-08-17T02:23:31.983652+0000","last_undegraded":"2024-08-17T02:23:31.983652+0000","last_fullsized":"2024-08-17T02:23:31.983652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:55.653301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.986694+0000","last_change":"2024-08-17T02:23:31.978093+0000","last_active":"2024-08-17T02:23:31.986694+0000","last_peered":"2024-08-17T02:23:31.986694+0000","last_clean":"2024-08-17T02:23:31.986694+0000","last_became_active":"2024-08-17T02:23:31.977706+0000","last_became_peered":"2024-08-17T02:23:31.977706+0000","last_unstale":"2024-08-17T02:23:31.986694+0000","last_undegraded":"2024-08-17T02:23:31.986694+0000","last_fullsized":"2024-08-17T02:23:31.986694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:43.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.987152+0000","last_change":"2024-08-17T02:23:30.957349+0000","last_active":"2024-08-17T02:23:31.987152+0000","last_peered":"2024-08-17T02:23:31.987152+0000","last_clean":"2024-08-17T02:23:31.987152+0000","last_became_active":"2024-08-17T02:23:30.957063+0000","last_became_peered":"2024-08-17T02:23:30.957063+0000","last_unstale":"2024-08-17T02:23:31.987152+0000","last_undegraded":"2024-08-17T02:23:31.987152+0000","last_fullsized":"2024-08-17T02:23:31.987152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:01.947289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.986866+0000","last_change":"2024-08-17T02:23:31.974984+0000","last_active":"2024-08-17T02:23:31.986866+0000","last_peered":"2024-08-17T02:23:31.986866+0000","last_clean":"2024-08-17T02:23:31.986866+0000","last_became_active":"2024-08-17T02:23:31.974774+0000","last_became_peered":"2024-08-17T02:23:31.974774+0000","last_unstale":"2024-08-17T02:23:31.986866+0000","last_undegraded":"2024-08-17T02:23:31.986866+0000","last_fullsized":"2024-08-17T02:23:31.986866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:38.802352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.974239+0000","last_change":"2024-08-17T02:23:30.965411+0000","last_active":"2024-08-17T02:23:31.974239+0000","last_peered":"2024-08-17T02:23:31.974239+0000","last_clean":"2024-08-17T02:23:31.974239+0000","last_became_active":"2024-08-17T02:23:30.962792+0000","last_became_peered":"2024-08-17T02:23:30.962792+0000","last_unstale":"2024-08-17T02:23:31.974239+0000","last_undegraded":"2024-08-17T02:23:31.974239+0000","last_fullsized":"2024-08-17T02:23:31.974239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:56.544091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983073+0000","last_change":"2024-08-17T02:23:31.980658+0000","last_active":"2024-08-17T02:23:31.983073+0000","last_peered":"2024-08-17T02:23:31.983073+0000","last_clean":"2024-08-17T02:23:31.983073+0000","last_became_active":"2024-08-17T02:23:31.980238+0000","last_became_peered":"2024-08-17T02:23:31.980238+0000","last_unstale":"2024-08-17T02:23:31.983073+0000","last_undegraded":"2024-08-17T02:23:31.983073+0000","last_fullsized":"2024-08-17T02:23:31.983073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:37.211325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983596+0000","last_change":"2024-08-17T02:23:30.972133+0000","last_active":"2024-08-17T02:23:31.983596+0000","last_peered":"2024-08-17T02:23:31.983596+0000","last_clean":"2024-08-17T02:23:31.983596+0000","last_became_active":"2024-08-17T02:23:30.971784+0000","last_became_peered":"2024-08-17T02:23:30.971784+0000","last_unstale":"2024-08-17T02:23:31.983596+0000","last_undegraded":"2024-08-17T02:23:31.983596+0000","last_fullsized":"2024-08-17T02:23:31.983596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:20.670802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983566+0000","last_change":"2024-08-17T02:23:31.965808+0000","last_active":"2024-08-17T02:23:31.983566+0000","last_peered":"2024-08-17T02:23:31.983566+0000","last_clean":"2024-08-17T02:23:31.983566+0000","last_became_active":"2024-08-17T02:23:31.965581+0000","last_became_peered":"2024-08-17T02:23:31.965581+0000","last_unstale":"2024-08-17T02:23:31.983566+0000","last_undegraded":"2024-08-17T02:23:31.983566+0000","last_fullsized":"2024-08-17T02:23:31.983566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:58.965182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.982943+0000","last_change":"2024-08-17T02:23:30.962575+0000","last_active":"2024-08-17T02:23:31.982943+0000","last_peered":"2024-08-17T02:23:31.982943+0000","last_clean":"2024-08-17T02:23:31.982943+0000","last_became_active":"2024-08-17T02:23:30.962277+0000","last_became_peered":"2024-08-17T02:23:30.962277+0000","last_unstale":"2024-08-17T02:23:31.982943+0000","last_undegraded":"2024-08-17T02:23:31.982943+0000","last_fullsized":"2024-08-17T02:23:31.982943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:24:02.271519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":815104,"data_stored":666251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301732,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070108,"statfs":{"total":96636764160,"available":96327790592,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301740,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070100,"statfs":{"total":96636764160,"available":96327782400,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302320,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069520,"statfs":{"total":96636764160,"available":96327188480,"internally_reserved":0,"allocated":823296,"data_stored":666307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:23:36.150 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:23:36.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.335+0000 7fbbfa800640 1 Processor -- start 2024-08-17T02:23:36.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.335+0000 7fbbfa800640 1 -- start start 2024-08-17T02:23:36.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.336+0000 7fbbfa800640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbbf40ad790 0x7fbbf40adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.336+0000 7fbbfa800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbf406e900 0x7fbbf415d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.336+0000 7fbbfa800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbbf4069780 0x7fbbf41585c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.336+0000 7fbbfa800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf406a620 con 0x7fbbf4069780 2024-08-17T02:23:36.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.336+0000 7fbbfa800640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf406a060 con 0x7fbbf40ad790 2024-08-17T02:23:36.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.336+0000 7fbbfa800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf406a340 con 0x7fbbf406e900 2024-08-17T02:23:36.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.336+0000 7fbbf9e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbbf4069780 0x7fbbf41585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.336+0000 7fbbf9e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbbf4069780 0x7fbbf41585c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53680/0 (socket says 172.21.15.2:53680) 2024-08-17T02:23:36.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.336+0000 7fbbf9e00640 1 -- 172.21.15.2:0/555873794 learned_addr learned my addr 172.21.15.2:0/555873794 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:36.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.337+0000 7fbbf8a00640 1 --2- 172.21.15.2:0/555873794 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbf406e900 0x7fbbf415d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.337+0000 7fbbf9400640 1 --2- 172.21.15.2:0/555873794 >> v2:172.21.15.145:3300/0 conn(0x7fbbf40ad790 0x7fbbf40adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.337+0000 7fbbf9e00640 1 -- 172.21.15.2:0/555873794 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbf406e900 msgr2=0x7fbbf415d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:36.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.337+0000 7fbbf9e00640 1 --2- 172.21.15.2:0/555873794 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbf406e900 0x7fbbf415d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.337+0000 7fbbf9e00640 1 -- 172.21.15.2:0/555873794 >> v2:172.21.15.145:3300/0 conn(0x7fbbf40ad790 msgr2=0x7fbbf40adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:36.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.337+0000 7fbbf9e00640 1 --2- 172.21.15.2:0/555873794 >> v2:172.21.15.145:3300/0 conn(0x7fbbf40ad790 0x7fbbf40adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.337+0000 7fbbf9e00640 1 -- 172.21.15.2:0/555873794 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf415c930 con 0x7fbbf4069780 2024-08-17T02:23:36.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.337+0000 7fbbf8a00640 1 --2- 172.21.15.2:0/555873794 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbf406e900 0x7fbbf415d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:36.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.338+0000 7fbbf9e00640 1 --2- 172.21.15.2:0/555873794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbf4069780 0x7fbbf41585c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4069420 tx=0x7fbbec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483d95b4656ab96 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:36.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.338+0000 7fbbf3e00640 1 -- 172.21.15.2:0/555873794 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec031400 con 0x7fbbf4069780 2024-08-17T02:23:36.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.338+0000 7fbbf3e00640 1 -- 172.21.15.2:0/555873794 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbec02d050 con 0x7fbbf4069780 2024-08-17T02:23:36.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.338+0000 7fbbf3e00640 1 -- 172.21.15.2:0/555873794 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0317d0 con 0x7fbbf4069780 2024-08-17T02:23:36.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.339+0000 7fbbfa800640 1 -- 172.21.15.2:0/555873794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbf4069780 msgr2=0x7fbbf41585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:36.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.339+0000 7fbbfa800640 1 --2- 172.21.15.2:0/555873794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbf4069780 0x7fbbf41585c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4069420 tx=0x7fbbec009840 comp rx=0 tx=0).stop 2024-08-17T02:23:36.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.339+0000 7fbbfa800640 1 -- 172.21.15.2:0/555873794 shutdown_connections 2024-08-17T02:23:36.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.339+0000 7fbbfa800640 1 --2- 172.21.15.2:0/555873794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbf4069780 0x7fbbf41585c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.339+0000 7fbbfa800640 1 --2- 172.21.15.2:0/555873794 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbf406e900 0x7fbbf415d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.339+0000 7fbbfa800640 1 --2- 172.21.15.2:0/555873794 >> v2:172.21.15.145:3300/0 conn(0x7fbbf40ad790 0x7fbbf40adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.339+0000 7fbbfa800640 1 -- 172.21.15.2:0/555873794 >> 172.21.15.2:0/555873794 conn(0x7fbbf4062af0 msgr2=0x7fbbf4062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:36.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.339+0000 7fbbfa800640 1 -- 172.21.15.2:0/555873794 shutdown_connections 2024-08-17T02:23:36.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.339+0000 7fbbfa800640 1 -- 172.21.15.2:0/555873794 wait complete. 2024-08-17T02:23:36.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.340+0000 7fbbfa800640 1 Processor -- start 2024-08-17T02:23:36.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.340+0000 7fbbfa800640 1 -- start start 2024-08-17T02:23:36.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.341+0000 7fbbfa800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbf4069780 0x7fbbf4158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.341+0000 7fbbfa800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbf406e900 0x7fbbf414ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.341+0000 7fbbfa800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbf40ad790 0x7fbbf4168cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.341+0000 7fbbfa800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf4150ef0 con 0x7fbbf406e900 2024-08-17T02:23:36.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.341+0000 7fbbfa800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf41589b0 con 0x7fbbf4069780 2024-08-17T02:23:36.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.341+0000 7fbbfa800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf414d3b0 con 0x7fbbf40ad790 2024-08-17T02:23:36.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.342+0000 7fbbf8a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbf406e900 0x7fbbf414ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.342+0000 7fbbf8a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbf406e900 0x7fbbf414ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53690/0 (socket says 172.21.15.2:53690) 2024-08-17T02:23:36.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.342+0000 7fbbf8a00640 1 -- 172.21.15.2:0/3371543528 learned_addr learned my addr 172.21.15.2:0/3371543528 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:36.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.342+0000 7fbbf9e00640 1 --2- 172.21.15.2:0/3371543528 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbf40ad790 0x7fbbf4168cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.342+0000 7fbbf9400640 1 --2- 172.21.15.2:0/3371543528 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbf4069780 0x7fbbf4158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.342+0000 7fbbf8a00640 1 -- 172.21.15.2:0/3371543528 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbf40ad790 msgr2=0x7fbbf4168cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:36.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.342+0000 7fbbf8a00640 1 --2- 172.21.15.2:0/3371543528 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbf40ad790 0x7fbbf4168cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.342+0000 7fbbf8a00640 1 -- 172.21.15.2:0/3371543528 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbf4069780 msgr2=0x7fbbf4158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:36.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.342+0000 7fbbf8a00640 1 --2- 172.21.15.2:0/3371543528 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbf4069780 0x7fbbf4158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.342+0000 7fbbf8a00640 1 -- 172.21.15.2:0/3371543528 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbec009ae0 con 0x7fbbf406e900 2024-08-17T02:23:36.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.342+0000 7fbbf8a00640 1 --2- 172.21.15.2:0/3371543528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbf406e900 0x7fbbf414ce70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000d890 tx=0x7fbbe0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:36.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.342+0000 7fbbf0c00640 1 -- 172.21.15.2:0/3371543528 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe000de80 con 0x7fbbf406e900 2024-08-17T02:23:36.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.343+0000 7fbbf0c00640 1 -- 172.21.15.2:0/3371543528 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe000b8d0 con 0x7fbbf406e900 2024-08-17T02:23:36.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.343+0000 7fbbf0c00640 1 -- 172.21.15.2:0/3371543528 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe000bc90 con 0x7fbbf406e900 2024-08-17T02:23:36.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.343+0000 7fbbfa800640 1 -- 172.21.15.2:0/3371543528 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf4151c10 con 0x7fbbf406e900 2024-08-17T02:23:36.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.343+0000 7fbbfa800640 1 -- 172.21.15.2:0/3371543528 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf41521d0 con 0x7fbbf406e900 2024-08-17T02:23:36.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.344+0000 7fbbfa800640 1 -- 172.21.15.2:0/3371543528 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf4070720 con 0x7fbbf406e900 2024-08-17T02:23:36.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.345+0000 7fbbf0c00640 1 -- 172.21.15.2:0/3371543528 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbbe001e460 con 0x7fbbf406e900 2024-08-17T02:23:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.346+0000 7fbbf0c00640 1 --2- 172.21.15.2:0/3371543528 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbbd4065150 0x7fbbd4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.346+0000 7fbbf0c00640 1 -- 172.21.15.2:0/3371543528 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbbe0082a60 con 0x7fbbf406e900 2024-08-17T02:23:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.346+0000 7fbbf9400640 1 --2- 172.21.15.2:0/3371543528 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbbd4065150 0x7fbbd4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.347+0000 7fbbf9400640 1 --2- 172.21.15.2:0/3371543528 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbbd4065150 0x7fbbd4067600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40ad4e0 tx=0x7fbbe8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:36.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.350+0000 7fbbf0c00640 1 -- 172.21.15.2:0/3371543528 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbbe0050b30 con 0x7fbbf406e900 2024-08-17T02:23:36.456 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:23:36.460 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:23:36.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.528+0000 7fbbfa800640 1 -- 172.21.15.2:0/3371543528 --> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbbf406e0b0 con 0x7fbbd4065150 2024-08-17T02:23:36.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.535+0000 7fbbf0c00640 1 -- 172.21.15.2:0/3371543528 <== mgr.4108 v2:172.21.15.145:6832/36841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264619 (secure 0 0 0) 0x7fbbf406e0b0 con 0x7fbbd4065150 2024-08-17T02:23:36.540 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:36.543 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-17T02:23:36.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.539+0000 7fbbfa800640 1 -- 172.21.15.2:0/3371543528 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbbd4065150 msgr2=0x7fbbd4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:36.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.539+0000 7fbbfa800640 1 --2- 172.21.15.2:0/3371543528 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbbd4065150 0x7fbbd4067600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40ad4e0 tx=0x7fbbe8008040 comp rx=0 tx=0).stop 2024-08-17T02:23:36.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.539+0000 7fbbfa800640 1 -- 172.21.15.2:0/3371543528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbf406e900 msgr2=0x7fbbf414ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:36.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.539+0000 7fbbfa800640 1 --2- 172.21.15.2:0/3371543528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbf406e900 0x7fbbf414ce70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000d890 tx=0x7fbbe0008040 comp rx=0 tx=0).stop 2024-08-17T02:23:36.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.539+0000 7fbbfa800640 1 -- 172.21.15.2:0/3371543528 shutdown_connections 2024-08-17T02:23:36.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.539+0000 7fbbfa800640 1 --2- 172.21.15.2:0/3371543528 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbbd4065150 0x7fbbd4067600 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.539+0000 7fbbfa800640 1 --2- 172.21.15.2:0/3371543528 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbf40ad790 0x7fbbf4168cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.539+0000 7fbbfa800640 1 --2- 172.21.15.2:0/3371543528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbf406e900 0x7fbbf414ce70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.539+0000 7fbbfa800640 1 --2- 172.21.15.2:0/3371543528 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbf4069780 0x7fbbf4158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.539+0000 7fbbfa800640 1 -- 172.21.15.2:0/3371543528 >> 172.21.15.2:0/3371543528 conn(0x7fbbf4062af0 msgr2=0x7fbbf40b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:36.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.539+0000 7fbbfa800640 1 -- 172.21.15.2:0/3371543528 shutdown_connections 2024-08-17T02:23:36.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.539+0000 7fbbfa800640 1 -- 172.21.15.2:0/3371543528 wait complete. 2024-08-17T02:23:36.557 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-08-17T02:23:36.051136+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398628,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576092,"statfs":{"total":773094113280,"available":770637918208,"internally_reserved":0,"allocated":2990080,"data_stored":1787916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.110549"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.976573+0000","last_change":"2024-08-17T02:23:31.975398+0000","last_active":"2024-08-17T02:23:31.976573+0000","last_peered":"2024-08-17T02:23:31.976573+0000","last_clean":"2024-08-17T02:23:31.976573+0000","last_became_active":"2024-08-17T02:23:31.974455+0000","last_became_peered":"2024-08-17T02:23:31.974455+0000","last_unstale":"2024-08-17T02:23:31.976573+0000","last_undegraded":"2024-08-17T02:23:31.976573+0000","last_fullsized":"2024-08-17T02:23:31.976573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:42:58.072658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.975890+0000","last_change":"2024-08-17T02:23:31.971947+0000","last_active":"2024-08-17T02:23:31.975890+0000","last_peered":"2024-08-17T02:23:31.975890+0000","last_clean":"2024-08-17T02:23:31.975890+0000","last_became_active":"2024-08-17T02:23:31.971544+0000","last_became_peered":"2024-08-17T02:23:31.971544+0000","last_unstale":"2024-08-17T02:23:31.975890+0000","last_undegraded":"2024-08-17T02:23:31.975890+0000","last_fullsized":"2024-08-17T02:23:31.975890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:43.020526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.976567+0000","last_change":"2024-08-17T02:23:31.967149+0000","last_active":"2024-08-17T02:23:31.976567+0000","last_peered":"2024-08-17T02:23:31.976567+0000","last_clean":"2024-08-17T02:23:31.976567+0000","last_became_active":"2024-08-17T02:23:31.966332+0000","last_became_peered":"2024-08-17T02:23:31.966332+0000","last_unstale":"2024-08-17T02:23:31.976567+0000","last_undegraded":"2024-08-17T02:23:31.976567+0000","last_fullsized":"2024-08-17T02:23:31.976567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:11:26.255794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.986850+0000","last_change":"2024-08-17T02:23:31.972259+0000","last_active":"2024-08-17T02:23:31.986850+0000","last_peered":"2024-08-17T02:23:31.986850+0000","last_clean":"2024-08-17T02:23:31.986850+0000","last_became_active":"2024-08-17T02:23:31.972071+0000","last_became_peered":"2024-08-17T02:23:31.972071+0000","last_unstale":"2024-08-17T02:23:31.986850+0000","last_undegraded":"2024-08-17T02:23:31.986850+0000","last_fullsized":"2024-08-17T02:23:31.986850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:50:55.354947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.970412+0000","last_change":"2024-08-17T02:23:31.966422+0000","last_active":"2024-08-17T02:23:31.970412+0000","last_peered":"2024-08-17T02:23:31.970412+0000","last_clean":"2024-08-17T02:23:31.970412+0000","last_became_active":"2024-08-17T02:23:31.966173+0000","last_became_peered":"2024-08-17T02:23:31.966173+0000","last_unstale":"2024-08-17T02:23:31.970412+0000","last_undegraded":"2024-08-17T02:23:31.970412+0000","last_fullsized":"2024-08-17T02:23:31.970412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:07:31.568338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983924+0000","last_change":"2024-08-17T02:23:31.966700+0000","last_active":"2024-08-17T02:23:31.983924+0000","last_peered":"2024-08-17T02:23:31.983924+0000","last_clean":"2024-08-17T02:23:31.983924+0000","last_became_active":"2024-08-17T02:23:31.965880+0000","last_became_peered":"2024-08-17T02:23:31.965880+0000","last_unstale":"2024-08-17T02:23:31.983924+0000","last_undegraded":"2024-08-17T02:23:31.983924+0000","last_fullsized":"2024-08-17T02:23:31.983924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:42:58.072658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.970145+0000","last_change":"2024-08-17T02:23:31.963777+0000","last_active":"2024-08-17T02:23:31.970145+0000","last_peered":"2024-08-17T02:23:31.970145+0000","last_clean":"2024-08-17T02:23:31.970145+0000","last_became_active":"2024-08-17T02:23:31.963602+0000","last_became_peered":"2024-08-17T02:23:31.963602+0000","last_unstale":"2024-08-17T02:23:31.970145+0000","last_undegraded":"2024-08-17T02:23:31.970145+0000","last_fullsized":"2024-08-17T02:23:31.970145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:05:46.608052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.987327+0000","last_change":"2024-08-17T02:23:31.986488+0000","last_active":"2024-08-17T02:23:31.987327+0000","last_peered":"2024-08-17T02:23:31.987327+0000","last_clean":"2024-08-17T02:23:31.987327+0000","last_became_active":"2024-08-17T02:23:31.986199+0000","last_became_peered":"2024-08-17T02:23:31.986199+0000","last_unstale":"2024-08-17T02:23:31.987327+0000","last_undegraded":"2024-08-17T02:23:31.987327+0000","last_fullsized":"2024-08-17T02:23:31.987327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:27:58.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985276+0000","last_change":"2024-08-17T02:23:31.982345+0000","last_active":"2024-08-17T02:23:31.985276+0000","last_peered":"2024-08-17T02:23:31.985276+0000","last_clean":"2024-08-17T02:23:31.985276+0000","last_became_active":"2024-08-17T02:23:31.982054+0000","last_became_peered":"2024-08-17T02:23:31.982054+0000","last_unstale":"2024-08-17T02:23:31.985276+0000","last_undegraded":"2024-08-17T02:23:31.985276+0000","last_fullsized":"2024-08-17T02:23:31.985276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:38.802352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985840+0000","last_change":"2024-08-17T02:23:31.984335+0000","last_active":"2024-08-17T02:23:31.985840+0000","last_peered":"2024-08-17T02:23:31.985840+0000","last_clean":"2024-08-17T02:23:31.985840+0000","last_became_active":"2024-08-17T02:23:31.984069+0000","last_became_peered":"2024-08-17T02:23:31.984069+0000","last_unstale":"2024-08-17T02:23:31.985840+0000","last_undegraded":"2024-08-17T02:23:31.985840+0000","last_fullsized":"2024-08-17T02:23:31.985840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:42:34.434625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.988620+0000","last_change":"2024-08-17T02:23:31.987422+0000","last_active":"2024-08-17T02:23:31.988620+0000","last_peered":"2024-08-17T02:23:31.988620+0000","last_clean":"2024-08-17T02:23:31.988620+0000","last_became_active":"2024-08-17T02:23:31.987106+0000","last_became_peered":"2024-08-17T02:23:31.987106+0000","last_unstale":"2024-08-17T02:23:31.988620+0000","last_undegraded":"2024-08-17T02:23:31.988620+0000","last_fullsized":"2024-08-17T02:23:31.988620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:11:26.255794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983816+0000","last_change":"2024-08-17T02:23:31.976682+0000","last_active":"2024-08-17T02:23:31.983816+0000","last_peered":"2024-08-17T02:23:31.983816+0000","last_clean":"2024-08-17T02:23:31.983816+0000","last_became_active":"2024-08-17T02:23:31.976445+0000","last_became_peered":"2024-08-17T02:23:31.976445+0000","last_unstale":"2024-08-17T02:23:31.983816+0000","last_undegraded":"2024-08-17T02:23:31.983816+0000","last_fullsized":"2024-08-17T02:23:31.983816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:55:04.972521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983681+0000","last_change":"2024-08-17T02:23:31.963968+0000","last_active":"2024-08-17T02:23:31.983681+0000","last_peered":"2024-08-17T02:23:31.983681+0000","last_clean":"2024-08-17T02:23:31.983681+0000","last_became_active":"2024-08-17T02:23:31.963710+0000","last_became_peered":"2024-08-17T02:23:31.963710+0000","last_unstale":"2024-08-17T02:23:31.983681+0000","last_undegraded":"2024-08-17T02:23:31.983681+0000","last_fullsized":"2024-08-17T02:23:31.983681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:06.432367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.977187+0000","last_change":"2024-08-17T02:23:31.970021+0000","last_active":"2024-08-17T02:23:31.977187+0000","last_peered":"2024-08-17T02:23:31.977187+0000","last_clean":"2024-08-17T02:23:31.977187+0000","last_became_active":"2024-08-17T02:23:31.969518+0000","last_became_peered":"2024-08-17T02:23:31.969518+0000","last_unstale":"2024-08-17T02:23:31.977187+0000","last_undegraded":"2024-08-17T02:23:31.977187+0000","last_fullsized":"2024-08-17T02:23:31.977187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:25:23.210871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983062+0000","last_change":"2024-08-17T02:23:31.980168+0000","last_active":"2024-08-17T02:23:31.983062+0000","last_peered":"2024-08-17T02:23:31.983062+0000","last_clean":"2024-08-17T02:23:31.983062+0000","last_became_active":"2024-08-17T02:23:31.979853+0000","last_became_peered":"2024-08-17T02:23:31.979853+0000","last_unstale":"2024-08-17T02:23:31.983062+0000","last_undegraded":"2024-08-17T02:23:31.983062+0000","last_fullsized":"2024-08-17T02:23:31.983062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:10.516503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985764+0000","last_change":"2024-08-17T02:23:31.968007+0000","last_active":"2024-08-17T02:23:31.985764+0000","last_peered":"2024-08-17T02:23:31.985764+0000","last_clean":"2024-08-17T02:23:31.985764+0000","last_became_active":"2024-08-17T02:23:31.967725+0000","last_became_peered":"2024-08-17T02:23:31.967725+0000","last_unstale":"2024-08-17T02:23:31.985764+0000","last_undegraded":"2024-08-17T02:23:31.985764+0000","last_fullsized":"2024-08-17T02:23:31.985764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:07:31.568338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.986784+0000","last_change":"2024-08-17T02:23:31.967123+0000","last_active":"2024-08-17T02:23:31.986784+0000","last_peered":"2024-08-17T02:23:31.986784+0000","last_clean":"2024-08-17T02:23:31.986784+0000","last_became_active":"2024-08-17T02:23:31.966871+0000","last_became_peered":"2024-08-17T02:23:31.966871+0000","last_unstale":"2024-08-17T02:23:31.986784+0000","last_undegraded":"2024-08-17T02:23:31.986784+0000","last_fullsized":"2024-08-17T02:23:31.986784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:58.965182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.966662+0000","last_change":"2024-08-17T02:23:31.964474+0000","last_active":"2024-08-17T02:23:31.966662+0000","last_peered":"2024-08-17T02:23:31.966662+0000","last_clean":"2024-08-17T02:23:31.966662+0000","last_became_active":"2024-08-17T02:23:31.964075+0000","last_became_peered":"2024-08-17T02:23:31.964075+0000","last_unstale":"2024-08-17T02:23:31.966662+0000","last_undegraded":"2024-08-17T02:23:31.966662+0000","last_fullsized":"2024-08-17T02:23:31.966662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:57.546866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.970203+0000","last_change":"2024-08-17T02:23:31.965304+0000","last_active":"2024-08-17T02:23:31.970203+0000","last_peered":"2024-08-17T02:23:31.970203+0000","last_clean":"2024-08-17T02:23:31.970203+0000","last_became_active":"2024-08-17T02:23:31.964834+0000","last_became_peered":"2024-08-17T02:23:31.964834+0000","last_unstale":"2024-08-17T02:23:31.970203+0000","last_undegraded":"2024-08-17T02:23:31.970203+0000","last_fullsized":"2024-08-17T02:23:31.970203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:51.027128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.982736+0000","last_change":"2024-08-17T02:23:31.981469+0000","last_active":"2024-08-17T02:23:31.982736+0000","last_peered":"2024-08-17T02:23:31.982736+0000","last_clean":"2024-08-17T02:23:31.982736+0000","last_became_active":"2024-08-17T02:23:31.981200+0000","last_became_peered":"2024-08-17T02:23:31.981200+0000","last_unstale":"2024-08-17T02:23:31.982736+0000","last_undegraded":"2024-08-17T02:23:31.982736+0000","last_fullsized":"2024-08-17T02:23:31.982736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:43.020526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.977261+0000","last_change":"2024-08-17T02:23:31.965936+0000","last_active":"2024-08-17T02:23:31.977261+0000","last_peered":"2024-08-17T02:23:31.977261+0000","last_clean":"2024-08-17T02:23:31.977261+0000","last_became_active":"2024-08-17T02:23:31.965076+0000","last_became_peered":"2024-08-17T02:23:31.965076+0000","last_unstale":"2024-08-17T02:23:31.977261+0000","last_undegraded":"2024-08-17T02:23:31.977261+0000","last_fullsized":"2024-08-17T02:23:31.977261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:39.645299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983907+0000","last_change":"2024-08-17T02:23:31.964668+0000","last_active":"2024-08-17T02:23:31.983907+0000","last_peered":"2024-08-17T02:23:31.983907+0000","last_clean":"2024-08-17T02:23:31.983907+0000","last_became_active":"2024-08-17T02:23:31.964419+0000","last_became_peered":"2024-08-17T02:23:31.964419+0000","last_unstale":"2024-08-17T02:23:31.983907+0000","last_undegraded":"2024-08-17T02:23:31.983907+0000","last_fullsized":"2024-08-17T02:23:31.983907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:37.211325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985700+0000","last_change":"2024-08-17T02:23:31.984594+0000","last_active":"2024-08-17T02:23:31.985700+0000","last_peered":"2024-08-17T02:23:31.985700+0000","last_clean":"2024-08-17T02:23:31.985700+0000","last_became_active":"2024-08-17T02:23:31.984322+0000","last_became_peered":"2024-08-17T02:23:31.984322+0000","last_unstale":"2024-08-17T02:23:31.985700+0000","last_undegraded":"2024-08-17T02:23:31.985700+0000","last_fullsized":"2024-08-17T02:23:31.985700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:37.211325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985777+0000","last_change":"2024-08-17T02:23:31.974171+0000","last_active":"2024-08-17T02:23:31.985777+0000","last_peered":"2024-08-17T02:23:31.985777+0000","last_clean":"2024-08-17T02:23:31.985777+0000","last_became_active":"2024-08-17T02:23:31.973932+0000","last_became_peered":"2024-08-17T02:23:31.973932+0000","last_unstale":"2024-08-17T02:23:31.985777+0000","last_undegraded":"2024-08-17T02:23:31.985777+0000","last_fullsized":"2024-08-17T02:23:31.985777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:06.432367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985116+0000","last_change":"2024-08-17T02:23:31.977090+0000","last_active":"2024-08-17T02:23:31.985116+0000","last_peered":"2024-08-17T02:23:31.985116+0000","last_clean":"2024-08-17T02:23:31.985116+0000","last_became_active":"2024-08-17T02:23:31.976653+0000","last_became_peered":"2024-08-17T02:23:31.976653+0000","last_unstale":"2024-08-17T02:23:31.985116+0000","last_undegraded":"2024-08-17T02:23:31.985116+0000","last_fullsized":"2024-08-17T02:23:31.985116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:38.802352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.966162+0000","last_change":"2024-08-17T02:23:31.962013+0000","last_active":"2024-08-17T02:23:31.966162+0000","last_peered":"2024-08-17T02:23:31.966162+0000","last_clean":"2024-08-17T02:23:31.966162+0000","last_became_active":"2024-08-17T02:23:31.961662+0000","last_became_peered":"2024-08-17T02:23:31.961662+0000","last_unstale":"2024-08-17T02:23:31.966162+0000","last_undegraded":"2024-08-17T02:23:31.966162+0000","last_fullsized":"2024-08-17T02:23:31.966162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:07:14.545767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.967130+0000","last_change":"2024-08-17T02:23:31.963911+0000","last_active":"2024-08-17T02:23:31.967130+0000","last_peered":"2024-08-17T02:23:31.967130+0000","last_clean":"2024-08-17T02:23:31.967130+0000","last_became_active":"2024-08-17T02:23:31.963534+0000","last_became_peered":"2024-08-17T02:23:31.963534+0000","last_unstale":"2024-08-17T02:23:31.967130+0000","last_undegraded":"2024-08-17T02:23:31.967130+0000","last_fullsized":"2024-08-17T02:23:31.967130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:11:26.255794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985361+0000","last_change":"2024-08-17T02:23:31.977370+0000","last_active":"2024-08-17T02:23:31.985361+0000","last_peered":"2024-08-17T02:23:31.985361+0000","last_clean":"2024-08-17T02:23:31.985361+0000","last_became_active":"2024-08-17T02:23:31.976692+0000","last_became_peered":"2024-08-17T02:23:31.976692+0000","last_unstale":"2024-08-17T02:23:31.985361+0000","last_undegraded":"2024-08-17T02:23:31.985361+0000","last_fullsized":"2024-08-17T02:23:31.985361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:39.645299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.977272+0000","last_change":"2024-08-17T02:23:31.966212+0000","last_active":"2024-08-17T02:23:31.977272+0000","last_peered":"2024-08-17T02:23:31.977272+0000","last_clean":"2024-08-17T02:23:31.977272+0000","last_became_active":"2024-08-17T02:23:31.965470+0000","last_became_peered":"2024-08-17T02:23:31.965470+0000","last_unstale":"2024-08-17T02:23:31.977272+0000","last_undegraded":"2024-08-17T02:23:31.977272+0000","last_fullsized":"2024-08-17T02:23:31.977272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:06.432367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983877+0000","last_change":"2024-08-17T02:23:31.964525+0000","last_active":"2024-08-17T02:23:31.983877+0000","last_peered":"2024-08-17T02:23:31.983877+0000","last_clean":"2024-08-17T02:23:31.983877+0000","last_became_active":"2024-08-17T02:23:31.963132+0000","last_became_peered":"2024-08-17T02:23:31.963132+0000","last_unstale":"2024-08-17T02:23:31.983877+0000","last_undegraded":"2024-08-17T02:23:31.983877+0000","last_fullsized":"2024-08-17T02:23:31.983877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:30.415547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983642+0000","last_change":"2024-08-17T02:23:31.982370+0000","last_active":"2024-08-17T02:23:31.983642+0000","last_peered":"2024-08-17T02:23:31.983642+0000","last_clean":"2024-08-17T02:23:31.983642+0000","last_became_active":"2024-08-17T02:23:31.982169+0000","last_became_peered":"2024-08-17T02:23:31.982169+0000","last_unstale":"2024-08-17T02:23:31.983642+0000","last_undegraded":"2024-08-17T02:23:31.983642+0000","last_fullsized":"2024-08-17T02:23:31.983642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:02.185169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.980609+0000","last_change":"2024-08-17T02:23:31.978196+0000","last_active":"2024-08-17T02:23:31.980609+0000","last_peered":"2024-08-17T02:23:31.980609+0000","last_clean":"2024-08-17T02:23:31.980609+0000","last_became_active":"2024-08-17T02:23:31.977913+0000","last_became_peered":"2024-08-17T02:23:31.977913+0000","last_unstale":"2024-08-17T02:23:31.980609+0000","last_undegraded":"2024-08-17T02:23:31.980609+0000","last_fullsized":"2024-08-17T02:23:31.980609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:37.211325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.980234+0000","last_change":"2024-08-17T02:23:31.975460+0000","last_active":"2024-08-17T02:23:31.980234+0000","last_peered":"2024-08-17T02:23:31.980234+0000","last_clean":"2024-08-17T02:23:31.980234+0000","last_became_active":"2024-08-17T02:23:31.972459+0000","last_became_peered":"2024-08-17T02:23:31.972459+0000","last_unstale":"2024-08-17T02:23:31.980234+0000","last_undegraded":"2024-08-17T02:23:31.980234+0000","last_fullsized":"2024-08-17T02:23:31.980234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:02.185169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983707+0000","last_change":"2024-08-17T02:23:30.979772+0000","last_active":"2024-08-17T02:23:31.983707+0000","last_peered":"2024-08-17T02:23:31.983707+0000","last_clean":"2024-08-17T02:23:31.983707+0000","last_became_active":"2024-08-17T02:23:30.979520+0000","last_became_peered":"2024-08-17T02:23:30.979520+0000","last_unstale":"2024-08-17T02:23:31.983707+0000","last_undegraded":"2024-08-17T02:23:31.983707+0000","last_fullsized":"2024-08-17T02:23:31.983707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:28.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.981114+0000","last_change":"2024-08-17T02:23:31.973462+0000","last_active":"2024-08-17T02:23:31.981114+0000","last_peered":"2024-08-17T02:23:31.981114+0000","last_clean":"2024-08-17T02:23:31.981114+0000","last_became_active":"2024-08-17T02:23:31.973180+0000","last_became_peered":"2024-08-17T02:23:31.973180+0000","last_unstale":"2024-08-17T02:23:31.981114+0000","last_undegraded":"2024-08-17T02:23:31.981114+0000","last_fullsized":"2024-08-17T02:23:31.981114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:43.020526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985474+0000","last_change":"2024-08-17T02:23:30.974773+0000","last_active":"2024-08-17T02:23:31.985474+0000","last_peered":"2024-08-17T02:23:31.985474+0000","last_clean":"2024-08-17T02:23:31.985474+0000","last_became_active":"2024-08-17T02:23:30.974578+0000","last_became_peered":"2024-08-17T02:23:30.974578+0000","last_unstale":"2024-08-17T02:23:31.985474+0000","last_undegraded":"2024-08-17T02:23:31.985474+0000","last_fullsized":"2024-08-17T02:23:31.985474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:55:03.969746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.956993+0000","last_change":"2024-08-17T02:23:30.968559+0000","last_active":"2024-08-17T02:23:31.956993+0000","last_peered":"2024-08-17T02:23:31.956993+0000","last_clean":"2024-08-17T02:23:31.956993+0000","last_became_active":"2024-08-17T02:23:30.968312+0000","last_became_peered":"2024-08-17T02:23:30.968312+0000","last_unstale":"2024-08-17T02:23:31.956993+0000","last_undegraded":"2024-08-17T02:23:31.956993+0000","last_fullsized":"2024-08-17T02:23:31.956993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:01.947289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.982474+0000","last_change":"2024-08-17T02:23:31.962531+0000","last_active":"2024-08-17T02:23:31.982474+0000","last_peered":"2024-08-17T02:23:31.982474+0000","last_clean":"2024-08-17T02:23:31.982474+0000","last_became_active":"2024-08-17T02:23:31.962242+0000","last_became_peered":"2024-08-17T02:23:31.962242+0000","last_unstale":"2024-08-17T02:23:31.982474+0000","last_undegraded":"2024-08-17T02:23:31.982474+0000","last_fullsized":"2024-08-17T02:23:31.982474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:11:26.255794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.952106+0000","last_change":"2024-08-17T02:23:30.972145+0000","last_active":"2024-08-17T02:23:31.952106+0000","last_peered":"2024-08-17T02:23:31.952106+0000","last_clean":"2024-08-17T02:23:31.952106+0000","last_became_active":"2024-08-17T02:23:30.969098+0000","last_became_peered":"2024-08-17T02:23:30.969098+0000","last_unstale":"2024-08-17T02:23:31.952106+0000","last_undegraded":"2024-08-17T02:23:31.952106+0000","last_fullsized":"2024-08-17T02:23:31.952106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:20.670802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.967039+0000","last_change":"2024-08-17T02:23:31.963819+0000","last_active":"2024-08-17T02:23:31.967039+0000","last_peered":"2024-08-17T02:23:31.967039+0000","last_clean":"2024-08-17T02:23:31.967039+0000","last_became_active":"2024-08-17T02:23:31.963535+0000","last_became_peered":"2024-08-17T02:23:31.963535+0000","last_unstale":"2024-08-17T02:23:31.967039+0000","last_undegraded":"2024-08-17T02:23:31.967039+0000","last_fullsized":"2024-08-17T02:23:31.967039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:42:34.434625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.965666+0000","last_change":"2024-08-17T02:23:30.970927+0000","last_active":"2024-08-17T02:23:31.965666+0000","last_peered":"2024-08-17T02:23:31.965666+0000","last_clean":"2024-08-17T02:23:31.965666+0000","last_became_active":"2024-08-17T02:23:30.970635+0000","last_became_peered":"2024-08-17T02:23:30.970635+0000","last_unstale":"2024-08-17T02:23:31.965666+0000","last_undegraded":"2024-08-17T02:23:31.965666+0000","last_fullsized":"2024-08-17T02:23:31.965666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:20.670802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983562+0000","last_change":"2024-08-17T02:23:31.962830+0000","last_active":"2024-08-17T02:23:31.983562+0000","last_peered":"2024-08-17T02:23:31.983562+0000","last_clean":"2024-08-17T02:23:31.983562+0000","last_became_active":"2024-08-17T02:23:31.962559+0000","last_became_peered":"2024-08-17T02:23:31.962559+0000","last_unstale":"2024-08-17T02:23:31.983562+0000","last_undegraded":"2024-08-17T02:23:31.983562+0000","last_fullsized":"2024-08-17T02:23:31.983562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:10.516503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.949546+0000","last_change":"2024-08-17T02:23:30.970596+0000","last_active":"2024-08-17T02:23:31.949546+0000","last_peered":"2024-08-17T02:23:31.949546+0000","last_clean":"2024-08-17T02:23:31.949546+0000","last_became_active":"2024-08-17T02:23:30.970344+0000","last_became_peered":"2024-08-17T02:23:30.970344+0000","last_unstale":"2024-08-17T02:23:31.949546+0000","last_undegraded":"2024-08-17T02:23:31.949546+0000","last_fullsized":"2024-08-17T02:23:31.949546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:55:03.969746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.984046+0000","last_change":"2024-08-17T02:23:31.982745+0000","last_active":"2024-08-17T02:23:31.984046+0000","last_peered":"2024-08-17T02:23:31.984046+0000","last_clean":"2024-08-17T02:23:31.984046+0000","last_became_active":"2024-08-17T02:23:31.980074+0000","last_became_peered":"2024-08-17T02:23:31.980074+0000","last_unstale":"2024-08-17T02:23:31.984046+0000","last_undegraded":"2024-08-17T02:23:31.984046+0000","last_fullsized":"2024-08-17T02:23:31.984046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:10.516503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.987068+0000","last_change":"2024-08-17T02:23:30.976633+0000","last_active":"2024-08-17T02:23:31.987068+0000","last_peered":"2024-08-17T02:23:31.987068+0000","last_clean":"2024-08-17T02:23:31.987068+0000","last_became_active":"2024-08-17T02:23:30.976281+0000","last_became_peered":"2024-08-17T02:23:30.976281+0000","last_unstale":"2024-08-17T02:23:31.987068+0000","last_undegraded":"2024-08-17T02:23:31.987068+0000","last_fullsized":"2024-08-17T02:23:31.987068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:40.754285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983904+0000","last_change":"2024-08-17T02:23:31.977353+0000","last_active":"2024-08-17T02:23:31.983904+0000","last_peered":"2024-08-17T02:23:31.983904+0000","last_clean":"2024-08-17T02:23:31.983904+0000","last_became_active":"2024-08-17T02:23:31.976904+0000","last_became_peered":"2024-08-17T02:23:31.976904+0000","last_unstale":"2024-08-17T02:23:31.983904+0000","last_undegraded":"2024-08-17T02:23:31.983904+0000","last_fullsized":"2024-08-17T02:23:31.983904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:02.950063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.989041+0000","last_change":"2024-08-17T02:23:30.975577+0000","last_active":"2024-08-17T02:23:31.989041+0000","last_peered":"2024-08-17T02:23:31.989041+0000","last_clean":"2024-08-17T02:23:31.989041+0000","last_became_active":"2024-08-17T02:23:30.975345+0000","last_became_peered":"2024-08-17T02:23:30.975345+0000","last_unstale":"2024-08-17T02:23:31.989041+0000","last_undegraded":"2024-08-17T02:23:31.989041+0000","last_fullsized":"2024-08-17T02:23:31.989041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:40.754285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.970187+0000","last_change":"2024-08-17T02:23:31.965120+0000","last_active":"2024-08-17T02:23:31.970187+0000","last_peered":"2024-08-17T02:23:31.970187+0000","last_clean":"2024-08-17T02:23:31.970187+0000","last_became_active":"2024-08-17T02:23:31.964587+0000","last_became_peered":"2024-08-17T02:23:31.964587+0000","last_unstale":"2024-08-17T02:23:31.970187+0000","last_undegraded":"2024-08-17T02:23:31.970187+0000","last_fullsized":"2024-08-17T02:23:31.970187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:39:53.991015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985350+0000","last_change":"2024-08-17T02:23:30.972844+0000","last_active":"2024-08-17T02:23:31.985350+0000","last_peered":"2024-08-17T02:23:31.985350+0000","last_clean":"2024-08-17T02:23:31.985350+0000","last_became_active":"2024-08-17T02:23:30.972369+0000","last_became_peered":"2024-08-17T02:23:30.972369+0000","last_unstale":"2024-08-17T02:23:31.985350+0000","last_undegraded":"2024-08-17T02:23:31.985350+0000","last_fullsized":"2024-08-17T02:23:31.985350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:36:25.509573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.977171+0000","last_change":"2024-08-17T02:23:31.963289+0000","last_active":"2024-08-17T02:23:31.977171+0000","last_peered":"2024-08-17T02:23:31.977171+0000","last_clean":"2024-08-17T02:23:31.977171+0000","last_became_active":"2024-08-17T02:23:31.962870+0000","last_became_peered":"2024-08-17T02:23:31.962870+0000","last_unstale":"2024-08-17T02:23:31.977171+0000","last_undegraded":"2024-08-17T02:23:31.977171+0000","last_fullsized":"2024-08-17T02:23:31.977171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:03:52.570659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.948335+0000","last_change":"2024-08-17T02:23:30.973479+0000","last_active":"2024-08-17T02:23:31.948335+0000","last_peered":"2024-08-17T02:23:31.948335+0000","last_clean":"2024-08-17T02:23:31.948335+0000","last_became_active":"2024-08-17T02:23:30.973209+0000","last_became_peered":"2024-08-17T02:23:30.973209+0000","last_unstale":"2024-08-17T02:23:31.948335+0000","last_undegraded":"2024-08-17T02:23:31.948335+0000","last_fullsized":"2024-08-17T02:23:31.948335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:28.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.974767+0000","last_change":"2024-08-17T02:23:31.973100+0000","last_active":"2024-08-17T02:23:31.974767+0000","last_peered":"2024-08-17T02:23:31.974767+0000","last_clean":"2024-08-17T02:23:31.974767+0000","last_became_active":"2024-08-17T02:23:31.972794+0000","last_became_peered":"2024-08-17T02:23:31.972794+0000","last_unstale":"2024-08-17T02:23:31.974767+0000","last_undegraded":"2024-08-17T02:23:31.974767+0000","last_fullsized":"2024-08-17T02:23:31.974767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:58.965182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.954123+0000","last_change":"2024-08-17T02:23:30.970722+0000","last_active":"2024-08-17T02:23:31.954123+0000","last_peered":"2024-08-17T02:23:31.954123+0000","last_clean":"2024-08-17T02:23:31.954123+0000","last_became_active":"2024-08-17T02:23:30.970468+0000","last_became_peered":"2024-08-17T02:23:30.970468+0000","last_unstale":"2024-08-17T02:23:31.954123+0000","last_undegraded":"2024-08-17T02:23:31.954123+0000","last_fullsized":"2024-08-17T02:23:31.954123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:28.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.980626+0000","last_change":"2024-08-17T02:23:31.978226+0000","last_active":"2024-08-17T02:23:31.980626+0000","last_peered":"2024-08-17T02:23:31.980626+0000","last_clean":"2024-08-17T02:23:31.980626+0000","last_became_active":"2024-08-17T02:23:31.977930+0000","last_became_peered":"2024-08-17T02:23:31.977930+0000","last_unstale":"2024-08-17T02:23:31.980626+0000","last_undegraded":"2024-08-17T02:23:31.980626+0000","last_fullsized":"2024-08-17T02:23:31.980626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:10.516503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.979877+0000","last_change":"2024-08-17T02:23:30.965657+0000","last_active":"2024-08-17T02:23:31.979877+0000","last_peered":"2024-08-17T02:23:31.979877+0000","last_clean":"2024-08-17T02:23:31.979877+0000","last_became_active":"2024-08-17T02:23:30.965304+0000","last_became_peered":"2024-08-17T02:23:30.965304+0000","last_unstale":"2024-08-17T02:23:31.979877+0000","last_undegraded":"2024-08-17T02:23:31.979877+0000","last_fullsized":"2024-08-17T02:23:31.979877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:01.947289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.982558+0000","last_change":"2024-08-17T02:23:31.981260+0000","last_active":"2024-08-17T02:23:31.982558+0000","last_peered":"2024-08-17T02:23:31.982558+0000","last_clean":"2024-08-17T02:23:31.982558+0000","last_became_active":"2024-08-17T02:23:31.980747+0000","last_became_peered":"2024-08-17T02:23:31.980747+0000","last_unstale":"2024-08-17T02:23:31.982558+0000","last_undegraded":"2024-08-17T02:23:31.982558+0000","last_fullsized":"2024-08-17T02:23:31.982558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:30.415547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.984093+0000","last_change":"2024-08-17T02:23:30.968562+0000","last_active":"2024-08-17T02:23:31.984093+0000","last_peered":"2024-08-17T02:23:31.984093+0000","last_clean":"2024-08-17T02:23:31.984093+0000","last_became_active":"2024-08-17T02:23:30.968264+0000","last_became_peered":"2024-08-17T02:23:30.968264+0000","last_unstale":"2024-08-17T02:23:31.984093+0000","last_undegraded":"2024-08-17T02:23:31.984093+0000","last_fullsized":"2024-08-17T02:23:31.984093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:48:44.495463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.974695+0000","last_change":"2024-08-17T02:23:31.972997+0000","last_active":"2024-08-17T02:23:31.974695+0000","last_peered":"2024-08-17T02:23:31.974695+0000","last_clean":"2024-08-17T02:23:31.974695+0000","last_became_active":"2024-08-17T02:23:31.972782+0000","last_became_peered":"2024-08-17T02:23:31.972782+0000","last_unstale":"2024-08-17T02:23:31.974695+0000","last_undegraded":"2024-08-17T02:23:31.974695+0000","last_fullsized":"2024-08-17T02:23:31.974695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:50:55.354947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985261+0000","last_change":"2024-08-17T02:23:30.973992+0000","last_active":"2024-08-17T02:23:31.985261+0000","last_peered":"2024-08-17T02:23:31.985261+0000","last_clean":"2024-08-17T02:23:31.985261+0000","last_became_active":"2024-08-17T02:23:30.973677+0000","last_became_peered":"2024-08-17T02:23:30.973677+0000","last_unstale":"2024-08-17T02:23:31.985261+0000","last_undegraded":"2024-08-17T02:23:31.985261+0000","last_fullsized":"2024-08-17T02:23:31.985261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:28.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.976099+0000","last_change":"2024-08-17T02:23:31.973617+0000","last_active":"2024-08-17T02:23:31.976099+0000","last_peered":"2024-08-17T02:23:31.976099+0000","last_clean":"2024-08-17T02:23:31.976099+0000","last_became_active":"2024-08-17T02:23:31.973290+0000","last_became_peered":"2024-08-17T02:23:31.973290+0000","last_unstale":"2024-08-17T02:23:31.976099+0000","last_undegraded":"2024-08-17T02:23:31.976099+0000","last_fullsized":"2024-08-17T02:23:31.976099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:06.432367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.977182+0000","last_change":"2024-08-17T02:23:30.968994+0000","last_active":"2024-08-17T02:23:31.977182+0000","last_peered":"2024-08-17T02:23:31.977182+0000","last_clean":"2024-08-17T02:23:31.977182+0000","last_became_active":"2024-08-17T02:23:30.968655+0000","last_became_peered":"2024-08-17T02:23:30.968655+0000","last_unstale":"2024-08-17T02:23:31.977182+0000","last_undegraded":"2024-08-17T02:23:31.977182+0000","last_fullsized":"2024-08-17T02:23:31.977182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:20.670802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.986832+0000","last_change":"2024-08-17T02:23:31.968122+0000","last_active":"2024-08-17T02:23:31.986832+0000","last_peered":"2024-08-17T02:23:31.986832+0000","last_clean":"2024-08-17T02:23:31.986832+0000","last_became_active":"2024-08-17T02:23:31.967900+0000","last_became_peered":"2024-08-17T02:23:31.967900+0000","last_unstale":"2024-08-17T02:23:31.986832+0000","last_undegraded":"2024-08-17T02:23:31.986832+0000","last_fullsized":"2024-08-17T02:23:31.986832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:51.027128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.950822+0000","last_change":"2024-08-17T02:23:30.958979+0000","last_active":"2024-08-17T02:23:31.950822+0000","last_peered":"2024-08-17T02:23:31.950822+0000","last_clean":"2024-08-17T02:23:31.950822+0000","last_became_active":"2024-08-17T02:23:30.958685+0000","last_became_peered":"2024-08-17T02:23:30.958685+0000","last_unstale":"2024-08-17T02:23:31.950822+0000","last_undegraded":"2024-08-17T02:23:31.950822+0000","last_fullsized":"2024-08-17T02:23:31.950822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:20.670802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985565+0000","last_change":"2024-08-17T02:23:31.983473+0000","last_active":"2024-08-17T02:23:31.985565+0000","last_peered":"2024-08-17T02:23:31.985565+0000","last_clean":"2024-08-17T02:23:31.985565+0000","last_became_active":"2024-08-17T02:23:31.983267+0000","last_became_peered":"2024-08-17T02:23:31.983267+0000","last_unstale":"2024-08-17T02:23:31.985565+0000","last_undegraded":"2024-08-17T02:23:31.985565+0000","last_fullsized":"2024-08-17T02:23:31.985565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:43.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.949384+0000","last_change":"2024-08-17T02:23:27.953699+0000","last_active":"2024-08-17T02:23:31.949384+0000","last_peered":"2024-08-17T02:23:31.949384+0000","last_clean":"2024-08-17T02:23:31.949384+0000","last_became_active":"2024-08-17T02:23:27.952879+0000","last_became_peered":"2024-08-17T02:23:27.952879+0000","last_unstale":"2024-08-17T02:23:31.949384+0000","last_undegraded":"2024-08-17T02:23:31.949384+0000","last_fullsized":"2024-08-17T02:23:31.949384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:26.811202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:26.811202+0000","last_clean_scrub_stamp":"2024-08-17T02:23:26.811202+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:48.565059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.946954+0000","last_change":"2024-08-17T02:23:30.951704+0000","last_active":"2024-08-17T02:23:31.946954+0000","last_peered":"2024-08-17T02:23:31.946954+0000","last_clean":"2024-08-17T02:23:31.946954+0000","last_became_active":"2024-08-17T02:23:30.951462+0000","last_became_peered":"2024-08-17T02:23:30.951462+0000","last_unstale":"2024-08-17T02:23:31.946954+0000","last_undegraded":"2024-08-17T02:23:31.946954+0000","last_fullsized":"2024-08-17T02:23:31.946954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:01.947289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985590+0000","last_change":"2024-08-17T02:23:31.982162+0000","last_active":"2024-08-17T02:23:31.985590+0000","last_peered":"2024-08-17T02:23:31.985590+0000","last_clean":"2024-08-17T02:23:31.985590+0000","last_became_active":"2024-08-17T02:23:31.981826+0000","last_became_peered":"2024-08-17T02:23:31.981826+0000","last_unstale":"2024-08-17T02:23:31.985590+0000","last_undegraded":"2024-08-17T02:23:31.985590+0000","last_fullsized":"2024-08-17T02:23:31.985590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:07:31.568338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.949295+0000","last_change":"2024-08-17T02:23:30.960984+0000","last_active":"2024-08-17T02:23:31.949295+0000","last_peered":"2024-08-17T02:23:31.949295+0000","last_clean":"2024-08-17T02:23:31.949295+0000","last_became_active":"2024-08-17T02:23:30.960649+0000","last_became_peered":"2024-08-17T02:23:30.960649+0000","last_unstale":"2024-08-17T02:23:31.949295+0000","last_undegraded":"2024-08-17T02:23:31.949295+0000","last_fullsized":"2024-08-17T02:23:31.949295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:55:03.969746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983295+0000","last_change":"2024-08-17T02:23:31.980993+0000","last_active":"2024-08-17T02:23:31.983295+0000","last_peered":"2024-08-17T02:23:31.983295+0000","last_clean":"2024-08-17T02:23:31.983295+0000","last_became_active":"2024-08-17T02:23:31.980759+0000","last_became_peered":"2024-08-17T02:23:31.980759+0000","last_unstale":"2024-08-17T02:23:31.983295+0000","last_undegraded":"2024-08-17T02:23:31.983295+0000","last_fullsized":"2024-08-17T02:23:31.983295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:55.653301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.950251+0000","last_change":"2024-08-17T02:23:30.962851+0000","last_active":"2024-08-17T02:23:31.950251+0000","last_peered":"2024-08-17T02:23:31.950251+0000","last_clean":"2024-08-17T02:23:31.950251+0000","last_became_active":"2024-08-17T02:23:30.962554+0000","last_became_peered":"2024-08-17T02:23:30.962554+0000","last_unstale":"2024-08-17T02:23:31.950251+0000","last_undegraded":"2024-08-17T02:23:31.950251+0000","last_fullsized":"2024-08-17T02:23:31.950251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:36:25.509573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.960964+0000","last_change":"2024-08-17T02:23:31.957810+0000","last_active":"2024-08-17T02:23:31.960964+0000","last_peered":"2024-08-17T02:23:31.960964+0000","last_clean":"2024-08-17T02:23:31.960964+0000","last_became_active":"2024-08-17T02:23:31.957542+0000","last_became_peered":"2024-08-17T02:23:31.957542+0000","last_unstale":"2024-08-17T02:23:31.960964+0000","last_undegraded":"2024-08-17T02:23:31.960964+0000","last_fullsized":"2024-08-17T02:23:31.960964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:55.653301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.948429+0000","last_change":"2024-08-17T02:23:30.964915+0000","last_active":"2024-08-17T02:23:31.948429+0000","last_peered":"2024-08-17T02:23:31.948429+0000","last_clean":"2024-08-17T02:23:31.948429+0000","last_became_active":"2024-08-17T02:23:30.964673+0000","last_became_peered":"2024-08-17T02:23:30.964673+0000","last_unstale":"2024-08-17T02:23:31.948429+0000","last_undegraded":"2024-08-17T02:23:31.948429+0000","last_fullsized":"2024-08-17T02:23:31.948429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:40.754285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.976470+0000","last_change":"2024-08-17T02:23:31.971758+0000","last_active":"2024-08-17T02:23:31.976470+0000","last_peered":"2024-08-17T02:23:31.976470+0000","last_clean":"2024-08-17T02:23:31.976470+0000","last_became_active":"2024-08-17T02:23:31.971467+0000","last_became_peered":"2024-08-17T02:23:31.971467+0000","last_unstale":"2024-08-17T02:23:31.976470+0000","last_undegraded":"2024-08-17T02:23:31.976470+0000","last_fullsized":"2024-08-17T02:23:31.976470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:36.029248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.945915+0000","last_change":"2024-08-17T02:23:30.959168+0000","last_active":"2024-08-17T02:23:31.945915+0000","last_peered":"2024-08-17T02:23:31.945915+0000","last_clean":"2024-08-17T02:23:31.945915+0000","last_became_active":"2024-08-17T02:23:30.958720+0000","last_became_peered":"2024-08-17T02:23:30.958720+0000","last_unstale":"2024-08-17T02:23:31.945915+0000","last_undegraded":"2024-08-17T02:23:31.945915+0000","last_fullsized":"2024-08-17T02:23:31.945915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:35.026473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983315+0000","last_change":"2024-08-17T02:23:31.964694+0000","last_active":"2024-08-17T02:23:31.983315+0000","last_peered":"2024-08-17T02:23:31.983315+0000","last_clean":"2024-08-17T02:23:31.983315+0000","last_became_active":"2024-08-17T02:23:31.963180+0000","last_became_peered":"2024-08-17T02:23:31.963180+0000","last_unstale":"2024-08-17T02:23:31.983315+0000","last_undegraded":"2024-08-17T02:23:31.983315+0000","last_fullsized":"2024-08-17T02:23:31.983315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:39.645299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.949003+0000","last_change":"2024-08-17T02:23:30.961092+0000","last_active":"2024-08-17T02:23:31.949003+0000","last_peered":"2024-08-17T02:23:31.949003+0000","last_clean":"2024-08-17T02:23:31.949003+0000","last_became_active":"2024-08-17T02:23:30.960812+0000","last_became_peered":"2024-08-17T02:23:30.960812+0000","last_unstale":"2024-08-17T02:23:31.949003+0000","last_undegraded":"2024-08-17T02:23:31.949003+0000","last_fullsized":"2024-08-17T02:23:31.949003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:40.754285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.966415+0000","last_change":"2024-08-17T02:23:31.961035+0000","last_active":"2024-08-17T02:23:31.966415+0000","last_peered":"2024-08-17T02:23:31.966415+0000","last_clean":"2024-08-17T02:23:31.966415+0000","last_became_active":"2024-08-17T02:23:31.960738+0000","last_became_peered":"2024-08-17T02:23:31.960738+0000","last_unstale":"2024-08-17T02:23:31.966415+0000","last_undegraded":"2024-08-17T02:23:31.966415+0000","last_fullsized":"2024-08-17T02:23:31.966415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:27:58.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.946096+0000","last_change":"2024-08-17T02:23:30.962881+0000","last_active":"2024-08-17T02:23:31.946096+0000","last_peered":"2024-08-17T02:23:31.946096+0000","last_clean":"2024-08-17T02:23:31.946096+0000","last_became_active":"2024-08-17T02:23:30.962620+0000","last_became_peered":"2024-08-17T02:23:30.962620+0000","last_unstale":"2024-08-17T02:23:31.946096+0000","last_undegraded":"2024-08-17T02:23:31.946096+0000","last_fullsized":"2024-08-17T02:23:31.946096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:55:03.969746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.982546+0000","last_change":"2024-08-17T02:23:31.962220+0000","last_active":"2024-08-17T02:23:31.982546+0000","last_peered":"2024-08-17T02:23:31.982546+0000","last_clean":"2024-08-17T02:23:31.982546+0000","last_became_active":"2024-08-17T02:23:31.961166+0000","last_became_peered":"2024-08-17T02:23:31.961166+0000","last_unstale":"2024-08-17T02:23:31.982546+0000","last_undegraded":"2024-08-17T02:23:31.982546+0000","last_fullsized":"2024-08-17T02:23:31.982546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:43.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.976607+0000","last_change":"2024-08-17T02:23:30.966054+0000","last_active":"2024-08-17T02:23:31.976607+0000","last_peered":"2024-08-17T02:23:31.976607+0000","last_clean":"2024-08-17T02:23:31.976607+0000","last_became_active":"2024-08-17T02:23:30.965784+0000","last_became_peered":"2024-08-17T02:23:30.965784+0000","last_unstale":"2024-08-17T02:23:31.976607+0000","last_undegraded":"2024-08-17T02:23:31.976607+0000","last_fullsized":"2024-08-17T02:23:31.976607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:01.947289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.976523+0000","last_change":"2024-08-17T02:23:31.965797+0000","last_active":"2024-08-17T02:23:31.976523+0000","last_peered":"2024-08-17T02:23:31.976523+0000","last_clean":"2024-08-17T02:23:31.976523+0000","last_became_active":"2024-08-17T02:23:31.965545+0000","last_became_peered":"2024-08-17T02:23:31.965545+0000","last_unstale":"2024-08-17T02:23:31.976523+0000","last_undegraded":"2024-08-17T02:23:31.976523+0000","last_fullsized":"2024-08-17T02:23:31.976523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:45:56.326425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.949197+0000","last_change":"2024-08-17T02:23:30.965869+0000","last_active":"2024-08-17T02:23:31.949197+0000","last_peered":"2024-08-17T02:23:31.949197+0000","last_clean":"2024-08-17T02:23:31.949197+0000","last_became_active":"2024-08-17T02:23:30.965608+0000","last_became_peered":"2024-08-17T02:23:30.965608+0000","last_unstale":"2024-08-17T02:23:31.949197+0000","last_undegraded":"2024-08-17T02:23:31.949197+0000","last_fullsized":"2024-08-17T02:23:31.949197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:35.026473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983948+0000","last_change":"2024-08-17T02:23:31.978413+0000","last_active":"2024-08-17T02:23:31.983948+0000","last_peered":"2024-08-17T02:23:31.983948+0000","last_clean":"2024-08-17T02:23:31.983948+0000","last_became_active":"2024-08-17T02:23:31.978007+0000","last_became_peered":"2024-08-17T02:23:31.978007+0000","last_unstale":"2024-08-17T02:23:31.983948+0000","last_undegraded":"2024-08-17T02:23:31.983948+0000","last_fullsized":"2024-08-17T02:23:31.983948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:41.757059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.945306+0000","last_change":"2024-08-17T02:23:30.964876+0000","last_active":"2024-08-17T02:23:31.945306+0000","last_peered":"2024-08-17T02:23:31.945306+0000","last_clean":"2024-08-17T02:23:31.945306+0000","last_became_active":"2024-08-17T02:23:30.964624+0000","last_became_peered":"2024-08-17T02:23:30.964624+0000","last_unstale":"2024-08-17T02:23:31.945306+0000","last_undegraded":"2024-08-17T02:23:31.945306+0000","last_fullsized":"2024-08-17T02:23:31.945306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:28.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.982454+0000","last_change":"2024-08-17T02:23:31.962150+0000","last_active":"2024-08-17T02:23:31.982454+0000","last_peered":"2024-08-17T02:23:31.982454+0000","last_clean":"2024-08-17T02:23:31.982454+0000","last_became_active":"2024-08-17T02:23:31.961854+0000","last_became_peered":"2024-08-17T02:23:31.961854+0000","last_unstale":"2024-08-17T02:23:31.982454+0000","last_undegraded":"2024-08-17T02:23:31.982454+0000","last_fullsized":"2024-08-17T02:23:31.982454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:03:52.570659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.945619+0000","last_change":"2024-08-17T02:23:30.973512+0000","last_active":"2024-08-17T02:23:31.945619+0000","last_peered":"2024-08-17T02:23:31.945619+0000","last_clean":"2024-08-17T02:23:31.945619+0000","last_became_active":"2024-08-17T02:23:30.973240+0000","last_became_peered":"2024-08-17T02:23:30.973240+0000","last_unstale":"2024-08-17T02:23:31.945619+0000","last_undegraded":"2024-08-17T02:23:31.945619+0000","last_fullsized":"2024-08-17T02:23:31.945619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:01.947289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985519+0000","last_change":"2024-08-17T02:23:31.978338+0000","last_active":"2024-08-17T02:23:31.985519+0000","last_peered":"2024-08-17T02:23:31.985519+0000","last_clean":"2024-08-17T02:23:31.985519+0000","last_became_active":"2024-08-17T02:23:31.978044+0000","last_became_peered":"2024-08-17T02:23:31.978044+0000","last_unstale":"2024-08-17T02:23:31.985519+0000","last_undegraded":"2024-08-17T02:23:31.985519+0000","last_fullsized":"2024-08-17T02:23:31.985519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:10.516503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.973244+0000","last_change":"2024-08-17T02:23:30.965867+0000","last_active":"2024-08-17T02:23:31.973244+0000","last_peered":"2024-08-17T02:23:31.973244+0000","last_clean":"2024-08-17T02:23:31.973244+0000","last_became_active":"2024-08-17T02:23:30.965564+0000","last_became_peered":"2024-08-17T02:23:30.965564+0000","last_unstale":"2024-08-17T02:23:31.973244+0000","last_undegraded":"2024-08-17T02:23:31.973244+0000","last_fullsized":"2024-08-17T02:23:31.973244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:01.182394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983652+0000","last_change":"2024-08-17T02:23:31.982027+0000","last_active":"2024-08-17T02:23:31.983652+0000","last_peered":"2024-08-17T02:23:31.983652+0000","last_clean":"2024-08-17T02:23:31.983652+0000","last_became_active":"2024-08-17T02:23:31.981722+0000","last_became_peered":"2024-08-17T02:23:31.981722+0000","last_unstale":"2024-08-17T02:23:31.983652+0000","last_undegraded":"2024-08-17T02:23:31.983652+0000","last_fullsized":"2024-08-17T02:23:31.983652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:55.653301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.986694+0000","last_change":"2024-08-17T02:23:31.978093+0000","last_active":"2024-08-17T02:23:31.986694+0000","last_peered":"2024-08-17T02:23:31.986694+0000","last_clean":"2024-08-17T02:23:31.986694+0000","last_became_active":"2024-08-17T02:23:31.977706+0000","last_became_peered":"2024-08-17T02:23:31.977706+0000","last_unstale":"2024-08-17T02:23:31.986694+0000","last_undegraded":"2024-08-17T02:23:31.986694+0000","last_fullsized":"2024-08-17T02:23:31.986694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:43.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.987152+0000","last_change":"2024-08-17T02:23:30.957349+0000","last_active":"2024-08-17T02:23:31.987152+0000","last_peered":"2024-08-17T02:23:31.987152+0000","last_clean":"2024-08-17T02:23:31.987152+0000","last_became_active":"2024-08-17T02:23:30.957063+0000","last_became_peered":"2024-08-17T02:23:30.957063+0000","last_unstale":"2024-08-17T02:23:31.987152+0000","last_undegraded":"2024-08-17T02:23:31.987152+0000","last_fullsized":"2024-08-17T02:23:31.987152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:01.947289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.986866+0000","last_change":"2024-08-17T02:23:31.974984+0000","last_active":"2024-08-17T02:23:31.986866+0000","last_peered":"2024-08-17T02:23:31.986866+0000","last_clean":"2024-08-17T02:23:31.986866+0000","last_became_active":"2024-08-17T02:23:31.974774+0000","last_became_peered":"2024-08-17T02:23:31.974774+0000","last_unstale":"2024-08-17T02:23:31.986866+0000","last_undegraded":"2024-08-17T02:23:31.986866+0000","last_fullsized":"2024-08-17T02:23:31.986866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:38.802352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.974239+0000","last_change":"2024-08-17T02:23:30.965411+0000","last_active":"2024-08-17T02:23:31.974239+0000","last_peered":"2024-08-17T02:23:31.974239+0000","last_clean":"2024-08-17T02:23:31.974239+0000","last_became_active":"2024-08-17T02:23:30.962792+0000","last_became_peered":"2024-08-17T02:23:30.962792+0000","last_unstale":"2024-08-17T02:23:31.974239+0000","last_undegraded":"2024-08-17T02:23:31.974239+0000","last_fullsized":"2024-08-17T02:23:31.974239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:56.544091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983073+0000","last_change":"2024-08-17T02:23:31.980658+0000","last_active":"2024-08-17T02:23:31.983073+0000","last_peered":"2024-08-17T02:23:31.983073+0000","last_clean":"2024-08-17T02:23:31.983073+0000","last_became_active":"2024-08-17T02:23:31.980238+0000","last_became_peered":"2024-08-17T02:23:31.980238+0000","last_unstale":"2024-08-17T02:23:31.983073+0000","last_undegraded":"2024-08-17T02:23:31.983073+0000","last_fullsized":"2024-08-17T02:23:31.983073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:37.211325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983596+0000","last_change":"2024-08-17T02:23:30.972133+0000","last_active":"2024-08-17T02:23:31.983596+0000","last_peered":"2024-08-17T02:23:31.983596+0000","last_clean":"2024-08-17T02:23:31.983596+0000","last_became_active":"2024-08-17T02:23:30.971784+0000","last_became_peered":"2024-08-17T02:23:30.971784+0000","last_unstale":"2024-08-17T02:23:31.983596+0000","last_undegraded":"2024-08-17T02:23:31.983596+0000","last_fullsized":"2024-08-17T02:23:31.983596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:20.670802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983566+0000","last_change":"2024-08-17T02:23:31.965808+0000","last_active":"2024-08-17T02:23:31.983566+0000","last_peered":"2024-08-17T02:23:31.983566+0000","last_clean":"2024-08-17T02:23:31.983566+0000","last_became_active":"2024-08-17T02:23:31.965581+0000","last_became_peered":"2024-08-17T02:23:31.965581+0000","last_unstale":"2024-08-17T02:23:31.983566+0000","last_undegraded":"2024-08-17T02:23:31.983566+0000","last_fullsized":"2024-08-17T02:23:31.983566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:58.965182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.982943+0000","last_change":"2024-08-17T02:23:30.962575+0000","last_active":"2024-08-17T02:23:31.982943+0000","last_peered":"2024-08-17T02:23:31.982943+0000","last_clean":"2024-08-17T02:23:31.982943+0000","last_became_active":"2024-08-17T02:23:30.962277+0000","last_became_peered":"2024-08-17T02:23:30.962277+0000","last_unstale":"2024-08-17T02:23:31.982943+0000","last_undegraded":"2024-08-17T02:23:31.982943+0000","last_fullsized":"2024-08-17T02:23:31.982943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:24:02.271519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":815104,"data_stored":666251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301732,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070108,"statfs":{"total":96636764160,"available":96327790592,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301740,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070100,"statfs":{"total":96636764160,"available":96327782400,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302320,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069520,"statfs":{"total":96636764160,"available":96327188480,"internally_reserved":0,"allocated":823296,"data_stored":666307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:23:36.562 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:23:36.563 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-17T02:23:36.563 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-17T02:23:36.563 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-17T02:23:36.563 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-17T02:23:36.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.748+0000 7fceb4e00640 1 Processor -- start 2024-08-17T02:23:36.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.748+0000 7fceb4e00640 1 -- start start 2024-08-17T02:23:36.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.749+0000 7fceb4e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fceb0158a20 0x7fceb00a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.749+0000 7fceb4e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fceb00ae860 0x7fceb006d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.750+0000 7fceb4e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb00aed90 con 0x7fceb0158df0 2024-08-17T02:23:36.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.750+0000 7fceb4e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb00af070 con 0x7fceb0158a20 2024-08-17T02:23:36.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.750+0000 7fceb4e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb00af350 con 0x7fceb00ae860 2024-08-17T02:23:36.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.750+0000 7fceade00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fceb0158a20 0x7fceb00a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.750+0000 7fceade00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fceb0158a20 0x7fceb00a89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53702/0 (socket says 172.21.15.2:53702) 2024-08-17T02:23:36.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.750+0000 7fceade00640 1 -- 172.21.15.2:0/2629149316 learned_addr learned my addr 172.21.15.2:0/2629149316 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:36.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.750+0000 7fcea7e00640 1 --2- 172.21.15.2:0/2629149316 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fceb00ae860 0x7fceb006d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.750+0000 7fceade00640 1 -- 172.21.15.2:0/2629149316 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fceb00ae860 msgr2=0x7fceb006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:36.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.750+0000 7fceade00640 1 --2- 172.21.15.2:0/2629149316 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fceb00ae860 0x7fceb006d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.750+0000 7fceade00640 1 -- 172.21.15.2:0/2629149316 >> v1:172.21.15.2:6789/0 conn(0x7fceb0158df0 legacy=0x7fceb015c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:36.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.750+0000 7fceade00640 1 -- 172.21.15.2:0/2629149316 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb00af630 con 0x7fceb0158a20 2024-08-17T02:23:36.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.750+0000 7fcea7e00640 1 --2- 172.21.15.2:0/2629149316 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fceb00ae860 0x7fceb006d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:36.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.751+0000 7fceade00640 1 --2- 172.21.15.2:0/2629149316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fceb0158a20 0x7fceb00a89c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009910 tx=0x7fcea00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0fc0a26a243b5b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:36.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.751+0000 7fcead400640 1 -- 172.21.15.2:0/2629149316 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea002ae40 con 0x7fceb0158a20 2024-08-17T02:23:36.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.751+0000 7fcead400640 1 -- 172.21.15.2:0/2629149316 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea0032440 con 0x7fceb0158a20 2024-08-17T02:23:36.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.752+0000 7fcead400640 1 -- 172.21.15.2:0/2629149316 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea0032820 con 0x7fceb0158a20 2024-08-17T02:23:36.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.752+0000 7fceb4e00640 1 -- 172.21.15.2:0/2629149316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fceb0158a20 msgr2=0x7fceb00a89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:36.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.752+0000 7fceb4e00640 1 --2- 172.21.15.2:0/2629149316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fceb0158a20 0x7fceb00a89c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009910 tx=0x7fcea00091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.752+0000 7fceb4e00640 1 -- 172.21.15.2:0/2629149316 shutdown_connections 2024-08-17T02:23:36.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.752+0000 7fceb4e00640 1 --2- 172.21.15.2:0/2629149316 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fceb00ae860 0x7fceb006d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.752+0000 7fceb4e00640 1 --2- 172.21.15.2:0/2629149316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fceb0158a20 0x7fceb00a89c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.752+0000 7fceb4e00640 1 -- 172.21.15.2:0/2629149316 >> 172.21.15.2:0/2629149316 conn(0x7fceb0066e60 msgr2=0x7fceb0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:36.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.752+0000 7fceb4e00640 1 -- 172.21.15.2:0/2629149316 shutdown_connections 2024-08-17T02:23:36.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.752+0000 7fceb4e00640 1 -- 172.21.15.2:0/2629149316 wait complete. 2024-08-17T02:23:36.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.753+0000 7fceb4e00640 1 Processor -- start 2024-08-17T02:23:36.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.754+0000 7fceb4e00640 1 -- start start 2024-08-17T02:23:36.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.754+0000 7fceb4e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fceb00ae860 0x7fceb01560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.754+0000 7fceb4e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fceb0158a20 0x7fceb0144f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.754+0000 7fceb4e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fceb0158df0 0x7fceb0145460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.754+0000 7fceb4e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb0154800 con 0x7fceb0158a20 2024-08-17T02:23:36.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.754+0000 7fceb4e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb0154ae0 con 0x7fceb00ae860 2024-08-17T02:23:36.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.754+0000 7fceb4e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb0154dc0 con 0x7fceb0158df0 2024-08-17T02:23:36.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.755+0000 7fcea7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fceb0158a20 0x7fceb0144f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.755+0000 7fcea7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fceb0158a20 0x7fceb0144f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53712/0 (socket says 172.21.15.2:53712) 2024-08-17T02:23:36.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.755+0000 7fcea7e00640 1 -- 172.21.15.2:0/985647777 learned_addr learned my addr 172.21.15.2:0/985647777 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:36.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.755+0000 7fceade00640 1 --2- 172.21.15.2:0/985647777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fceb00ae860 0x7fceb01560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.755+0000 7fceae800640 1 --2- 172.21.15.2:0/985647777 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fceb0158df0 0x7fceb0145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.755+0000 7fcea7e00640 1 -- 172.21.15.2:0/985647777 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fceb0158df0 msgr2=0x7fceb0145460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:36.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.755+0000 7fcea7e00640 1 --2- 172.21.15.2:0/985647777 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fceb0158df0 0x7fceb0145460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.755+0000 7fcea7e00640 1 -- 172.21.15.2:0/985647777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fceb00ae860 msgr2=0x7fceb01560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:36.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.755+0000 7fcea7e00640 1 --2- 172.21.15.2:0/985647777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fceb00ae860 0x7fceb01560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.755+0000 7fcea7e00640 1 -- 172.21.15.2:0/985647777 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea0009450 con 0x7fceb0158a20 2024-08-17T02:23:36.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.755+0000 7fceade00640 1 --2- 172.21.15.2:0/985647777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fceb00ae860 0x7fceb01560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:36.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.755+0000 7fcea7e00640 1 --2- 172.21.15.2:0/985647777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fceb0158a20 0x7fceb0144f20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fce9800d890 tx=0x7fce98008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:36.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.755+0000 7fcea5600640 1 -- 172.21.15.2:0/985647777 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9800de20 con 0x7fceb0158a20 2024-08-17T02:23:36.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.756+0000 7fcea5600640 1 -- 172.21.15.2:0/985647777 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9800b8d0 con 0x7fceb0158a20 2024-08-17T02:23:36.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.756+0000 7fcea5600640 1 -- 172.21.15.2:0/985647777 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9800bc70 con 0x7fceb0158a20 2024-08-17T02:23:36.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.756+0000 7fceb4e00640 1 -- 172.21.15.2:0/985647777 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb01550a0 con 0x7fceb0158a20 2024-08-17T02:23:36.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.756+0000 7fceb4e00640 1 -- 172.21.15.2:0/985647777 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb0152860 con 0x7fceb0158a20 2024-08-17T02:23:36.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.757+0000 7fceb4e00640 1 -- 172.21.15.2:0/985647777 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb0063fb0 con 0x7fceb0158a20 2024-08-17T02:23:36.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.757+0000 7fcea5600640 1 -- 172.21.15.2:0/985647777 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fce9801e460 con 0x7fceb0158a20 2024-08-17T02:23:36.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.758+0000 7fcea5600640 1 --2- 172.21.15.2:0/985647777 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fce8c065150 0x7fce8c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.758+0000 7fcea5600640 1 -- 172.21.15.2:0/985647777 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fce98082bd0 con 0x7fceb0158a20 2024-08-17T02:23:36.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.759+0000 7fceade00640 1 --2- 172.21.15.2:0/985647777 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fce8c065150 0x7fce8c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.759+0000 7fceade00640 1 --2- 172.21.15.2:0/985647777 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fce8c065150 0x7fce8c067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcea0034000 tx=0x7fcea0032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:36.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.762+0000 7fcea5600640 1 -- 172.21.15.2:0/985647777 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fce98050cb0 con 0x7fceb0158a20 2024-08-17T02:23:36.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.990+0000 7fceb4e00640 1 -- 172.21.15.2:0/985647777 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fceb006e4c0 con 0x7fceb0158a20 2024-08-17T02:23:36.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.994+0000 7fcea5600640 1 -- 172.21.15.2:0/985647777 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+161037 (secure 0 0 0) 0x7fce980542d0 con 0x7fceb0158a20 2024-08-17T02:23:36.995 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:36.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.997+0000 7fceb4e00640 1 -- 172.21.15.2:0/985647777 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fce8c065150 msgr2=0x7fce8c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:36.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.997+0000 7fceb4e00640 1 --2- 172.21.15.2:0/985647777 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fce8c065150 0x7fce8c067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcea0034000 tx=0x7fcea0032000 comp rx=0 tx=0).stop 2024-08-17T02:23:36.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.997+0000 7fceb4e00640 1 -- 172.21.15.2:0/985647777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fceb0158a20 msgr2=0x7fceb0144f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:36.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.997+0000 7fceb4e00640 1 --2- 172.21.15.2:0/985647777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fceb0158a20 0x7fceb0144f20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fce9800d890 tx=0x7fce98008040 comp rx=0 tx=0).stop 2024-08-17T02:23:36.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.997+0000 7fceb4e00640 1 -- 172.21.15.2:0/985647777 shutdown_connections 2024-08-17T02:23:36.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.997+0000 7fceb4e00640 1 --2- 172.21.15.2:0/985647777 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fce8c065150 0x7fce8c067600 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.997+0000 7fceb4e00640 1 --2- 172.21.15.2:0/985647777 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fceb0158df0 0x7fceb0145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.997+0000 7fceb4e00640 1 --2- 172.21.15.2:0/985647777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fceb0158a20 0x7fceb0144f20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.997+0000 7fceb4e00640 1 --2- 172.21.15.2:0/985647777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fceb00ae860 0x7fceb01560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.997+0000 7fceb4e00640 1 -- 172.21.15.2:0/985647777 >> 172.21.15.2:0/985647777 conn(0x7fceb0066e60 msgr2=0x7fceb006b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:36.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.997+0000 7fceb4e00640 1 -- 172.21.15.2:0/985647777 shutdown_connections 2024-08-17T02:23:36.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:36.997+0000 7fceb4e00640 1 -- 172.21.15.2:0/985647777 wait complete. 2024-08-17T02:23:37.011 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":36841},{"type":"v1","addr":"172.21.15.145:6833","nonce":36841}]},"active_addr":"172.21.15.145:6833/36841","active_change":"2024-08-17T02:23:18.037168+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.145:0","nonce":583870546}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.145:0","nonce":3405421445}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.145:0","nonce":2845788602}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.145:0","nonce":2354302045}]}]} 2024-08-17T02:23:37.015 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-17T02:23:37.015 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-17T02:23:37.015 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:37.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.167+0000 7f27ce800640 1 Processor -- start 2024-08-17T02:23:37.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.167+0000 7f27ce800640 1 -- start start 2024-08-17T02:23:37.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.168+0000 7f27ce800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27c80acf10 0x7f27c80b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:37.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.168+0000 7f27ce800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c80c92b0 con 0x7f27c80afca0 2024-08-17T02:23:37.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.168+0000 7f27ce800640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c80ad480 con 0x7f27c81590b0 2024-08-17T02:23:37.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.168+0000 7f27ce800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c80b0980 con 0x7f27c80acf10 2024-08-17T02:23:37.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.168+0000 7f27c7400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f27c80afca0 0x7f27c81589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36000/0 (socket says 172.21.15.2:36000) 2024-08-17T02:23:37.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.168+0000 7f27c7400640 1 -- 172.21.15.2:0/2371899257 learned_addr learned my addr 172.21.15.2:0/2371899257 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:37.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.169+0000 7f27c7e00640 1 --2- 172.21.15.2:0/2371899257 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27c80acf10 0x7f27c80b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:37.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.169+0000 7f27c6a00640 1 -- 172.21.15.2:0/2371899257 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1000628598 0 0) 0x7f27c80c92b0 con 0x7f27c80afca0 2024-08-17T02:23:37.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.169+0000 7f27c6a00640 1 -- 172.21.15.2:0/2371899257 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27ac0034e0 con 0x7f27c80afca0 2024-08-17T02:23:37.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.169+0000 7f27c6a00640 1 -- 172.21.15.2:0/2371899257 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407681 0 0) 0x7f27c80ad480 con 0x7f27c81590b0 2024-08-17T02:23:37.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.169+0000 7f27c6a00640 1 -- 172.21.15.2:0/2371899257 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27c80c92b0 con 0x7f27c81590b0 2024-08-17T02:23:37.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.169+0000 7f27c6a00640 1 -- 172.21.15.2:0/2371899257 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2457638939 0 0) 0x7f27ac0034e0 con 0x7f27c80afca0 2024-08-17T02:23:37.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.169+0000 7f27c7e00640 1 -- 172.21.15.2:0/2371899257 >> v1:172.21.15.145:6789/0 conn(0x7f27c81590b0 legacy=0x7f27c80c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:37.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.169+0000 7f27c7e00640 1 -- 172.21.15.2:0/2371899257 >> v1:172.21.15.2:6789/0 conn(0x7f27c80afca0 legacy=0x7f27c81589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:37.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.169+0000 7f27c7e00640 1 -- 172.21.15.2:0/2371899257 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c80ad760 con 0x7f27c80acf10 2024-08-17T02:23:37.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.170+0000 7f27c7e00640 1 --2- 172.21.15.2:0/2371899257 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27c80acf10 0x7f27c80b0070 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009e90 tx=0x7f27c0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c20f3178deb84de0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:37.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.170+0000 7f27c6a00640 1 -- 172.21.15.2:0/2371899257 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b8001470 con 0x7f27c80acf10 2024-08-17T02:23:37.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.170+0000 7f27c6a00640 1 -- 172.21.15.2:0/2371899257 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c002d050 con 0x7f27c80acf10 2024-08-17T02:23:37.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.170+0000 7f27c6a00640 1 -- 172.21.15.2:0/2371899257 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c0031630 con 0x7f27c80acf10 2024-08-17T02:23:37.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.171+0000 7f27ce800640 1 -- 172.21.15.2:0/2371899257 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27c80acf10 msgr2=0x7f27c80b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:37.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.171+0000 7f27ce800640 1 --2- 172.21.15.2:0/2371899257 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27c80acf10 0x7f27c80b0070 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009e90 tx=0x7f27c0009780 comp rx=0 tx=0).stop 2024-08-17T02:23:37.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.171+0000 7f27ce800640 1 -- 172.21.15.2:0/2371899257 shutdown_connections 2024-08-17T02:23:37.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.171+0000 7f27ce800640 1 --2- 172.21.15.2:0/2371899257 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27c80acf10 0x7f27c80b0070 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.171+0000 7f27ce800640 1 -- 172.21.15.2:0/2371899257 >> 172.21.15.2:0/2371899257 conn(0x7f27c8066e60 msgr2=0x7f27c8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:37.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.171+0000 7f27ce800640 1 -- 172.21.15.2:0/2371899257 shutdown_connections 2024-08-17T02:23:37.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.171+0000 7f27ce800640 1 -- 172.21.15.2:0/2371899257 wait complete. 2024-08-17T02:23:37.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.172+0000 7f27ce800640 1 Processor -- start 2024-08-17T02:23:37.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.173+0000 7f27ce800640 1 -- start start 2024-08-17T02:23:37.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.173+0000 7f27ce800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27c80acf10 0x7f27c8155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:37.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.173+0000 7f27ce800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27c80afca0 0x7f27c8151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:37.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.173+0000 7f27ce800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f27c81590b0 0x7f27c8156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:37.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.174+0000 7f27ce800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c8156500 con 0x7f27c80afca0 2024-08-17T02:23:37.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.174+0000 7f27ce800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c8155b30 con 0x7f27c81590b0 2024-08-17T02:23:37.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.174+0000 7f27ce800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c8152320 con 0x7f27c80acf10 2024-08-17T02:23:37.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.174+0000 7f27bfe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27c80afca0 0x7f27c8151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:37.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.174+0000 7f27bfe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27c80afca0 0x7f27c8151de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53728/0 (socket says 172.21.15.2:53728) 2024-08-17T02:23:37.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.174+0000 7f27bfe00640 1 -- 172.21.15.2:0/3696185312 learned_addr learned my addr 172.21.15.2:0/3696185312 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:37.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.174+0000 7f27c7400640 1 --2- 172.21.15.2:0/3696185312 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27c80acf10 0x7f27c8155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:37.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.174+0000 7f27c7e00640 1 --2- 172.21.15.2:0/3696185312 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f27c81590b0 0x7f27c8156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:37.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.174+0000 7f27bfe00640 1 -- 172.21.15.2:0/3696185312 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27c80acf10 msgr2=0x7f27c8155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:37.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.174+0000 7f27bfe00640 1 --2- 172.21.15.2:0/3696185312 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27c80acf10 0x7f27c8155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.174+0000 7f27bfe00640 1 -- 172.21.15.2:0/3696185312 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f27c81590b0 msgr2=0x7f27c8156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:37.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.174+0000 7f27bfe00640 1 --2- 172.21.15.2:0/3696185312 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f27c81590b0 0x7f27c8156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.174+0000 7f27bfe00640 1 -- 172.21.15.2:0/3696185312 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c0009a20 con 0x7f27c80afca0 2024-08-17T02:23:37.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.174+0000 7f27bfe00640 1 --2- 172.21.15.2:0/3696185312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27c80afca0 0x7f27c8151de0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f27b000c4b0 tx=0x7f27b0007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:37.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.175+0000 7f27bea00640 1 -- 172.21.15.2:0/3696185312 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b0011590 con 0x7f27c80afca0 2024-08-17T02:23:37.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.175+0000 7f27bea00640 1 -- 172.21.15.2:0/3696185312 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b00116f0 con 0x7f27c80afca0 2024-08-17T02:23:37.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.175+0000 7f27bea00640 1 -- 172.21.15.2:0/3696185312 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b0011ab0 con 0x7f27c80afca0 2024-08-17T02:23:37.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.175+0000 7f27ce800640 1 -- 172.21.15.2:0/3696185312 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c8154f20 con 0x7f27c80afca0 2024-08-17T02:23:37.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.175+0000 7f27ce800640 1 -- 172.21.15.2:0/3696185312 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c81554e0 con 0x7f27c80afca0 2024-08-17T02:23:37.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.176+0000 7f27ce800640 1 -- 172.21.15.2:0/3696185312 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c8063fb0 con 0x7f27c80afca0 2024-08-17T02:23:37.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.177+0000 7f27bea00640 1 -- 172.21.15.2:0/3696185312 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f27b001c460 con 0x7f27c80afca0 2024-08-17T02:23:37.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.177+0000 7f27bea00640 1 --2- 172.21.15.2:0/3696185312 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f27a4065150 0x7f27a4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:37.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.178+0000 7f27bea00640 1 -- 172.21.15.2:0/3696185312 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f27b0081ff0 con 0x7f27c80afca0 2024-08-17T02:23:37.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.178+0000 7f27c7400640 1 --2- 172.21.15.2:0/3696185312 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f27a4065150 0x7f27a4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:37.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.178+0000 7f27c7400640 1 --2- 172.21.15.2:0/3696185312 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f27a4065150 0x7f27a4067600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f27b80015a0 tx=0x7f27b8001b00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:37.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.181+0000 7f27bea00640 1 -- 172.21.15.2:0/3696185312 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f27b0050120 con 0x7f27c80afca0 2024-08-17T02:23:37.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.365+0000 7f27ce800640 1 -- 172.21.15.2:0/3696185312 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27c8067b70 con 0x7f27c80afca0 2024-08-17T02:23:37.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.366+0000 7f27bea00640 1 -- 172.21.15.2:0/3696185312 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f27b0053740 con 0x7f27c80afca0 2024-08-17T02:23:37.366 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:37.366 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:23:32.955197+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:29.708835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:30.361908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:37.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.368+0000 7f27ce800640 1 -- 172.21.15.2:0/3696185312 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f27a4065150 msgr2=0x7f27a4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:37.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.368+0000 7f27ce800640 1 --2- 172.21.15.2:0/3696185312 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f27a4065150 0x7f27a4067600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f27b80015a0 tx=0x7f27b8001b00 comp rx=0 tx=0).stop 2024-08-17T02:23:37.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.368+0000 7f27ce800640 1 -- 172.21.15.2:0/3696185312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27c80afca0 msgr2=0x7f27c8151de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:37.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.368+0000 7f27ce800640 1 --2- 172.21.15.2:0/3696185312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27c80afca0 0x7f27c8151de0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f27b000c4b0 tx=0x7f27b0007d50 comp rx=0 tx=0).stop 2024-08-17T02:23:37.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.368+0000 7f27ce800640 1 -- 172.21.15.2:0/3696185312 shutdown_connections 2024-08-17T02:23:37.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.368+0000 7f27ce800640 1 --2- 172.21.15.2:0/3696185312 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f27c81590b0 0x7f27c8156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.368+0000 7f27ce800640 1 --2- 172.21.15.2:0/3696185312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27c80afca0 0x7f27c8151de0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.368+0000 7f27ce800640 1 --2- 172.21.15.2:0/3696185312 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f27a4065150 0x7f27a4067600 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.368+0000 7f27ce800640 1 --2- 172.21.15.2:0/3696185312 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27c80acf10 0x7f27c8155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.368+0000 7f27ce800640 1 -- 172.21.15.2:0/3696185312 >> 172.21.15.2:0/3696185312 conn(0x7f27c8066e60 msgr2=0x7f27c80c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:37.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.369+0000 7f27ce800640 1 -- 172.21.15.2:0/3696185312 shutdown_connections 2024-08-17T02:23:37.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.369+0000 7f27ce800640 1 -- 172.21.15.2:0/3696185312 wait complete. 2024-08-17T02:23:37.385 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-17T02:23:37.385 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:37.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.535+0000 7f7436c00640 1 Processor -- start 2024-08-17T02:23:37.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.536+0000 7f7436c00640 1 -- start start 2024-08-17T02:23:37.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.537+0000 7f7436c00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f74300b0e30 0x7f74300b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:37.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.537+0000 7f7436c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f743015a590 0x7f743013fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:37.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.537+0000 7f7436c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743006d7c0 con 0x7f7430156f90 2024-08-17T02:23:37.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.537+0000 7f7436c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743015ab30 con 0x7f743015a590 2024-08-17T02:23:37.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.537+0000 7f7436c00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743015ae10 con 0x7f74300b0e30 2024-08-17T02:23:37.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.537+0000 7f7436200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f743015a590 0x7f743013fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:37.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.537+0000 7f7436200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f743015a590 0x7f743013fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53732/0 (socket says 172.21.15.2:53732) 2024-08-17T02:23:37.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.537+0000 7f7436200640 1 -- 172.21.15.2:0/3831869000 learned_addr learned my addr 172.21.15.2:0/3831869000 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:37.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.537+0000 7f7435800640 1 --2- 172.21.15.2:0/3831869000 >> v2:172.21.15.145:3300/0 conn(0x7f74300b0e30 0x7f74300b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:37.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.538+0000 7f7436200640 1 -- 172.21.15.2:0/3831869000 >> v2:172.21.15.145:3300/0 conn(0x7f74300b0e30 msgr2=0x7f74300b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:37.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.538+0000 7f7436200640 1 --2- 172.21.15.2:0/3831869000 >> v2:172.21.15.145:3300/0 conn(0x7f74300b0e30 0x7f74300b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.538+0000 7f7436200640 1 -- 172.21.15.2:0/3831869000 >> v1:172.21.15.2:6789/0 conn(0x7f7430156f90 legacy=0x7f74300cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:37.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.538+0000 7f7436200640 1 -- 172.21.15.2:0/3831869000 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743015b0f0 con 0x7f743015a590 2024-08-17T02:23:37.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.539+0000 7f7436200640 1 --2- 172.21.15.2:0/3831869000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f743015a590 0x7f743013fcc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f74300cb7e0 tx=0x7f7428009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad40edca4e761af1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:37.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.539+0000 7f742fe00640 1 -- 172.21.15.2:0/3831869000 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742802e050 con 0x7f743015a590 2024-08-17T02:23:37.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.539+0000 7f742fe00640 1 -- 172.21.15.2:0/3831869000 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7428007400 con 0x7f743015a590 2024-08-17T02:23:37.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.539+0000 7f742fe00640 1 -- 172.21.15.2:0/3831869000 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74280077e0 con 0x7f743015a590 2024-08-17T02:23:37.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.540+0000 7f7436c00640 1 -- 172.21.15.2:0/3831869000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f743015a590 msgr2=0x7f743013fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:37.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.540+0000 7f7436c00640 1 --2- 172.21.15.2:0/3831869000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f743015a590 0x7f743013fcc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f74300cb7e0 tx=0x7f7428009840 comp rx=0 tx=0).stop 2024-08-17T02:23:37.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.540+0000 7f7436c00640 1 -- 172.21.15.2:0/3831869000 shutdown_connections 2024-08-17T02:23:37.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.540+0000 7f7436c00640 1 --2- 172.21.15.2:0/3831869000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f743015a590 0x7f743013fcc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.540+0000 7f7436c00640 1 --2- 172.21.15.2:0/3831869000 >> v2:172.21.15.145:3300/0 conn(0x7f74300b0e30 0x7f74300b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.540+0000 7f7436c00640 1 -- 172.21.15.2:0/3831869000 >> 172.21.15.2:0/3831869000 conn(0x7f7430062af0 msgr2=0x7f7430062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:37.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.540+0000 7f7436c00640 1 -- 172.21.15.2:0/3831869000 shutdown_connections 2024-08-17T02:23:37.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.540+0000 7f7436c00640 1 -- 172.21.15.2:0/3831869000 wait complete. 2024-08-17T02:23:37.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.541+0000 7f7436c00640 1 Processor -- start 2024-08-17T02:23:37.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.541+0000 7f7436c00640 1 -- start start 2024-08-17T02:23:37.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.542+0000 7f7436c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74300b0e30 0x7f74300c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:37.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.542+0000 7f7436c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7430156f90 0x7f7430139400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:37.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.542+0000 7f7436c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f743015a590 0x7f74300c36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:37.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.542+0000 7f7436c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74300c29c0 con 0x7f74300b0e30 2024-08-17T02:23:37.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.542+0000 7f7436c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74300c1db0 con 0x7f743015a590 2024-08-17T02:23:37.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.542+0000 7f7436c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74300c2090 con 0x7f7430156f90 2024-08-17T02:23:37.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.542+0000 7f7435800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74300b0e30 0x7f74300c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:37.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.542+0000 7f7435800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74300b0e30 0x7f74300c1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53746/0 (socket says 172.21.15.2:53746) 2024-08-17T02:23:37.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.542+0000 7f7435800640 1 -- 172.21.15.2:0/266851709 learned_addr learned my addr 172.21.15.2:0/266851709 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:37.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.543+0000 7f7436200640 1 --2- 172.21.15.2:0/266851709 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f743015a590 0x7f74300c36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:37.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.543+0000 7f7434e00640 1 --2- 172.21.15.2:0/266851709 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7430156f90 0x7f7430139400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:37.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.543+0000 7f7435800640 1 -- 172.21.15.2:0/266851709 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7430156f90 msgr2=0x7f7430139400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:37.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.543+0000 7f7435800640 1 --2- 172.21.15.2:0/266851709 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7430156f90 0x7f7430139400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.543+0000 7f7435800640 1 -- 172.21.15.2:0/266851709 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f743015a590 msgr2=0x7f74300c36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:37.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.543+0000 7f7435800640 1 --2- 172.21.15.2:0/266851709 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f743015a590 0x7f74300c36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.543+0000 7f7435800640 1 -- 172.21.15.2:0/266851709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7428009ae0 con 0x7f74300b0e30 2024-08-17T02:23:37.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.543+0000 7f7434e00640 1 --2- 172.21.15.2:0/266851709 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7430156f90 0x7f7430139400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:37.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.543+0000 7f7435800640 1 --2- 172.21.15.2:0/266851709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74300b0e30 0x7f74300c1720 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f742400ea20 tx=0x7f74240090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:37.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.543+0000 7f742cc00640 1 -- 172.21.15.2:0/266851709 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742400ca10 con 0x7f74300b0e30 2024-08-17T02:23:37.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.543+0000 7f742cc00640 1 -- 172.21.15.2:0/266851709 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742400cb70 con 0x7f74300b0e30 2024-08-17T02:23:37.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.543+0000 7f7436c00640 1 -- 172.21.15.2:0/266851709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74300c2370 con 0x7f74300b0e30 2024-08-17T02:23:37.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.543+0000 7f742cc00640 1 -- 172.21.15.2:0/266851709 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7424013470 con 0x7f74300b0e30 2024-08-17T02:23:37.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.544+0000 7f7436c00640 1 -- 172.21.15.2:0/266851709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74300c3c30 con 0x7f74300b0e30 2024-08-17T02:23:37.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.545+0000 7f7436c00640 1 -- 172.21.15.2:0/266851709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74300c56b0 con 0x7f74300b0e30 2024-08-17T02:23:37.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.545+0000 7f742cc00640 1 -- 172.21.15.2:0/266851709 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7424013860 con 0x7f74300b0e30 2024-08-17T02:23:37.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.546+0000 7f742cc00640 1 --2- 172.21.15.2:0/266851709 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7410065150 0x7f7410067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:37.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.546+0000 7f742cc00640 1 -- 172.21.15.2:0/266851709 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7424082690 con 0x7f74300b0e30 2024-08-17T02:23:37.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.547+0000 7f7434e00640 1 --2- 172.21.15.2:0/266851709 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7410065150 0x7f7410067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:37.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.547+0000 7f7434e00640 1 --2- 172.21.15.2:0/266851709 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7410065150 0x7f7410067600 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f74300c8120 tx=0x7f741c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:37.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.550+0000 7f742cc00640 1 -- 172.21.15.2:0/266851709 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7424050800 con 0x7f74300b0e30 2024-08-17T02:23:37.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.732+0000 7f7436c00640 1 -- 172.21.15.2:0/266851709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74300c27f0 con 0x7f74300b0e30 2024-08-17T02:23:37.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.733+0000 7f742cc00640 1 -- 172.21.15.2:0/266851709 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f7424053e20 con 0x7f74300b0e30 2024-08-17T02:23:37.733 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:37.733 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:23:32.955197+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:29.708835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:30.361908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:37.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.735+0000 7f7436c00640 1 -- 172.21.15.2:0/266851709 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7410065150 msgr2=0x7f7410067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:37.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.735+0000 7f7436c00640 1 --2- 172.21.15.2:0/266851709 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7410065150 0x7f7410067600 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f74300c8120 tx=0x7f741c009040 comp rx=0 tx=0).stop 2024-08-17T02:23:37.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.735+0000 7f7436c00640 1 -- 172.21.15.2:0/266851709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74300b0e30 msgr2=0x7f74300c1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:37.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.735+0000 7f7436c00640 1 --2- 172.21.15.2:0/266851709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74300b0e30 0x7f74300c1720 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f742400ea20 tx=0x7f74240090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.735+0000 7f7436c00640 1 -- 172.21.15.2:0/266851709 shutdown_connections 2024-08-17T02:23:37.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.735+0000 7f7436c00640 1 --2- 172.21.15.2:0/266851709 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f743015a590 0x7f74300c36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.735+0000 7f7436c00640 1 --2- 172.21.15.2:0/266851709 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7410065150 0x7f7410067600 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.735+0000 7f7436c00640 1 --2- 172.21.15.2:0/266851709 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7430156f90 0x7f7430139400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.735+0000 7f7436c00640 1 --2- 172.21.15.2:0/266851709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74300b0e30 0x7f74300c1720 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.735+0000 7f7436c00640 1 -- 172.21.15.2:0/266851709 >> 172.21.15.2:0/266851709 conn(0x7f7430062af0 msgr2=0x7f743013f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:37.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.735+0000 7f7436c00640 1 -- 172.21.15.2:0/266851709 shutdown_connections 2024-08-17T02:23:37.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:37.735+0000 7f7436c00640 1 -- 172.21.15.2:0/266851709 wait complete. 2024-08-17T02:23:37.751 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-17T02:23:37.752 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-17T02:23:37.752 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-17T02:23:37.752 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-17T02:23:37.753 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-17T02:23:37.753 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-17T02:23:37.754 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-17T02:23:37.754 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-17T02:23:38.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.021+0000 7f5e57200640 1 Processor -- start 2024-08-17T02:23:38.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.021+0000 7f5e57200640 1 -- start start 2024-08-17T02:23:38.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.023+0000 7f5e57200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e58158a00 0x7f5e58158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.023+0000 7f5e57200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5e580cb190 0x7f5e580cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.023+0000 7f5e57200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f5e5806e590 0x7f5e5806e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.023+0000 7f5e57200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e5806ef10 con 0x7f5e580cb190 2024-08-17T02:23:38.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.023+0000 7f5e57200640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e580cbc50 con 0x7f5e5806e590 2024-08-17T02:23:38.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.023+0000 7f5e57200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e580cbf30 con 0x7f5e58158a00 2024-08-17T02:23:38.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.024+0000 7f06fb200640 1 Processor -- start 2024-08-17T02:23:38.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.025+0000 7f06fb200640 1 -- start start 2024-08-17T02:23:38.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.027+0000 7f06fb200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f06fc1588d0 0x7f06fc0ca800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.027+0000 7f06fb200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f06fc0cf900 0x7f06fc0cad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.027+0000 7f06fb200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06fc0af600 con 0x7f06fc158ca0 2024-08-17T02:23:38.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.024+0000 7f5e55e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e58158a00 0x7f5e58158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.024+0000 7f5e55e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e58158a00 0x7f5e58158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47052/0 (socket says 172.21.15.2:47052) 2024-08-17T02:23:38.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.027+0000 7f06fb200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06fc0cb280 con 0x7f06fc1588d0 2024-08-17T02:23:38.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.024+0000 7f5e55e00640 1 -- 172.21.15.2:0/91290611 learned_addr learned my addr 172.21.15.2:0/91290611 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.024+0000 7f5e56800640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f5e5806e590 0x7f5e5806e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.024+0000 7f5e4d400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5e580cb190 0x7f5e580cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.025+0000 7f5e4d400640 1 -- 172.21.15.2:0/91290611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e58158a00 msgr2=0x7f5e58158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.025+0000 7f5e4d400640 1 --2- 172.21.15.2:0/91290611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e58158a00 0x7f5e58158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.025+0000 7f5e4d400640 1 -- 172.21.15.2:0/91290611 >> v2:172.21.15.145:3300/0 conn(0x7f5e5806e590 msgr2=0x7f5e5806e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.025+0000 7f5e4d400640 1 --2- 172.21.15.2:0/91290611 >> v2:172.21.15.145:3300/0 conn(0x7f5e5806e590 0x7f5e5806e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.025+0000 7f5e4d400640 1 -- 172.21.15.2:0/91290611 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e580cc210 con 0x7f5e580cb190 2024-08-17T02:23:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.027+0000 7f06fb200640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06fc0afb60 con 0x7f06fc0cf900 2024-08-17T02:23:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.028+0000 7f06f9e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f06fc1588d0 0x7f06fc0ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.028+0000 7f06f3e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f06fc158ca0 0x7f06fc0cf1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36014/0 (socket says 172.21.15.2:36014) 2024-08-17T02:23:38.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.028+0000 7f5e4d400640 1 --2- 172.21.15.2:0/91290611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e580cb190 0x7f5e580cb5c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5e580d0bd0 tx=0x7f5e480119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1f8fcfddb95c60 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.028+0000 7f06f3e00640 1 -- 172.21.15.2:0/1232961968 learned_addr learned my addr 172.21.15.2:0/1232961968 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:38.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.029+0000 7f5e55400640 1 -- 172.21.15.2:0/91290611 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4803bc80 con 0x7f5e580cb190 2024-08-17T02:23:38.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.030+0000 7f5e55400640 1 -- 172.21.15.2:0/91290611 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4803bde0 con 0x7f5e580cb190 2024-08-17T02:23:38.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.029+0000 7f06f9400640 1 -- 172.21.15.2:0/1232961968 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1632029485 0 0) 0x7f06fc0af600 con 0x7f06fc158ca0 2024-08-17T02:23:38.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.030+0000 7f06f9400640 1 -- 172.21.15.2:0/1232961968 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06e00034e0 con 0x7f06fc158ca0 2024-08-17T02:23:38.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.030+0000 7f5e55400640 1 -- 172.21.15.2:0/91290611 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4803bc80 con 0x7f5e580cb190 2024-08-17T02:23:38.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.031+0000 7f7286000640 1 Processor -- start 2024-08-17T02:23:38.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.031+0000 7f7286000640 1 -- start start 2024-08-17T02:23:38.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.032+0000 7f5e57200640 1 -- 172.21.15.2:0/91290611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e580cb190 msgr2=0x7f5e580cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.032+0000 7f5e57200640 1 --2- 172.21.15.2:0/91290611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e580cb190 0x7f5e580cb5c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5e580d0bd0 tx=0x7f5e480119b0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.032+0000 7f5e57200640 1 -- 172.21.15.2:0/91290611 shutdown_connections 2024-08-17T02:23:38.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.032+0000 7f5e57200640 1 --2- 172.21.15.2:0/91290611 >> v2:172.21.15.145:3300/0 conn(0x7f5e5806e590 0x7f5e5806e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.032+0000 7f5e57200640 1 --2- 172.21.15.2:0/91290611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e580cb190 0x7f5e580cb5c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.032+0000 7f5e57200640 1 --2- 172.21.15.2:0/91290611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e58158a00 0x7f5e58158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.032+0000 7f5e57200640 1 -- 172.21.15.2:0/91290611 >> 172.21.15.2:0/91290611 conn(0x7f5e580cfb80 msgr2=0x7f5e580cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.032+0000 7f5e57200640 1 -- 172.21.15.2:0/91290611 shutdown_connections 2024-08-17T02:23:38.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.032+0000 7f5e57200640 1 -- 172.21.15.2:0/91290611 wait complete. 2024-08-17T02:23:38.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.031+0000 7f06f9e00640 1 -- 172.21.15.2:0/1232961968 >> v2:172.21.15.145:3300/0 conn(0x7f06fc0cf900 msgr2=0x7f06fc0cad40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:23:38.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.031+0000 7f06f9e00640 1 --2- 172.21.15.2:0/1232961968 >> v2:172.21.15.145:3300/0 conn(0x7f06fc0cf900 0x7f06fc0cad40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.031+0000 7f06f9e00640 1 -- 172.21.15.2:0/1232961968 >> v1:172.21.15.2:6789/0 conn(0x7f06fc158ca0 legacy=0x7f06fc0cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.031+0000 7f06f9e00640 1 -- 172.21.15.2:0/1232961968 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc0d04e0 con 0x7f06fc1588d0 2024-08-17T02:23:38.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.033+0000 7f7286000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72780e6c70 0x7f72780e7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.033+0000 7f7286000640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7278006880 0x7f727804fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.033+0000 7f7286000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72780503c0 con 0x7f7278033860 2024-08-17T02:23:38.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.033+0000 7f7286000640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7278007850 con 0x7f7278006880 2024-08-17T02:23:38.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.033+0000 7f7286000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7278006fb0 con 0x7f72780e6c70 2024-08-17T02:23:38.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.033+0000 7f727fe00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7278006880 0x7f727804fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.034+0000 7f7284c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72780e6c70 0x7f72780e7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.034+0000 7f7284c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72780e6c70 0x7f72780e7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47060/0 (socket says 172.21.15.2:47060) 2024-08-17T02:23:38.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.034+0000 7f7284c00640 1 -- 172.21.15.2:0/2915790802 learned_addr learned my addr 172.21.15.2:0/2915790802 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.034+0000 7f5e57200640 1 Processor -- start 2024-08-17T02:23:38.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.034+0000 7f7284c00640 1 -- 172.21.15.2:0/2915790802 >> v2:172.21.15.145:3300/0 conn(0x7f7278006880 msgr2=0x7f727804fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.034+0000 7f7284c00640 1 --2- 172.21.15.2:0/2915790802 >> v2:172.21.15.145:3300/0 conn(0x7f7278006880 0x7f727804fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.034+0000 7f7284c00640 1 -- 172.21.15.2:0/2915790802 >> v1:172.21.15.2:6789/0 conn(0x7f7278033860 legacy=0x7f7278033cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.034+0000 7f7284c00640 1 -- 172.21.15.2:0/2915790802 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7278007290 con 0x7f72780e6c70 2024-08-17T02:23:38.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.035+0000 7f5e57200640 1 -- start start 2024-08-17T02:23:38.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.035+0000 7f06f9e00640 1 --2- 172.21.15.2:0/1232961968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06fc1588d0 0x7f06fc0ca800 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0cb8d0 tx=0x7f06e40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c6c0230dc6cc92 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.036+0000 7fd02d400640 1 Processor -- start 2024-08-17T02:23:38.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.036+0000 7f06f9400640 1 -- 172.21.15.2:0/1232961968 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e402add0 con 0x7f06fc1588d0 2024-08-17T02:23:38.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.036+0000 7fd02d400640 1 -- start start 2024-08-17T02:23:38.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.036+0000 7f06f9400640 1 -- 172.21.15.2:0/1232961968 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e4032440 con 0x7f06fc1588d0 2024-08-17T02:23:38.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.036+0000 7f7284c00640 1 --2- 172.21.15.2:0/2915790802 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72780e6c70 0x7f72780e7040 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7280064f60 tx=0x7f7280064990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12889cc143b7bcf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.036+0000 7f06f9400640 1 -- 172.21.15.2:0/1232961968 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4032800 con 0x7f06fc1588d0 2024-08-17T02:23:38.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.036+0000 7f727f400640 1 -- 172.21.15.2:0/2915790802 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72800a1e00 con 0x7f72780e6c70 2024-08-17T02:23:38.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.036+0000 7f727f400640 1 -- 172.21.15.2:0/2915790802 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72800a93f0 con 0x7f72780e6c70 2024-08-17T02:23:38.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.037+0000 7f727f400640 1 -- 172.21.15.2:0/2915790802 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72800a9830 con 0x7f72780e6c70 2024-08-17T02:23:38.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.037+0000 7f9dd2000640 1 Processor -- start 2024-08-17T02:23:38.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.037+0000 7f5e57200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e5806e590 0x7f5e58150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.037+0000 7f5e57200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e580cb190 0x7f5e5806cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.037+0000 7f5e57200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e58158a00 0x7f5e581569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.037+0000 7f5e57200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5806d7b0 con 0x7f5e580cb190 2024-08-17T02:23:38.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.037+0000 7f5e57200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5806da90 con 0x7f5e58158a00 2024-08-17T02:23:38.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.037+0000 7f5e57200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5806dd70 con 0x7f5e5806e590 2024-08-17T02:23:38.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.037+0000 7f9dd2000640 1 -- start start 2024-08-17T02:23:38.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.038+0000 7f7286000640 1 -- 172.21.15.2:0/2915790802 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72780e6c70 msgr2=0x7f72780e7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.038+0000 7f7286000640 1 --2- 172.21.15.2:0/2915790802 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72780e6c70 0x7f72780e7040 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7280064f60 tx=0x7f7280064990 comp rx=0 tx=0).stop 2024-08-17T02:23:38.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.038+0000 7fd02d400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd02815c200 0x7fd0280a93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.038+0000 7f7286000640 1 -- 172.21.15.2:0/2915790802 shutdown_connections 2024-08-17T02:23:38.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.038+0000 7f7286000640 1 --2- 172.21.15.2:0/2915790802 >> v2:172.21.15.145:3300/0 conn(0x7f7278006880 0x7f727804fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.038+0000 7f7286000640 1 --2- 172.21.15.2:0/2915790802 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72780e6c70 0x7f72780e7040 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.038+0000 7f7286000640 1 -- 172.21.15.2:0/2915790802 >> 172.21.15.2:0/2915790802 conn(0x7f7278054b90 msgr2=0x7f7278054f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.038+0000 7fd02d400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd0280a98f0 0x7fd028158e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.038+0000 7f06fb200640 1 -- 172.21.15.2:0/1232961968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06fc1588d0 msgr2=0x7f06fc0ca800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.038+0000 7f06fb200640 1 --2- 172.21.15.2:0/1232961968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06fc1588d0 0x7f06fc0ca800 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0cb8d0 tx=0x7f06e40090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.038+0000 7f5e55e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e5806e590 0x7f5e58150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.038+0000 7f5e55e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e5806e590 0x7f5e58150fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47064/0 (socket says 172.21.15.2:47064) 2024-08-17T02:23:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.038+0000 7f5e55e00640 1 -- 172.21.15.2:0/3779592340 learned_addr learned my addr 172.21.15.2:0/3779592340 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.038+0000 7f5e56800640 1 --2- 172.21.15.2:0/3779592340 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e58158a00 0x7f5e581569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.038+0000 7f5e4d400640 1 --2- 172.21.15.2:0/3779592340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e580cb190 0x7f5e5806cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.038+0000 7f7286000640 1 -- 172.21.15.2:0/2915790802 shutdown_connections 2024-08-17T02:23:38.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.038+0000 7fd027200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd0280a98f0 0x7fd028158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.038+0000 7fd026800640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fd028158aa0 0x7fd02806d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:56328/0 (socket says 172.21.15.2:56328) 2024-08-17T02:23:38.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.039+0000 7fd027200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd0280a98f0 0x7fd028158e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:47314/0 (socket says 172.21.15.2:47314) 2024-08-17T02:23:38.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.039+0000 7f06fb200640 1 -- 172.21.15.2:0/1232961968 shutdown_connections 2024-08-17T02:23:38.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.039+0000 7f06fb200640 1 --2- 172.21.15.2:0/1232961968 >> v2:172.21.15.145:3300/0 conn(0x7f06fc0cf900 0x7f06fc0cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.039+0000 7f06fb200640 1 --2- 172.21.15.2:0/1232961968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06fc1588d0 0x7f06fc0ca800 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.039+0000 7f06fb200640 1 -- 172.21.15.2:0/1232961968 >> 172.21.15.2:0/1232961968 conn(0x7f06fc087a80 msgr2=0x7f06fc06e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.038+0000 7f7286000640 1 -- 172.21.15.2:0/2915790802 wait complete. 2024-08-17T02:23:38.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.039+0000 7f06fb200640 1 -- 172.21.15.2:0/1232961968 shutdown_connections 2024-08-17T02:23:38.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.039+0000 7f5e55e00640 1 -- 172.21.15.2:0/3779592340 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e58158a00 msgr2=0x7f5e581569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.039+0000 7f5e55e00640 1 --2- 172.21.15.2:0/3779592340 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e58158a00 0x7f5e581569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.039+0000 7f5e55e00640 1 -- 172.21.15.2:0/3779592340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e580cb190 msgr2=0x7f5e5806cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.039+0000 7f5e55e00640 1 --2- 172.21.15.2:0/3779592340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e580cb190 0x7f5e5806cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.039+0000 7fd026800640 1 -- 172.21.15.2:0/3827466286 learned_addr learned my addr 172.21.15.2:0/3827466286 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:38.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.039+0000 7fd025e00640 1 --2- 172.21.15.2:0/3827466286 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd02815c200 0x7fd0280a93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.039+0000 7fd02d400640 1 -- 172.21.15.2:0/3827466286 --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0280a9d70 con 0x7fd028158aa0 2024-08-17T02:23:38.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.039+0000 7fd02d400640 1 -- 172.21.15.2:0/3827466286 --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0280ab480 con 0x7fd0280a98f0 2024-08-17T02:23:38.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.039+0000 7fd02d400640 1 -- 172.21.15.2:0/3827466286 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd02815a4c0 con 0x7fd02815c200 2024-08-17T02:23:38.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.040+0000 7fd025400640 1 -- 172.21.15.2:0/3827466286 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957637206 0 0) 0x7fd018001110 con 0x7fd028158aa0 2024-08-17T02:23:38.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.039+0000 7f5e55e00640 1 -- 172.21.15.2:0/3779592340 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e48011c30 con 0x7f5e5806e590 2024-08-17T02:23:38.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.039+0000 7f5e4d400640 1 --2- 172.21.15.2:0/3779592340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e580cb190 0x7f5e5806cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:38.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.040+0000 7f5e56800640 1 --2- 172.21.15.2:0/3779592340 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e58158a00 0x7f5e581569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:38.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.040+0000 7f5e55e00640 1 --2- 172.21.15.2:0/3779592340 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e5806e590 0x7f5e58150fc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000ea20 tx=0x7f5e400091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.040+0000 7fd025400640 1 -- 172.21.15.2:0/3827466286 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd00c0034e0 con 0x7fd028158aa0 2024-08-17T02:23:38.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.040+0000 7fd025e00640 1 -- 172.21.15.2:0/3827466286 >> v2:172.21.15.145:3300/0 conn(0x7fd0280a98f0 msgr2=0x7fd028158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.040+0000 7fd025e00640 1 --2- 172.21.15.2:0/3827466286 >> v2:172.21.15.145:3300/0 conn(0x7fd0280a98f0 0x7fd028158e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.040+0000 7fd025e00640 1 -- 172.21.15.2:0/3827466286 >> v1:172.21.15.145:6789/0 conn(0x7fd028158aa0 legacy=0x7fd02806d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.040+0000 7fd025e00640 1 -- 172.21.15.2:0/3827466286 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd02815ad60 con 0x7fd02815c200 2024-08-17T02:23:38.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.040+0000 7fd027200640 1 --2- 172.21.15.2:0/3827466286 >> v2:172.21.15.145:3300/0 conn(0x7fd0280a98f0 0x7fd028158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:38.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.041+0000 7f7286000640 1 Processor -- start 2024-08-17T02:23:38.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.041+0000 7f7286000640 1 -- start start 2024-08-17T02:23:38.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.039+0000 7f06fb200640 1 -- 172.21.15.2:0/1232961968 wait complete. 2024-08-17T02:23:38.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.042+0000 7f9dd2000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9dc40e0240 0x7f9dc40eafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.042+0000 7f9dd2000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc40363e0 con 0x7f9dc4051da0 2024-08-17T02:23:38.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.042+0000 7f9dd2000640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc4054b10 con 0x7f9dc4052170 2024-08-17T02:23:38.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.042+0000 7f9dd2000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc40525f0 con 0x7f9dc40e0240 2024-08-17T02:23:38.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.041+0000 7f5e4e000640 1 -- 172.21.15.2:0/3779592340 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4000c940 con 0x7f5e5806e590 2024-08-17T02:23:38.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.041+0000 7f06fb200640 1 Processor -- start 2024-08-17T02:23:38.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.042+0000 7f9dd0c00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9dc4051da0 0x7f9dc4035960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36032/0 (socket says 172.21.15.2:36032) 2024-08-17T02:23:38.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.042+0000 7f9dd0c00640 1 -- 172.21.15.2:0/3675957312 learned_addr learned my addr 172.21.15.2:0/3675957312 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:38.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.042+0000 7f5e57200640 1 -- 172.21.15.2:0/3779592340 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e5806e050 con 0x7f5e5806e590 2024-08-17T02:23:38.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.042+0000 7f5e57200640 1 -- 172.21.15.2:0/3779592340 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e58155190 con 0x7f5e5806e590 2024-08-17T02:23:38.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.042+0000 7f5e4e000640 1 -- 172.21.15.2:0/3779592340 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4000caa0 con 0x7f5e5806e590 2024-08-17T02:23:38.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.042+0000 7f5e4e000640 1 -- 172.21.15.2:0/3779592340 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4000c940 con 0x7f5e5806e590 2024-08-17T02:23:38.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.042+0000 7f06fb200640 1 -- start start 2024-08-17T02:23:38.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.043+0000 7f9dd1600640 1 --2- 172.21.15.2:0/3675957312 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9dc40e0240 0x7f9dc40eafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.043+0000 7fd025e00640 1 --2- 172.21.15.2:0/3827466286 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd02815c200 0x7fd0280a93b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd010009850 tx=0x7fd0100090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87d055565de603b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.043+0000 7fd025400640 1 -- 172.21.15.2:0/3827466286 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01002ad90 con 0x7fd02815c200 2024-08-17T02:23:38.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.043+0000 7fd025400640 1 -- 172.21.15.2:0/3827466286 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd010032440 con 0x7fd02815c200 2024-08-17T02:23:38.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.043+0000 7fef29200640 1 Processor -- start 2024-08-17T02:23:38.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.043+0000 7f06fb200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06fc0cf900 0x7f06fc154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.044+0000 7f06fb200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06fc1588d0 0x7f06fc0b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.044+0000 7f06fb200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06fc158ca0 0x7f06fc0cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.044+0000 7fd025400640 1 -- 172.21.15.2:0/3827466286 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd010032800 con 0x7fd02815c200 2024-08-17T02:23:38.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.044+0000 7fef29200640 1 -- start start 2024-08-17T02:23:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.044+0000 7f9dd1600640 1 -- 172.21.15.2:0/3675957312 >> v1:172.21.15.145:6789/0 conn(0x7f9dc4052170 legacy=0x7f9dc40dfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.044+0000 7f9dd1600640 1 -- 172.21.15.2:0/3675957312 >> v1:172.21.15.2:6789/0 conn(0x7f9dc4051da0 legacy=0x7f9dc4035960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.044+0000 7f06fb200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc154aa0 con 0x7f06fc1588d0 2024-08-17T02:23:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.044+0000 7f06fb200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc0b3dc0 con 0x7f06fc158ca0 2024-08-17T02:23:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.044+0000 7f06fb200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc0b40a0 con 0x7f06fc0cf900 2024-08-17T02:23:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.044+0000 7f06f9e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06fc0cf900 0x7f06fc154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.044+0000 7f9dd1600640 1 -- 172.21.15.2:0/3675957312 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc4009b40 con 0x7f9dc40e0240 2024-08-17T02:23:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.045+0000 7f7286000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7278006880 0x7f72780ecf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.044+0000 7f9dcb400640 1 -- 172.21.15.2:0/3675957312 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3676224809 0 0) 0x7f9dc40363e0 con 0x7f9dc4051da0 2024-08-17T02:23:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.044+0000 7f06fa800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06fc158ca0 0x7f06fc0cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.045+0000 7f06f3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06fc1588d0 0x7f06fc0b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.045+0000 7f7286000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7278033860 0x7f72780d7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.045+0000 7f7286000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72780e6c70 0x7f72780f9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.045+0000 7f7286000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727804cd00 con 0x7f7278006880 2024-08-17T02:23:38.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.045+0000 7f7286000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72780faee0 con 0x7f72780e6c70 2024-08-17T02:23:38.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.045+0000 7f7286000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7278038d00 con 0x7f7278033860 2024-08-17T02:23:38.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.045+0000 7f727fe00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7278033860 0x7f72780d7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.045+0000 7f727fe00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7278033860 0x7f72780d7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47100/0 (socket says 172.21.15.2:47100) 2024-08-17T02:23:38.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.045+0000 7f727fe00640 1 -- 172.21.15.2:0/3908527239 learned_addr learned my addr 172.21.15.2:0/3908527239 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.046+0000 7f9dd1600640 1 --2- 172.21.15.2:0/3675957312 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9dc40e0240 0x7f9dc40eafc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc04c0c0 tx=0x7f9dcc064990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f10448025c19e195 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.045+0000 7f7284c00640 1 --2- 172.21.15.2:0/3908527239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7278006880 0x7f72780ecf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.046+0000 7fd02d400640 1 -- 172.21.15.2:0/3827466286 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd02815c200 msgr2=0x7fd0280a93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.046+0000 7fd02d400640 1 --2- 172.21.15.2:0/3827466286 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd02815c200 0x7fd0280a93b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd010009850 tx=0x7fd0100090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.046+0000 7fef29200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fef241589e0 0x7fef24158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.045+0000 7f06f9e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06fc0cf900 0x7f06fc154560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47090/0 (socket says 172.21.15.2:47090) 2024-08-17T02:23:38.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.045+0000 7f06f9e00640 1 -- 172.21.15.2:0/658924517 learned_addr learned my addr 172.21.15.2:0/658924517 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.046+0000 7f7285600640 1 --2- 172.21.15.2:0/3908527239 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72780e6c70 0x7f72780f9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.046+0000 7fef29200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef240af9a0 con 0x7fef240ce140 2024-08-17T02:23:38.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.046+0000 7fef29200640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef240ce740 con 0x7fef240ca9c0 2024-08-17T02:23:38.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.046+0000 7fef29200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef240af810 con 0x7fef241589e0 2024-08-17T02:23:38.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.046+0000 7f9dcb400640 1 -- 172.21.15.2:0/3675957312 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc0a1c00 con 0x7f9dc40e0240 2024-08-17T02:23:38.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.046+0000 7fd02d400640 1 -- 172.21.15.2:0/3827466286 shutdown_connections 2024-08-17T02:23:38.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.046+0000 7fd02d400640 1 --2- 172.21.15.2:0/3827466286 >> v2:172.21.15.145:3300/0 conn(0x7fd0280a98f0 0x7fd028158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.046+0000 7fd02d400640 1 --2- 172.21.15.2:0/3827466286 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd02815c200 0x7fd0280a93b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.046+0000 7fd02d400640 1 -- 172.21.15.2:0/3827466286 >> 172.21.15.2:0/3827466286 conn(0x7fd028066e60 msgr2=0x7fd028067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.047+0000 7f5e57200640 1 -- 172.21.15.2:0/3779592340 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5e30000fd0 con 0x7f5e5806e590 2024-08-17T02:23:38.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.048+0000 7f5e4e000640 1 -- 172.21.15.2:0/3779592340 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5e40013470 con 0x7f5e5806e590 2024-08-17T02:23:38.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.048+0000 7f06f9e00640 1 -- 172.21.15.2:0/658924517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06fc158ca0 msgr2=0x7f06fc0cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.048+0000 7f06f9e00640 1 --2- 172.21.15.2:0/658924517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06fc158ca0 0x7f06fc0cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.048+0000 7f06f9e00640 1 -- 172.21.15.2:0/658924517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06fc1588d0 msgr2=0x7f06fc0b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.048+0000 7f06f9e00640 1 --2- 172.21.15.2:0/658924517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06fc1588d0 0x7f06fc0b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.048+0000 7f06f9e00640 1 -- 172.21.15.2:0/658924517 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e4009390 con 0x7f06fc0cf900 2024-08-17T02:23:38.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.048+0000 7f06fa800640 1 --2- 172.21.15.2:0/658924517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06fc158ca0 0x7f06fc0cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:38.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.048+0000 7f06f9e00640 1 --2- 172.21.15.2:0/658924517 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06fc0cf900 0x7f06fc154560 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009130 tx=0x7f06e4032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.046+0000 7f9dcb400640 1 -- 172.21.15.2:0/3675957312 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dcc0a1d60 con 0x7f9dc40e0240 2024-08-17T02:23:38.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.046+0000 7f9dcb400640 1 -- 172.21.15.2:0/3675957312 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc0a9600 con 0x7f9dc40e0240 2024-08-17T02:23:38.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.047+0000 7f9dd2000640 1 -- 172.21.15.2:0/3675957312 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9dc40e0240 msgr2=0x7f9dc40eafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.047+0000 7f9dd2000640 1 --2- 172.21.15.2:0/3675957312 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9dc40e0240 0x7f9dc40eafc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc04c0c0 tx=0x7f9dcc064990 comp rx=0 tx=0).stop 2024-08-17T02:23:38.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.048+0000 7f9dd2000640 1 -- 172.21.15.2:0/3675957312 shutdown_connections 2024-08-17T02:23:38.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.048+0000 7f9dd2000640 1 --2- 172.21.15.2:0/3675957312 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9dc40e0240 0x7f9dc40eafc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.048+0000 7f9dd2000640 1 -- 172.21.15.2:0/3675957312 >> 172.21.15.2:0/3675957312 conn(0x7f9dc400a800 msgr2=0x7f9dc4056da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.046+0000 7f727fe00640 1 -- 172.21.15.2:0/3908527239 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72780e6c70 msgr2=0x7f72780f9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.046+0000 7f727fe00640 1 --2- 172.21.15.2:0/3908527239 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72780e6c70 0x7f72780f9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.046+0000 7f727fe00640 1 -- 172.21.15.2:0/3908527239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7278006880 msgr2=0x7f72780ecf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.046+0000 7f727fe00640 1 --2- 172.21.15.2:0/3908527239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7278006880 0x7f72780ecf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.046+0000 7f727fe00640 1 -- 172.21.15.2:0/3908527239 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728004c200 con 0x7f7278033860 2024-08-17T02:23:38.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.047+0000 7fd02d400640 1 -- 172.21.15.2:0/3827466286 shutdown_connections 2024-08-17T02:23:38.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.047+0000 7fd02d400640 1 -- 172.21.15.2:0/3827466286 wait complete. 2024-08-17T02:23:38.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.046+0000 7f9048600640 1 Processor -- start 2024-08-17T02:23:38.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.047+0000 7f9048600640 1 -- start start 2024-08-17T02:23:38.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.047+0000 7fef21e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fef241589e0 0x7fef24158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.047+0000 7fef21e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fef241589e0 0x7fef24158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53806/0 (socket says 172.21.15.2:53806) 2024-08-17T02:23:38.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.047+0000 7fef21e00640 1 -- 172.21.15.2:0/3517971784 learned_addr learned my addr 172.21.15.2:0/3517971784 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.048+0000 7fef20a00640 1 -- 172.21.15.2:0/3517971784 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3738563679 0 0) 0x7fef240ce740 con 0x7fef240ca9c0 2024-08-17T02:23:38.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.048+0000 7fef21e00640 1 -- 172.21.15.2:0/3517971784 >> v1:172.21.15.145:6789/0 conn(0x7fef240ca9c0 legacy=0x7fef240cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.049+0000 7fef21e00640 1 -- 172.21.15.2:0/3517971784 >> v1:172.21.15.2:6789/0 conn(0x7fef240ce140 legacy=0x7fef240afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.049+0000 7fef21e00640 1 -- 172.21.15.2:0/3517971784 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef240cea00 con 0x7fef241589e0 2024-08-17T02:23:38.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.049+0000 7f06f1600640 1 -- 172.21.15.2:0/658924517 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4031800 con 0x7f06fc0cf900 2024-08-17T02:23:38.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.049+0000 7f06f1600640 1 -- 172.21.15.2:0/658924517 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e4031980 con 0x7f06fc0cf900 2024-08-17T02:23:38.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.049+0000 7f06f1600640 1 -- 172.21.15.2:0/658924517 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4031d40 con 0x7f06fc0cf900 2024-08-17T02:23:38.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.049+0000 7f06fb200640 1 -- 172.21.15.2:0/658924517 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06fc0b4380 con 0x7f06fc0cf900 2024-08-17T02:23:38.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.049+0000 7f06fb200640 1 -- 172.21.15.2:0/658924517 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06fc0b4940 con 0x7f06fc0cf900 2024-08-17T02:23:38.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.049+0000 7f9048600640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f90400acf10 0x7f90400b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.049+0000 7f9048600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90400c92b0 con 0x7f90400afca0 2024-08-17T02:23:38.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.049+0000 7f9048600640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90400ad480 con 0x7f90401590b0 2024-08-17T02:23:38.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.049+0000 7f9048600640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90400b0980 con 0x7f90400acf10 2024-08-17T02:23:38.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.049+0000 7f9045200640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f90401590b0 0x7f90400c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:56352/0 (socket says 172.21.15.2:56352) 2024-08-17T02:23:38.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.049+0000 7f9045200640 1 -- 172.21.15.2:0/1483253737 learned_addr learned my addr 172.21.15.2:0/1483253737 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:38.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.050+0000 7f9046600640 1 --2- 172.21.15.2:0/1483253737 >> v2:172.21.15.145:3300/0 conn(0x7f90400acf10 0x7f90400b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.049+0000 7f727fe00640 1 --2- 172.21.15.2:0/3908527239 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7278033860 0x7f72780d7c90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f727400e900 tx=0x7f72740090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.050+0000 7f5e4e000640 1 --2- 172.21.15.2:0/3779592340 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5e34065230 0x7f5e340676e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.050+0000 7f5e4e000640 1 -- 172.21.15.2:0/3779592340 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5e40082710 con 0x7f5e5806e590 2024-08-17T02:23:38.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.050+0000 7f7273e00640 1 -- 172.21.15.2:0/3908527239 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727400c8e0 con 0x7f7278033860 2024-08-17T02:23:38.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.050+0000 7f7273e00640 1 -- 172.21.15.2:0/3908527239 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727400ca40 con 0x7f7278033860 2024-08-17T02:23:38.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.050+0000 7f7273e00640 1 -- 172.21.15.2:0/3908527239 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727400cde0 con 0x7f7278033860 2024-08-17T02:23:38.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.050+0000 7f903fe00640 1 -- 172.21.15.2:0/1483253737 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713611918 0 0) 0x7f90400ad480 con 0x7f90401590b0 2024-08-17T02:23:38.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.050+0000 7f06fb200640 1 -- 172.21.15.2:0/658924517 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f06fc070720 con 0x7f06fc0cf900 2024-08-17T02:23:38.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.050+0000 7fef21e00640 1 --2- 172.21.15.2:0/3517971784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef241589e0 0x7fef24158db0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fef14009910 tx=0x7fef140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98b9515efa71c0e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.051+0000 7f7286000640 1 -- 172.21.15.2:0/3908527239 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f727804c6f0 con 0x7f7278033860 2024-08-17T02:23:38.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.051+0000 7f5e4d400640 1 --2- 172.21.15.2:0/3779592340 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5e34065230 0x7f5e340676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.051+0000 7f7286000640 1 -- 172.21.15.2:0/3908527239 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727804c990 con 0x7f7278033860 2024-08-17T02:23:38.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.049+0000 7fd02d400640 1 Processor -- start 2024-08-17T02:23:38.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.051+0000 7f5e4e000640 1 --2- 172.21.15.2:0/3779592340 >> [v2:172.21.15.2:6807/37010,v1:172.21.15.2:6809/37010] conn(0x7f5e3406d3c0 0x7f5e3406f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.051+0000 7f5e4e000640 1 -- 172.21.15.2:0/3779592340 --> [v2:172.21.15.2:6807/37010,v1:172.21.15.2:6809/37010] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5e3406fe80 con 0x7f5e3406d3c0 2024-08-17T02:23:38.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.048+0000 7f9dd2000640 1 -- 172.21.15.2:0/3675957312 shutdown_connections 2024-08-17T02:23:38.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.049+0000 7f9dd2000640 1 -- 172.21.15.2:0/3675957312 wait complete. 2024-08-17T02:23:38.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.051+0000 7fd02d400640 1 -- start start 2024-08-17T02:23:38.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.051+0000 7fef20a00640 1 -- 172.21.15.2:0/3517971784 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1402ae90 con 0x7fef241589e0 2024-08-17T02:23:38.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.051+0000 7f5e4e000640 1 -- 172.21.15.2:0/3779592340 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e40080fd0 con 0x7f5e5806e590 2024-08-17T02:23:38.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.051+0000 7f9dd2000640 1 Processor -- start 2024-08-17T02:23:38.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.052+0000 7f5e4d400640 1 --2- 172.21.15.2:0/3779592340 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5e34065230 0x7f5e340676e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5e48044000 tx=0x7f5e48045000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.052+0000 7fef20a00640 1 -- 172.21.15.2:0/3517971784 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef14032440 con 0x7fef241589e0 2024-08-17T02:23:38.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.052+0000 7fef20a00640 1 -- 172.21.15.2:0/3517971784 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef140327c0 con 0x7fef241589e0 2024-08-17T02:23:38.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.052+0000 7efd6fe00640 1 Processor -- start 2024-08-17T02:23:38.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.052+0000 7efd6fe00640 1 -- start start 2024-08-17T02:23:38.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.052+0000 7f06f1600640 1 -- 172.21.15.2:0/658924517 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f06e4039050 con 0x7f06fc0cf900 2024-08-17T02:23:38.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.053+0000 7f06f1600640 1 --2- 172.21.15.2:0/658924517 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f06d8065220 0x7f06d80676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.053+0000 7f06f1600640 1 -- 172.21.15.2:0/658924517 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f06e40a2cd0 con 0x7f06fc0cf900 2024-08-17T02:23:38.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.053+0000 7f06f1600640 1 --2- 172.21.15.2:0/658924517 >> [v2:172.21.15.2:6800/37012,v1:172.21.15.2:6801/37012] conn(0x7f06d806d430 0x7f06d806f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.053+0000 7f06f1600640 1 -- 172.21.15.2:0/658924517 --> [v2:172.21.15.2:6800/37012,v1:172.21.15.2:6801/37012] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06d806fef0 con 0x7f06d806d430 2024-08-17T02:23:38.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.053+0000 7f06f1600640 1 -- 172.21.15.2:0/658924517 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06e40a7220 con 0x7f06fc0cf900 2024-08-17T02:23:38.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.054+0000 7f06fa800640 1 --2- 172.21.15.2:0/658924517 >> [v2:172.21.15.2:6800/37012,v1:172.21.15.2:6801/37012] conn(0x7f06d806d430 0x7f06d806f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.052+0000 7f7286000640 1 -- 172.21.15.2:0/3908527239 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f72780eaf70 con 0x7f7278033860 2024-08-17T02:23:38.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.053+0000 7f903fe00640 1 -- 172.21.15.2:0/1483253737 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90280034e0 con 0x7f90401590b0 2024-08-17T02:23:38.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.053+0000 7f903fe00640 1 -- 172.21.15.2:0/1483253737 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1118580059 0 0) 0x7f90400c92b0 con 0x7f90400afca0 2024-08-17T02:23:38.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.053+0000 7f903fe00640 1 -- 172.21.15.2:0/1483253737 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90400ad480 con 0x7f90400afca0 2024-08-17T02:23:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.053+0000 7f903fe00640 1 -- 172.21.15.2:0/1483253737 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3643824438 0 0) 0x7f90280034e0 con 0x7f90401590b0 2024-08-17T02:23:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.053+0000 7f903fe00640 1 -- 172.21.15.2:0/1483253737 >> v2:172.21.15.145:3300/0 conn(0x7f90400acf10 msgr2=0x7f90400b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.053+0000 7f903fe00640 1 --2- 172.21.15.2:0/1483253737 >> v2:172.21.15.145:3300/0 conn(0x7f90400acf10 0x7f90400b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.053+0000 7f903fe00640 1 -- 172.21.15.2:0/1483253737 >> v1:172.21.15.2:6789/0 conn(0x7f90400afca0 legacy=0x7f90401589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.053+0000 7f903fe00640 1 -- 172.21.15.2:0/1483253737 --> v1:172.21.15.145:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90400ad760 con 0x7f90401590b0 2024-08-17T02:23:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.053+0000 7f903fe00640 1 -- 172.21.15.2:0/1483253737 <== mon.1 v1:172.21.15.145:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7f9030001470 con 0x7f90401590b0 2024-08-17T02:23:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.053+0000 7f903fe00640 1 -- 172.21.15.2:0/1483253737 >> v1:172.21.15.145:6789/0 conn(0x7f90401590b0 legacy=0x7f90400c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.054+0000 7f903fe00640 1 --2- 172.21.15.2:0/1483253737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9028004c10 0x7f9028005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.054+0000 7f903fe00640 1 --2- 172.21.15.2:0/1483253737 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9028003720 0x7f9028003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.054+0000 7f903fe00640 1 --2- 172.21.15.2:0/1483253737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9028004120 0x7f902800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.054+0000 7f903fe00640 1 -- 172.21.15.2:0/1483253737 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902800c0a0 con 0x7f9028004120 2024-08-17T02:23:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.054+0000 7f903fe00640 1 -- 172.21.15.2:0/1483253737 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902800c1e0 con 0x7f9028004c10 2024-08-17T02:23:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.054+0000 7f903fe00640 1 -- 172.21.15.2:0/1483253737 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902800c370 con 0x7f9028003720 2024-08-17T02:23:38.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.053+0000 7fef29200640 1 -- 172.21.15.2:0/3517971784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef241589e0 msgr2=0x7fef24158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.053+0000 7fef29200640 1 --2- 172.21.15.2:0/3517971784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef241589e0 0x7fef24158db0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fef14009910 tx=0x7fef140091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.053+0000 7fef29200640 1 -- 172.21.15.2:0/3517971784 shutdown_connections 2024-08-17T02:23:38.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.053+0000 7fef29200640 1 --2- 172.21.15.2:0/3517971784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef241589e0 0x7fef24158db0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.053+0000 7fef29200640 1 -- 172.21.15.2:0/3517971784 >> 172.21.15.2:0/3517971784 conn(0x7fef2406e590 msgr2=0x7fef2406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.054+0000 7fef29200640 1 -- 172.21.15.2:0/3517971784 shutdown_connections 2024-08-17T02:23:38.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.054+0000 7fef29200640 1 -- 172.21.15.2:0/3517971784 wait complete. 2024-08-17T02:23:38.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.053+0000 7f5e56800640 1 --2- 172.21.15.2:0/3779592340 >> [v2:172.21.15.2:6807/37010,v1:172.21.15.2:6809/37010] conn(0x7f5e3406d3c0 0x7f5e3406f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.054+0000 7f9045200640 1 --2- 172.21.15.2:0/1483253737 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9028003720 0x7f9028003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.055+0000 7efd6fe00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efd701588d0 0x7efd700ca800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.055+0000 7efd6fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efd700cf900 0x7efd700cad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.055+0000 7efd6fe00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd700af600 con 0x7efd70158ca0 2024-08-17T02:23:38.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.055+0000 7efd6fe00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd700cb280 con 0x7efd700cf900 2024-08-17T02:23:38.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.055+0000 7efd6fe00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd700afb60 con 0x7efd701588d0 2024-08-17T02:23:38.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.055+0000 7f06fa800640 1 --2- 172.21.15.2:0/658924517 >> [v2:172.21.15.2:6800/37012,v1:172.21.15.2:6801/37012] conn(0x7f06d806d430 0x7f06d806f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.055+0000 7f9045200640 1 -- 172.21.15.2:0/1483253737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9028004c10 msgr2=0x7f9028005000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:23:38.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.055+0000 7f9045200640 1 --2- 172.21.15.2:0/1483253737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9028004c10 0x7f9028005000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.055+0000 7f9045200640 1 -- 172.21.15.2:0/1483253737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9028004120 msgr2=0x7f902800b9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:23:38.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.055+0000 7f9045200640 1 --2- 172.21.15.2:0/1483253737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9028004120 0x7f902800b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.055+0000 7f9045200640 1 -- 172.21.15.2:0/1483253737 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90280034e0 con 0x7f9028003720 2024-08-17T02:23:38.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.055+0000 7f9046600640 1 -- 172.21.15.2:0/1483253737 reap_dead start 2024-08-17T02:23:38.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.055+0000 7efd6ea00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efd701588d0 0x7efd700ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.055+0000 7efd6ea00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efd701588d0 0x7efd700ca800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47114/0 (socket says 172.21.15.2:47114) 2024-08-17T02:23:38.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.055+0000 7efd6ea00640 1 -- 172.21.15.2:0/588316902 learned_addr learned my addr 172.21.15.2:0/588316902 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.055+0000 7f7273e00640 1 -- 172.21.15.2:0/3908527239 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7274013680 con 0x7f7278033860 2024-08-17T02:23:38.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.055+0000 7f5e56800640 1 --2- 172.21.15.2:0/3779592340 >> [v2:172.21.15.2:6807/37010,v1:172.21.15.2:6809/37010] conn(0x7f5e3406d3c0 0x7f5e3406f7d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.055+0000 7efd6ea00640 1 -- 172.21.15.2:0/588316902 >> v2:172.21.15.2:3300/0 conn(0x7efd700cf900 msgr2=0x7efd700cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.055+0000 7efd6f400640 1 --2- 172.21.15.2:0/588316902 >> v2:172.21.15.2:3300/0 conn(0x7efd700cf900 0x7efd700cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.056+0000 7efd6ea00640 1 --2- 172.21.15.2:0/588316902 >> v2:172.21.15.2:3300/0 conn(0x7efd700cf900 0x7efd700cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.056+0000 7efd6ea00640 1 -- 172.21.15.2:0/588316902 >> v1:172.21.15.2:6789/0 conn(0x7efd70158ca0 legacy=0x7efd700cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.056+0000 7efd6ea00640 1 -- 172.21.15.2:0/588316902 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd700d04e0 con 0x7efd701588d0 2024-08-17T02:23:38.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.054+0000 7fd02d400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0280a98f0 0x7fd0281563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.056+0000 7f06f3e00640 1 --2- 172.21.15.2:0/658924517 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f06d8065220 0x7f06d80676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.056+0000 7efd6f400640 1 --2- 172.21.15.2:0/588316902 >> v2:172.21.15.2:3300/0 conn(0x7efd700cf900 0x7efd700cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:38.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.056+0000 7f5e4e000640 1 -- 172.21.15.2:0/3779592340 <== osd.0 v2:172.21.15.2:6807/37010 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f5e3406fe80 con 0x7f5e3406d3c0 2024-08-17T02:23:38.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.057+0000 7fd02d400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd028158aa0 0x7fd0280affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.057+0000 7f7273e00640 1 --2- 172.21.15.2:0/3908527239 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f72600652a0 0x7f7260067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.057+0000 7efd6ea00640 1 --2- 172.21.15.2:0/588316902 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efd701588d0 0x7efd700ca800 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efd60009910 tx=0x7efd600091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8361b5937a2b4972 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.057+0000 7f06f1600640 1 -- 172.21.15.2:0/658924517 <== osd.1 v2:172.21.15.2:6800/37012 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f06d806fef0 con 0x7f06d806d430 2024-08-17T02:23:38.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.057+0000 7f06f3e00640 1 --2- 172.21.15.2:0/658924517 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f06d8065220 0x7f06d80676d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f06fc15f7c0 tx=0x7f06ec009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.057+0000 7f9dd2000640 1 -- start start 2024-08-17T02:23:38.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.057+0000 7fef29200640 1 Processor -- start 2024-08-17T02:23:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.057+0000 7fd02d400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd02815c200 0x7fd028069d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.057+0000 7fd02d400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0280ab970 con 0x7fd028158aa0 2024-08-17T02:23:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.057+0000 7fd02d400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd028139ad0 con 0x7fd02815c200 2024-08-17T02:23:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.057+0000 7fd02d400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd028151460 con 0x7fd0280a98f0 2024-08-17T02:23:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.057+0000 7fd026800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0280a98f0 0x7fd0281563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.057+0000 7fd026800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0280a98f0 0x7fd0281563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47124/0 (socket says 172.21.15.2:47124) 2024-08-17T02:23:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.057+0000 7fd026800640 1 -- 172.21.15.2:0/432150816 learned_addr learned my addr 172.21.15.2:0/432150816 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.057+0000 7fd025e00640 1 --2- 172.21.15.2:0/432150816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd028158aa0 0x7fd0280affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.057+0000 7fd027200640 1 --2- 172.21.15.2:0/432150816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd02815c200 0x7fd028069d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.057+0000 7f9045200640 1 --2- 172.21.15.2:0/1483253737 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9028003720 0x7f9028003b90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f903000e820 tx=0x7f90400ad370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dbde80626a17a13 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.057+0000 7fef29200640 1 -- start start 2024-08-17T02:23:38.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.058+0000 7efd6d600640 1 -- 172.21.15.2:0/588316902 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6002ad30 con 0x7efd701588d0 2024-08-17T02:23:38.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.058+0000 7efd6d600640 1 -- 172.21.15.2:0/588316902 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6002ae90 con 0x7efd701588d0 2024-08-17T02:23:38.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.058+0000 7efd6d600640 1 -- 172.21.15.2:0/588316902 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60032670 con 0x7efd701588d0 2024-08-17T02:23:38.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.058+0000 7fd026800640 1 -- 172.21.15.2:0/432150816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd02815c200 msgr2=0x7fd028069d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.058+0000 7fd026800640 1 --2- 172.21.15.2:0/432150816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd02815c200 0x7fd028069d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.058+0000 7fd026800640 1 -- 172.21.15.2:0/432150816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd028158aa0 msgr2=0x7fd0280affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.058+0000 7fd026800640 1 --2- 172.21.15.2:0/432150816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd028158aa0 0x7fd0280affa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.058+0000 7fd026800640 1 -- 172.21.15.2:0/432150816 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd020009a20 con 0x7fd0280a98f0 2024-08-17T02:23:38.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.058+0000 7f903fe00640 1 -- 172.21.15.2:0/1483253737 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903002f7e0 con 0x7f9028003720 2024-08-17T02:23:38.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7efd6fe00640 1 -- 172.21.15.2:0/588316902 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efd701588d0 msgr2=0x7efd700ca800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7fd026800640 1 --2- 172.21.15.2:0/432150816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0280a98f0 0x7fd0281563f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd01800c7c0 tx=0x7fd018007bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7f9dd2000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9dc4051da0 0x7f9dc40d6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7f9dd2000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dc4052170 0x7f9dc40507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7f9dd2000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9dc40e0240 0x7f9dc40de350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7f9dd2000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc40f6ea0 con 0x7f9dc4052170 2024-08-17T02:23:38.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7efd6fe00640 1 --2- 172.21.15.2:0/588316902 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efd701588d0 0x7efd700ca800 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efd60009910 tx=0x7efd600091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7f9dd2000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc40f7180 con 0x7f9dc40e0240 2024-08-17T02:23:38.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7f9dd2000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc40f7460 con 0x7f9dc4051da0 2024-08-17T02:23:38.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7efd6fe00640 1 -- 172.21.15.2:0/588316902 shutdown_connections 2024-08-17T02:23:38.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7efd6fe00640 1 --2- 172.21.15.2:0/588316902 >> v2:172.21.15.2:3300/0 conn(0x7efd700cf900 0x7efd700cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7f903fe00640 1 -- 172.21.15.2:0/1483253737 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903002f960 con 0x7f9028003720 2024-08-17T02:23:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7efd6fe00640 1 --2- 172.21.15.2:0/588316902 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efd701588d0 0x7efd700ca800 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7efd6fe00640 1 -- 172.21.15.2:0/588316902 >> 172.21.15.2:0/588316902 conn(0x7efd70087a80 msgr2=0x7efd7006e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7f9dd0c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9dc4051da0 0x7f9dc40d6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7f903fe00640 1 -- 172.21.15.2:0/1483253737 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903002fd20 con 0x7f9028003720 2024-08-17T02:23:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7f9dd0c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9dc4051da0 0x7f9dc40d6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47126/0 (socket says 172.21.15.2:47126) 2024-08-17T02:23:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7efd6fe00640 1 -- 172.21.15.2:0/588316902 shutdown_connections 2024-08-17T02:23:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7fef29200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef240ca9c0 0x7fef240c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7fef29200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef240ce140 0x7fef240b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7fef29200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef241589e0 0x7fef2414f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7f9dd1600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9dc40e0240 0x7f9dc40de350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.060+0000 7f9dd1600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9dc40e0240 0x7f9dc40de350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:47372/0 (socket says 172.21.15.2:47372) 2024-08-17T02:23:38.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.060+0000 7f9dd1600640 1 -- 172.21.15.2:0/2922728891 learned_addr learned my addr 172.21.15.2:0/2922728891 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.060+0000 7efd6fe00640 1 -- 172.21.15.2:0/588316902 wait complete. 2024-08-17T02:23:38.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.060+0000 7f9dcbe00640 1 --2- 172.21.15.2:0/2922728891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dc4052170 0x7f9dc40507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7fef29200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef240aff60 con 0x7fef240ce140 2024-08-17T02:23:38.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7fef29200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef240c92d0 con 0x7fef241589e0 2024-08-17T02:23:38.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.059+0000 7fef29200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef240b2340 con 0x7fef240ca9c0 2024-08-17T02:23:38.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.060+0000 7f9048600640 1 -- 172.21.15.2:0/1483253737 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9028003720 msgr2=0x7f9028003b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.060+0000 7f9048600640 1 --2- 172.21.15.2:0/1483253737 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9028003720 0x7f9028003b90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f903000e820 tx=0x7f90400ad370 comp rx=0 tx=0).stop 2024-08-17T02:23:38.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.060+0000 7f9048600640 1 -- 172.21.15.2:0/1483253737 shutdown_connections 2024-08-17T02:23:38.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.060+0000 7f9048600640 1 --2- 172.21.15.2:0/1483253737 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9028003720 0x7f9028003b90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.060+0000 7f9048600640 1 -- 172.21.15.2:0/1483253737 >> 172.21.15.2:0/1483253737 conn(0x7f9040066e60 msgr2=0x7f9040067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.060+0000 7fef21e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef240ca9c0 0x7fef240c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.060+0000 7f9dd1600640 1 -- 172.21.15.2:0/2922728891 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9dc4051da0 msgr2=0x7f9dc40d6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.060+0000 7fef21e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef240ca9c0 0x7fef240c6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47128/0 (socket says 172.21.15.2:47128) 2024-08-17T02:23:38.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.060+0000 7fef21e00640 1 -- 172.21.15.2:0/22972265 learned_addr learned my addr 172.21.15.2:0/22972265 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.060+0000 7f9dd1600640 1 --2- 172.21.15.2:0/2922728891 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9dc4051da0 0x7f9dc40d6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.060+0000 7f9dd1600640 1 -- 172.21.15.2:0/2922728891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dc4052170 msgr2=0x7f9dc40507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.060+0000 7f9dd1600640 1 --2- 172.21.15.2:0/2922728891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dc4052170 0x7f9dc40507a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.060+0000 7f9dd1600640 1 -- 172.21.15.2:0/2922728891 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc04c200 con 0x7f9dc40e0240 2024-08-17T02:23:38.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.060+0000 7f9dd0c00640 1 --2- 172.21.15.2:0/2922728891 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9dc4051da0 0x7f9dc40d6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:38.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.057+0000 7f7273e00640 1 -- 172.21.15.2:0/3908527239 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f72740824f0 con 0x7f7278033860 2024-08-17T02:23:38.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.057+0000 7f7284c00640 1 --2- 172.21.15.2:0/3908527239 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f72600652a0 0x7f7260067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.060+0000 7fef22800640 1 --2- 172.21.15.2:0/22972265 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef241589e0 0x7fef2414f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.060+0000 7fef21400640 1 --2- 172.21.15.2:0/22972265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef240ce140 0x7fef240b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.060+0000 7fd01e000640 1 -- 172.21.15.2:0/432150816 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01800ce90 con 0x7fd0280a98f0 2024-08-17T02:23:38.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.061+0000 7f7273e00640 1 --2- 172.21.15.2:0/3908527239 >> [v2:172.21.15.2:6824/37033,v1:172.21.15.2:6825/37033] conn(0x7f726006d4b0 0x7f726006f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.060+0000 7fd01e000640 1 -- 172.21.15.2:0/432150816 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd018005870 con 0x7fd0280a98f0 2024-08-17T02:23:38.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.061+0000 7fef21e00640 1 -- 172.21.15.2:0/22972265 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef241589e0 msgr2=0x7fef2414f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.061+0000 7fef21e00640 1 --2- 172.21.15.2:0/22972265 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef241589e0 0x7fef2414f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.061+0000 7fef21e00640 1 -- 172.21.15.2:0/22972265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef240ce140 msgr2=0x7fef240b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.061+0000 7fef21e00640 1 --2- 172.21.15.2:0/22972265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef240ce140 0x7fef240b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.061+0000 7fef21e00640 1 -- 172.21.15.2:0/22972265 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef14009450 con 0x7fef240ca9c0 2024-08-17T02:23:38.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.060+0000 7fd01e000640 1 -- 172.21.15.2:0/432150816 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd018005cb0 con 0x7fd0280a98f0 2024-08-17T02:23:38.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.061+0000 7fd02d400640 1 -- 172.21.15.2:0/432150816 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd010009390 con 0x7fd0280a98f0 2024-08-17T02:23:38.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.061+0000 7fd02d400640 1 -- 172.21.15.2:0/432150816 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0281516b0 con 0x7fd0280a98f0 2024-08-17T02:23:38.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.061+0000 7f9048600640 1 -- 172.21.15.2:0/1483253737 shutdown_connections 2024-08-17T02:23:38.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.062+0000 7f9dd1600640 1 --2- 172.21.15.2:0/2922728891 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9dc40e0240 0x7f9dc40de350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc070d50 tx=0x7f9dcc0ab000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.061+0000 7f7273e00640 1 -- 172.21.15.2:0/3908527239 --> [v2:172.21.15.2:6824/37033,v1:172.21.15.2:6825/37033] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f726006ff70 con 0x7f726006d4b0 2024-08-17T02:23:38.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.062+0000 7f7273e00640 1 -- 172.21.15.2:0/3908527239 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7274084a30 con 0x7f7278033860 2024-08-17T02:23:38.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.062+0000 7f7285600640 1 --2- 172.21.15.2:0/3908527239 >> [v2:172.21.15.2:6824/37033,v1:172.21.15.2:6825/37033] conn(0x7f726006d4b0 0x7f726006f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.062+0000 7fef21e00640 1 --2- 172.21.15.2:0/22972265 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef240ca9c0 0x7fef240c6ea0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fef14035040 tx=0x7fef14032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.062+0000 7fef19600640 1 -- 172.21.15.2:0/22972265 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef14031b30 con 0x7fef240ca9c0 2024-08-17T02:23:38.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.062+0000 7fef19600640 1 -- 172.21.15.2:0/22972265 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1402ae90 con 0x7fef240ca9c0 2024-08-17T02:23:38.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.062+0000 7efd6fe00640 1 Processor -- start 2024-08-17T02:23:38.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.063+0000 7f7285600640 1 --2- 172.21.15.2:0/3908527239 >> [v2:172.21.15.2:6824/37033,v1:172.21.15.2:6825/37033] conn(0x7f726006d4b0 0x7f726006f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.063+0000 7fd02d400640 1 -- 172.21.15.2:0/432150816 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd000000fd0 con 0x7fd0280a98f0 2024-08-17T02:23:38.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.062+0000 7fef19600640 1 -- 172.21.15.2:0/22972265 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1403e450 con 0x7fef240ca9c0 2024-08-17T02:23:38.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.063+0000 7efd6fe00640 1 -- start start 2024-08-17T02:23:38.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.061+0000 7f9048600640 1 -- 172.21.15.2:0/1483253737 wait complete. 2024-08-17T02:23:38.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.063+0000 7f9dbfe00640 1 -- 172.21.15.2:0/2922728891 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc0b8070 con 0x7f9dc40e0240 2024-08-17T02:23:38.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.064+0000 7fd01e000640 1 -- 172.21.15.2:0/432150816 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd018007300 con 0x7fd0280a98f0 2024-08-17T02:23:38.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.064+0000 7f7284c00640 1 --2- 172.21.15.2:0/3908527239 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f72600652a0 0x7f7260067750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f72780070f0 tx=0x7f72800ab000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.064+0000 7fef29200640 1 -- 172.21.15.2:0/22972265 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef240c9590 con 0x7fef240ca9c0 2024-08-17T02:23:38.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.064+0000 7fef29200640 1 -- 172.21.15.2:0/22972265 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef240b2ab0 con 0x7fef240ca9c0 2024-08-17T02:23:38.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.065+0000 7f9dbfe00640 1 -- 172.21.15.2:0/2922728891 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dcc0a8b10 con 0x7f9dc40e0240 2024-08-17T02:23:38.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.065+0000 7f9dbfe00640 1 -- 172.21.15.2:0/2922728891 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc0a8e90 con 0x7f9dc40e0240 2024-08-17T02:23:38.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.064+0000 7efd6fe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd700cf900 0x7efd70154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.064+0000 7efd6fe00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efd701588d0 0x7efd70169310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.065+0000 7efd6fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd70158ca0 0x7efd7016bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.065+0000 7efd6fe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd70168e80 con 0x7efd70158ca0 2024-08-17T02:23:38.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.065+0000 7efd6fe00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7016c870 con 0x7efd700cf900 2024-08-17T02:23:38.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.065+0000 7efd6fe00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7016cb50 con 0x7efd701588d0 2024-08-17T02:23:38.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.065+0000 7f7273e00640 1 -- 172.21.15.2:0/3908527239 <== osd.3 v2:172.21.15.2:6824/37033 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f726006ff70 con 0x7f726006d4b0 2024-08-17T02:23:38.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.066+0000 7fef29200640 1 -- 172.21.15.2:0/22972265 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef24063fb0 con 0x7fef240ca9c0 2024-08-17T02:23:38.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.065+0000 7f9dd2000640 1 -- 172.21.15.2:0/2922728891 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc40f7740 con 0x7f9dc40e0240 2024-08-17T02:23:38.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.066+0000 7f9dd2000640 1 -- 172.21.15.2:0/2922728891 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc40d7440 con 0x7f9dc40e0240 2024-08-17T02:23:38.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.066+0000 7f9048600640 1 Processor -- start 2024-08-17T02:23:38.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.066+0000 7fd01e000640 1 --2- 172.21.15.2:0/432150816 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd004065220 0x7fd0040676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.066+0000 7efd6e000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efd701588d0 0x7efd70169310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.066+0000 7efd6e000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efd701588d0 0x7efd70169310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47140/0 (socket says 172.21.15.2:47140) 2024-08-17T02:23:38.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.066+0000 7efd6e000640 1 -- 172.21.15.2:0/3768537139 learned_addr learned my addr 172.21.15.2:0/3768537139 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.066+0000 7efd6ea00640 1 --2- 172.21.15.2:0/3768537139 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd700cf900 0x7efd70154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.066+0000 7fd01e000640 1 -- 172.21.15.2:0/432150816 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd018081d10 con 0x7fd0280a98f0 2024-08-17T02:23:38.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.066+0000 7fd01e000640 1 --2- 172.21.15.2:0/432150816 >> [v2:172.21.15.145:6800/37421,v1:172.21.15.145:6801/37421] conn(0x7fd00406d240 0x7fd00406f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.066+0000 7fd01e000640 1 -- 172.21.15.2:0/432150816 --> [v2:172.21.15.145:6800/37421,v1:172.21.15.145:6801/37421] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd00406fd00 con 0x7fd00406d240 2024-08-17T02:23:38.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.066+0000 7fd01e000640 1 -- 172.21.15.2:0/432150816 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd01804fe30 con 0x7fd0280a98f0 2024-08-17T02:23:38.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.067+0000 7fd027200640 1 --2- 172.21.15.2:0/432150816 >> [v2:172.21.15.145:6800/37421,v1:172.21.15.145:6801/37421] conn(0x7fd00406d240 0x7fd00406f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.067+0000 7efd6e000640 1 -- 172.21.15.2:0/3768537139 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd700cf900 msgr2=0x7efd70154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.067+0000 7efd6e000640 1 --2- 172.21.15.2:0/3768537139 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd700cf900 0x7efd70154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.067+0000 7efd6e000640 1 -- 172.21.15.2:0/3768537139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd70158ca0 msgr2=0x7efd7016bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.067+0000 7efd6e000640 1 --2- 172.21.15.2:0/3768537139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd70158ca0 0x7efd7016bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.067+0000 7efd6e000640 1 -- 172.21.15.2:0/3768537139 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd60009450 con 0x7efd701588d0 2024-08-17T02:23:38.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.067+0000 7efd6ea00640 1 --2- 172.21.15.2:0/3768537139 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd700cf900 0x7efd70154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:38.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.066+0000 7f9048600640 1 -- start start 2024-08-17T02:23:38.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.068+0000 7efd6e000640 1 --2- 172.21.15.2:0/3768537139 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efd701588d0 0x7efd70169310 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efd5c00b4f0 tx=0x7efd5c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.068+0000 7f9048600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9028003720 0x7f904014fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.068+0000 7f9048600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f904014cb10 0x7f904014e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.068+0000 7fd025e00640 1 --2- 172.21.15.2:0/432150816 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd004065220 0x7fd0040676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.068+0000 7fd027200640 1 --2- 172.21.15.2:0/432150816 >> [v2:172.21.15.145:6800/37421,v1:172.21.15.145:6801/37421] conn(0x7fd00406d240 0x7fd00406f650 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.068+0000 7f9048600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f904014e7f0 0x7f90401646d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.069+0000 7efd66000640 1 -- 172.21.15.2:0/3768537139 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c00f510 con 0x7efd701588d0 2024-08-17T02:23:38.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.069+0000 7f9045c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9028003720 0x7f904014fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.069+0000 7f9045200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f904014cb10 0x7f904014e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.069+0000 7f9048600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904014d350 con 0x7f904014e7f0 2024-08-17T02:23:38.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.069+0000 7f9048600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904014ee20 con 0x7f904014cb10 2024-08-17T02:23:38.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.069+0000 7f9048600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904014f100 con 0x7f9028003720 2024-08-17T02:23:38.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.069+0000 7f9045200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f904014cb10 0x7f904014e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:47396/0 (socket says 172.21.15.2:47396) 2024-08-17T02:23:38.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.069+0000 7f9045200640 1 -- 172.21.15.2:0/2859721165 learned_addr learned my addr 172.21.15.2:0/2859721165 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.069+0000 7f9046600640 1 --2- 172.21.15.2:0/2859721165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f904014e7f0 0x7f90401646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.069+0000 7efd66000640 1 -- 172.21.15.2:0/3768537139 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5c00f690 con 0x7efd701588d0 2024-08-17T02:23:38.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.069+0000 7efd66000640 1 -- 172.21.15.2:0/3768537139 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c00fa90 con 0x7efd701588d0 2024-08-17T02:23:38.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.069+0000 7efd6fe00640 1 -- 172.21.15.2:0/3768537139 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd70168b10 con 0x7efd701588d0 2024-08-17T02:23:38.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.069+0000 7f9045200640 1 -- 172.21.15.2:0/2859721165 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9028003720 msgr2=0x7f904014fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.069+0000 7efd6fe00640 1 -- 172.21.15.2:0/3768537139 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd70169850 con 0x7efd701588d0 2024-08-17T02:23:38.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.069+0000 7f9045200640 1 --2- 172.21.15.2:0/2859721165 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9028003720 0x7f904014fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.070+0000 7f9045200640 1 -- 172.21.15.2:0/2859721165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f904014e7f0 msgr2=0x7f90401646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.069+0000 7f9dd2000640 1 -- 172.21.15.2:0/2922728891 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9da8000fd0 con 0x7f9dc40e0240 2024-08-17T02:23:38.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.070+0000 7f9045200640 1 --2- 172.21.15.2:0/2859721165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f904014e7f0 0x7f90401646d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.070+0000 7f9045200640 1 -- 172.21.15.2:0/2859721165 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904014f3e0 con 0x7f904014cb10 2024-08-17T02:23:38.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.068+0000 7fef19600640 1 -- 172.21.15.2:0/22972265 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fef1403e840 con 0x7fef240ca9c0 2024-08-17T02:23:38.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.070+0000 7fef19600640 1 --2- 172.21.15.2:0/22972265 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fef04065220 0x7fef040676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.070+0000 7fef19600640 1 -- 172.21.15.2:0/22972265 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fef140a2840 con 0x7fef240ca9c0 2024-08-17T02:23:38.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.070+0000 7fef19600640 1 --2- 172.21.15.2:0/22972265 >> [v2:172.21.15.145:6808/37423,v1:172.21.15.145:6809/37423] conn(0x7fef0406d430 0x7fef0406f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.070+0000 7fef19600640 1 -- 172.21.15.2:0/22972265 --> [v2:172.21.15.145:6808/37423,v1:172.21.15.145:6809/37423] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef0406fef0 con 0x7fef0406d430 2024-08-17T02:23:38.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.070+0000 7fef19600640 1 -- 172.21.15.2:0/22972265 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef140a4d40 con 0x7fef240ca9c0 2024-08-17T02:23:38.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.071+0000 7fef21400640 1 --2- 172.21.15.2:0/22972265 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fef04065220 0x7fef040676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.071+0000 7fef22800640 1 --2- 172.21.15.2:0/22972265 >> [v2:172.21.15.145:6808/37423,v1:172.21.15.145:6809/37423] conn(0x7fef0406d430 0x7fef0406f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.071+0000 7fd025e00640 1 --2- 172.21.15.2:0/432150816 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd004065220 0x7fd0040676d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd010034000 tx=0x7fd010032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.072+0000 7f9dbfe00640 1 -- 172.21.15.2:0/2922728891 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9dcc062af0 con 0x7f9dc40e0240 2024-08-17T02:23:38.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.070+0000 7f9046600640 1 --2- 172.21.15.2:0/2859721165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f904014e7f0 0x7f90401646d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:38.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.071+0000 7f9045200640 1 --2- 172.21.15.2:0/2859721165 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f904014cb10 0x7f904014e2b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f903000e880 tx=0x7f9030035000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.072+0000 7fef21400640 1 --2- 172.21.15.2:0/22972265 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fef04065220 0x7fef040676d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fef241530d0 tx=0x7fef10009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.072+0000 7fef22800640 1 --2- 172.21.15.2:0/22972265 >> [v2:172.21.15.145:6808/37423,v1:172.21.15.145:6809/37423] conn(0x7fef0406d430 0x7fef0406f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.072+0000 7fd01e000640 1 -- 172.21.15.2:0/432150816 <== osd.4 v2:172.21.15.145:6800/37421 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fd00406fd00 con 0x7fd00406d240 2024-08-17T02:23:38.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.072+0000 7f903cc00640 1 -- 172.21.15.2:0/2859721165 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030001470 con 0x7f904014cb10 2024-08-17T02:23:38.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.072+0000 7efd6fe00640 1 -- 172.21.15.2:0/3768537139 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efd70168970 con 0x7efd701588d0 2024-08-17T02:23:38.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.072+0000 7efd66000640 1 -- 172.21.15.2:0/3768537139 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efd5c01a400 con 0x7efd701588d0 2024-08-17T02:23:38.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.072+0000 7f9048600640 1 -- 172.21.15.2:0/2859721165 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f904014f6c0 con 0x7f904014cb10 2024-08-17T02:23:38.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.073+0000 7f9048600640 1 -- 172.21.15.2:0/2859721165 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9040164c10 con 0x7f904014cb10 2024-08-17T02:23:38.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.073+0000 7f903cc00640 1 -- 172.21.15.2:0/2859721165 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903002f7e0 con 0x7f904014cb10 2024-08-17T02:23:38.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.073+0000 7f903cc00640 1 -- 172.21.15.2:0/2859721165 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030038890 con 0x7f904014cb10 2024-08-17T02:23:38.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.073+0000 7f9dbfe00640 1 --2- 172.21.15.2:0/2922728891 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9dac0652a0 0x7f9dac067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.074+0000 7f9dbfe00640 1 -- 172.21.15.2:0/2922728891 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9dcc119a00 con 0x7f9dc40e0240 2024-08-17T02:23:38.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.074+0000 7f9048600640 1 -- 172.21.15.2:0/2859721165 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f901c000fd0 con 0x7f904014cb10 2024-08-17T02:23:38.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.074+0000 7efd66000640 1 --2- 172.21.15.2:0/3768537139 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7efd500651d0 0x7efd50067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.074+0000 7efd66000640 1 -- 172.21.15.2:0/3768537139 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efd5c081ee0 con 0x7efd701588d0 2024-08-17T02:23:38.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.074+0000 7f9dbfe00640 1 --2- 172.21.15.2:0/2922728891 >> [v2:172.21.15.2:6815/37013,v1:172.21.15.2:6817/37013] conn(0x7f9dac06d340 0x7f9dac06f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.074+0000 7f9dbfe00640 1 -- 172.21.15.2:0/2922728891 --> [v2:172.21.15.2:6815/37013,v1:172.21.15.2:6817/37013] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9dac06fe00 con 0x7f9dac06d340 2024-08-17T02:23:38.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.074+0000 7f9dbfe00640 1 -- 172.21.15.2:0/2922728891 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9dcc11e220 con 0x7f9dc40e0240 2024-08-17T02:23:38.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.074+0000 7f9dd0c00640 1 --2- 172.21.15.2:0/2922728891 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9dac0652a0 0x7f9dac067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.075+0000 7efd66000640 1 --2- 172.21.15.2:0/3768537139 >> [v2:172.21.15.145:6813/37424,v1:172.21.15.145:6815/37424] conn(0x7efd5006d360 0x7efd5006f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.075+0000 7efd66000640 1 -- 172.21.15.2:0/3768537139 --> [v2:172.21.15.145:6813/37424,v1:172.21.15.145:6815/37424] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd5006fe20 con 0x7efd5006d360 2024-08-17T02:23:38.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.075+0000 7efd66000640 1 -- 172.21.15.2:0/3768537139 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd5c04ff80 con 0x7efd701588d0 2024-08-17T02:23:38.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.075+0000 7f9dcbe00640 1 --2- 172.21.15.2:0/2922728891 >> [v2:172.21.15.2:6815/37013,v1:172.21.15.2:6817/37013] conn(0x7f9dac06d340 0x7f9dac06f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.075+0000 7efd6ea00640 1 --2- 172.21.15.2:0/3768537139 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7efd500651d0 0x7efd50067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.073+0000 7fef19600640 1 -- 172.21.15.2:0/22972265 <== osd.6 v2:172.21.15.145:6808/37423 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fef0406fef0 con 0x7fef0406d430 2024-08-17T02:23:38.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.075+0000 7efd6f400640 1 --2- 172.21.15.2:0/3768537139 >> [v2:172.21.15.145:6813/37424,v1:172.21.15.145:6815/37424] conn(0x7efd5006d360 0x7efd5006f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.076+0000 7efd6f400640 1 --2- 172.21.15.2:0/3768537139 >> [v2:172.21.15.145:6813/37424,v1:172.21.15.145:6815/37424] conn(0x7efd5006d360 0x7efd5006f770 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.076+0000 7efd6ea00640 1 --2- 172.21.15.2:0/3768537139 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7efd500651d0 0x7efd50067680 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efd60034000 tx=0x7efd60032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.076+0000 7f9dcbe00640 1 --2- 172.21.15.2:0/2922728891 >> [v2:172.21.15.2:6815/37013,v1:172.21.15.2:6817/37013] conn(0x7f9dac06d340 0x7f9dac06f750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.077+0000 7f903cc00640 1 -- 172.21.15.2:0/2859721165 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9030035070 con 0x7f904014cb10 2024-08-17T02:23:38.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.077+0000 7efd66000640 1 -- 172.21.15.2:0/3768537139 <== osd.7 v2:172.21.15.145:6813/37424 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7efd5006fe20 con 0x7efd5006d360 2024-08-17T02:23:38.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.077+0000 7f9dbfe00640 1 -- 172.21.15.2:0/2922728891 <== osd.2 v2:172.21.15.2:6815/37013 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f9dac06fe00 con 0x7f9dac06d340 2024-08-17T02:23:38.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.078+0000 7f903cc00640 1 --2- 172.21.15.2:0/2859721165 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f90240651d0 0x7f9024067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.078+0000 7f903cc00640 1 -- 172.21.15.2:0/2859721165 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f90300a2b80 con 0x7f904014cb10 2024-08-17T02:23:38.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.079+0000 7f903cc00640 1 --2- 172.21.15.2:0/2859721165 >> [v2:172.21.15.145:6824/37439,v1:172.21.15.145:6825/37439] conn(0x7f902406d3e0 0x7f902406f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.079+0000 7f903cc00640 1 -- 172.21.15.2:0/2859721165 --> [v2:172.21.15.145:6824/37439,v1:172.21.15.145:6825/37439] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f902406fea0 con 0x7f902406d3e0 2024-08-17T02:23:38.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.079+0000 7f903cc00640 1 -- 172.21.15.2:0/2859721165 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90300a2eb0 con 0x7f904014cb10 2024-08-17T02:23:38.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.079+0000 7f9dd0c00640 1 --2- 172.21.15.2:0/2922728891 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9dac0652a0 0x7f9dac067750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009870 tx=0x7f9dc0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.080+0000 7f9045c00640 1 --2- 172.21.15.2:0/2859721165 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f90240651d0 0x7f9024067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.080+0000 7f9046600640 1 --2- 172.21.15.2:0/2859721165 >> [v2:172.21.15.145:6824/37439,v1:172.21.15.145:6825/37439] conn(0x7f902406d3e0 0x7f902406f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.081+0000 7f9046600640 1 --2- 172.21.15.2:0/2859721165 >> [v2:172.21.15.145:6824/37439,v1:172.21.15.145:6825/37439] conn(0x7f902406d3e0 0x7f902406f7f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.081+0000 7f9045c00640 1 --2- 172.21.15.2:0/2859721165 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f90240651d0 0x7f9024067680 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9038007fd0 tx=0x7f9038009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.082+0000 7f903cc00640 1 -- 172.21.15.2:0/2859721165 <== osd.5 v2:172.21.15.145:6824/37439 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f902406fea0 con 0x7f902406d3e0 2024-08-17T02:23:38.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.086+0000 7f5e57200640 1 -- 172.21.15.2:0/3779592340 --> [v2:172.21.15.2:6807/37010,v1:172.21.15.2:6809/37010] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5e30002ca0 con 0x7f5e3406d3c0 2024-08-17T02:23:38.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.086+0000 7f5e4e000640 1 -- 172.21.15.2:0/3779592340 <== osd.0 v2:172.21.15.2:6807/37010 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5e30002ca0 con 0x7f5e3406d3c0 2024-08-17T02:23:38.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.086+0000 7f06fb200640 1 -- 172.21.15.2:0/658924517 --> [v2:172.21.15.2:6800/37012,v1:172.21.15.2:6801/37012] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f06fc0b41e0 con 0x7f06d806d430 2024-08-17T02:23:38.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.087+0000 7f06f1600640 1 -- 172.21.15.2:0/658924517 <== osd.1 v2:172.21.15.2:6800/37012 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f06fc0b41e0 con 0x7f06d806d430 2024-08-17T02:23:38.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.088+0000 7f06fb200640 1 -- 172.21.15.2:0/658924517 >> [v2:172.21.15.2:6800/37012,v1:172.21.15.2:6801/37012] conn(0x7f06d806d430 msgr2=0x7f06d806f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.088+0000 7f5e57200640 1 -- 172.21.15.2:0/3779592340 >> [v2:172.21.15.2:6807/37010,v1:172.21.15.2:6809/37010] conn(0x7f5e3406d3c0 msgr2=0x7f5e3406f7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.088+0000 7f5e57200640 1 --2- 172.21.15.2:0/3779592340 >> [v2:172.21.15.2:6807/37010,v1:172.21.15.2:6809/37010] conn(0x7f5e3406d3c0 0x7f5e3406f7d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.088+0000 7f06fb200640 1 --2- 172.21.15.2:0/658924517 >> [v2:172.21.15.2:6800/37012,v1:172.21.15.2:6801/37012] conn(0x7f06d806d430 0x7f06d806f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.088+0000 7f5e57200640 1 -- 172.21.15.2:0/3779592340 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5e34065230 msgr2=0x7f5e340676e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.088+0000 7f5e57200640 1 --2- 172.21.15.2:0/3779592340 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5e34065230 0x7f5e340676e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5e48044000 tx=0x7f5e48045000 comp rx=0 tx=0).stop 2024-08-17T02:23:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.088+0000 7f5e57200640 1 -- 172.21.15.2:0/3779592340 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e5806e590 msgr2=0x7f5e58150fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.088+0000 7f5e57200640 1 --2- 172.21.15.2:0/3779592340 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e5806e590 0x7f5e58150fc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000ea20 tx=0x7f5e400091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.088+0000 7f5e56800640 1 -- 172.21.15.2:0/3779592340 reap_dead start 2024-08-17T02:23:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.089+0000 7f5e57200640 1 -- 172.21.15.2:0/3779592340 shutdown_connections 2024-08-17T02:23:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.089+0000 7f5e57200640 1 -- 172.21.15.2:0/3779592340 >> 172.21.15.2:0/3779592340 conn(0x7f5e580cfb80 msgr2=0x7f5e580cde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.088+0000 7f06fb200640 1 -- 172.21.15.2:0/658924517 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f06d8065220 msgr2=0x7f06d80676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.088+0000 7f06fb200640 1 --2- 172.21.15.2:0/658924517 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f06d8065220 0x7f06d80676d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f06fc15f7c0 tx=0x7f06ec009040 comp rx=0 tx=0).stop 2024-08-17T02:23:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.088+0000 7f06fb200640 1 -- 172.21.15.2:0/658924517 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06fc0cf900 msgr2=0x7f06fc154560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.088+0000 7f06fb200640 1 --2- 172.21.15.2:0/658924517 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06fc0cf900 0x7f06fc154560 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009130 tx=0x7f06e4032000 comp rx=0 tx=0).stop 2024-08-17T02:23:38.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.089+0000 7f06fa800640 1 -- 172.21.15.2:0/658924517 reap_dead start 2024-08-17T02:23:38.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.090+0000 7f5e57200640 1 -- 172.21.15.2:0/3779592340 shutdown_connections 2024-08-17T02:23:38.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.090+0000 7f5e57200640 1 -- 172.21.15.2:0/3779592340 wait complete. 2024-08-17T02:23:38.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.091+0000 7f06fb200640 1 -- 172.21.15.2:0/658924517 shutdown_connections 2024-08-17T02:23:38.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.091+0000 7f06fb200640 1 -- 172.21.15.2:0/658924517 >> 172.21.15.2:0/658924517 conn(0x7f06fc087a80 msgr2=0x7f06fc155fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.091+0000 7f7286000640 1 -- 172.21.15.2:0/3908527239 --> [v2:172.21.15.2:6824/37033,v1:172.21.15.2:6825/37033] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7278005250 con 0x7f726006d4b0 2024-08-17T02:23:38.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.092+0000 7f06fb200640 1 -- 172.21.15.2:0/658924517 shutdown_connections 2024-08-17T02:23:38.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.092+0000 7f06fb200640 1 -- 172.21.15.2:0/658924517 wait complete. 2024-08-17T02:23:38.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.092+0000 7f7273e00640 1 -- 172.21.15.2:0/3908527239 <== osd.3 v2:172.21.15.2:6824/37033 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7278005250 con 0x7f726006d4b0 2024-08-17T02:23:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.092+0000 7f7286000640 1 -- 172.21.15.2:0/3908527239 >> [v2:172.21.15.2:6824/37033,v1:172.21.15.2:6825/37033] conn(0x7f726006d4b0 msgr2=0x7f726006f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.092+0000 7f7286000640 1 --2- 172.21.15.2:0/3908527239 >> [v2:172.21.15.2:6824/37033,v1:172.21.15.2:6825/37033] conn(0x7f726006d4b0 0x7f726006f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.096+0000 7f7286000640 1 -- 172.21.15.2:0/3908527239 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f72600652a0 msgr2=0x7f7260067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.096+0000 7f7286000640 1 --2- 172.21.15.2:0/3908527239 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f72600652a0 0x7f7260067750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f72780070f0 tx=0x7f72800ab000 comp rx=0 tx=0).stop 2024-08-17T02:23:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.096+0000 7f7286000640 1 -- 172.21.15.2:0/3908527239 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7278033860 msgr2=0x7f72780d7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.096+0000 7f7286000640 1 --2- 172.21.15.2:0/3908527239 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7278033860 0x7f72780d7c90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f727400e900 tx=0x7f72740090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.096+0000 7f7285600640 1 -- 172.21.15.2:0/3908527239 reap_dead start 2024-08-17T02:23:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.098+0000 7f7286000640 1 -- 172.21.15.2:0/3908527239 shutdown_connections 2024-08-17T02:23:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.098+0000 7f7286000640 1 -- 172.21.15.2:0/3908527239 >> 172.21.15.2:0/3908527239 conn(0x7f7278054b90 msgr2=0x7f7278005db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.098+0000 7f7286000640 1 -- 172.21.15.2:0/3908527239 shutdown_connections 2024-08-17T02:23:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.098+0000 7f7286000640 1 -- 172.21.15.2:0/3908527239 wait complete. 2024-08-17T02:23:38.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.104+0000 7fd02d400640 1 -- 172.21.15.2:0/432150816 --> [v2:172.21.15.145:6800/37421,v1:172.21.15.145:6801/37421] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd000002ca0 con 0x7fd00406d240 2024-08-17T02:23:38.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.104+0000 7fd01e000640 1 -- 172.21.15.2:0/432150816 <== osd.4 v2:172.21.15.145:6800/37421 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd000002ca0 con 0x7fd00406d240 2024-08-17T02:23:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.107+0000 7fd02d400640 1 -- 172.21.15.2:0/432150816 >> [v2:172.21.15.145:6800/37421,v1:172.21.15.145:6801/37421] conn(0x7fd00406d240 msgr2=0x7fd00406f650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.107+0000 7fd02d400640 1 --2- 172.21.15.2:0/432150816 >> [v2:172.21.15.145:6800/37421,v1:172.21.15.145:6801/37421] conn(0x7fd00406d240 0x7fd00406f650 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.108+0000 7fd02d400640 1 -- 172.21.15.2:0/432150816 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd004065220 msgr2=0x7fd0040676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.108+0000 7fef29200640 1 -- 172.21.15.2:0/22972265 --> [v2:172.21.15.145:6808/37423,v1:172.21.15.145:6809/37423] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fef24067620 con 0x7fef0406d430 2024-08-17T02:23:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.108+0000 7fd02d400640 1 --2- 172.21.15.2:0/432150816 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd004065220 0x7fd0040676d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd010034000 tx=0x7fd010032000 comp rx=0 tx=0).stop 2024-08-17T02:23:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.108+0000 7fd02d400640 1 -- 172.21.15.2:0/432150816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0280a98f0 msgr2=0x7fd0281563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.108+0000 7fd02d400640 1 --2- 172.21.15.2:0/432150816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0280a98f0 0x7fd0281563f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd01800c7c0 tx=0x7fd018007bc0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.108+0000 7fd027200640 1 -- 172.21.15.2:0/432150816 reap_dead start 2024-08-17T02:23:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.108+0000 7fd02d400640 1 -- 172.21.15.2:0/432150816 shutdown_connections 2024-08-17T02:23:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.108+0000 7fd02d400640 1 -- 172.21.15.2:0/432150816 >> 172.21.15.2:0/432150816 conn(0x7fd028066e60 msgr2=0x7fd028159b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.107+0000 7efd6fe00640 1 -- 172.21.15.2:0/3768537139 --> [v2:172.21.15.145:6813/37424,v1:172.21.15.145:6815/37424] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efd70070720 con 0x7efd5006d360 2024-08-17T02:23:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.109+0000 7fd02d400640 1 -- 172.21.15.2:0/432150816 shutdown_connections 2024-08-17T02:23:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.109+0000 7fd02d400640 1 -- 172.21.15.2:0/432150816 wait complete. 2024-08-17T02:23:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.109+0000 7fef19600640 1 -- 172.21.15.2:0/22972265 <== osd.6 v2:172.21.15.145:6808/37423 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fef24067620 con 0x7fef0406d430 2024-08-17T02:23:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.109+0000 7efd66000640 1 -- 172.21.15.2:0/3768537139 <== osd.7 v2:172.21.15.145:6813/37424 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efd70070720 con 0x7efd5006d360 2024-08-17T02:23:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.109+0000 7f9dd2000640 1 -- 172.21.15.2:0/2922728891 --> [v2:172.21.15.2:6815/37013,v1:172.21.15.2:6817/37013] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9da8002ca0 con 0x7f9dac06d340 2024-08-17T02:23:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.110+0000 7fef29200640 1 -- 172.21.15.2:0/22972265 >> [v2:172.21.15.145:6808/37423,v1:172.21.15.145:6809/37423] conn(0x7fef0406d430 msgr2=0x7fef0406f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.110+0000 7f9dbfe00640 1 -- 172.21.15.2:0/2922728891 <== osd.2 v2:172.21.15.2:6815/37013 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9da8002ca0 con 0x7f9dac06d340 2024-08-17T02:23:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.110+0000 7efd6fe00640 1 -- 172.21.15.2:0/3768537139 >> [v2:172.21.15.145:6813/37424,v1:172.21.15.145:6815/37424] conn(0x7efd5006d360 msgr2=0x7efd5006f770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.110+0000 7efd6fe00640 1 --2- 172.21.15.2:0/3768537139 >> [v2:172.21.15.145:6813/37424,v1:172.21.15.145:6815/37424] conn(0x7efd5006d360 0x7efd5006f770 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.110+0000 7fef29200640 1 --2- 172.21.15.2:0/22972265 >> [v2:172.21.15.145:6808/37423,v1:172.21.15.145:6809/37423] conn(0x7fef0406d430 0x7fef0406f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.111+0000 7efd6fe00640 1 -- 172.21.15.2:0/3768537139 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7efd500651d0 msgr2=0x7efd50067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.110+0000 7fef29200640 1 -- 172.21.15.2:0/22972265 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fef04065220 msgr2=0x7fef040676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.111+0000 7f9dd2000640 1 -- 172.21.15.2:0/2922728891 >> [v2:172.21.15.2:6815/37013,v1:172.21.15.2:6817/37013] conn(0x7f9dac06d340 msgr2=0x7f9dac06f750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.111+0000 7f9dd2000640 1 --2- 172.21.15.2:0/2922728891 >> [v2:172.21.15.2:6815/37013,v1:172.21.15.2:6817/37013] conn(0x7f9dac06d340 0x7f9dac06f750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.111+0000 7efd6fe00640 1 --2- 172.21.15.2:0/3768537139 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7efd500651d0 0x7efd50067680 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efd60034000 tx=0x7efd60032000 comp rx=0 tx=0).stop 2024-08-17T02:23:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.111+0000 7fef29200640 1 --2- 172.21.15.2:0/22972265 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fef04065220 0x7fef040676d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fef241530d0 tx=0x7fef10009040 comp rx=0 tx=0).stop 2024-08-17T02:23:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.111+0000 7fef29200640 1 -- 172.21.15.2:0/22972265 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef240ca9c0 msgr2=0x7fef240c6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.111+0000 7fef29200640 1 --2- 172.21.15.2:0/22972265 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef240ca9c0 0x7fef240c6ea0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fef14035040 tx=0x7fef14032000 comp rx=0 tx=0).stop 2024-08-17T02:23:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.111+0000 7efd6fe00640 1 -- 172.21.15.2:0/3768537139 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efd701588d0 msgr2=0x7efd70169310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.111+0000 7fef22800640 1 -- 172.21.15.2:0/22972265 reap_dead start 2024-08-17T02:23:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.111+0000 7efd6fe00640 1 --2- 172.21.15.2:0/3768537139 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efd701588d0 0x7efd70169310 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efd5c00b4f0 tx=0x7efd5c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.111+0000 7efd6f400640 1 -- 172.21.15.2:0/3768537139 reap_dead start 2024-08-17T02:23:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.111+0000 7fef29200640 1 -- 172.21.15.2:0/22972265 shutdown_connections 2024-08-17T02:23:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.111+0000 7fef29200640 1 -- 172.21.15.2:0/22972265 >> 172.21.15.2:0/22972265 conn(0x7fef2406e590 msgr2=0x7fef240cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.111+0000 7efd6fe00640 1 -- 172.21.15.2:0/3768537139 shutdown_connections 2024-08-17T02:23:38.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.111+0000 7efd6fe00640 1 -- 172.21.15.2:0/3768537139 >> 172.21.15.2:0/3768537139 conn(0x7efd70087a80 msgr2=0x7efd700cdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.112+0000 7fef29200640 1 -- 172.21.15.2:0/22972265 shutdown_connections 2024-08-17T02:23:38.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.112+0000 7efd6fe00640 1 -- 172.21.15.2:0/3768537139 shutdown_connections 2024-08-17T02:23:38.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.112+0000 7efd6fe00640 1 -- 172.21.15.2:0/3768537139 wait complete. 2024-08-17T02:23:38.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.112+0000 7fef29200640 1 -- 172.21.15.2:0/22972265 wait complete. 2024-08-17T02:23:38.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.112+0000 7f9dd2000640 1 -- 172.21.15.2:0/2922728891 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9dac0652a0 msgr2=0x7f9dac067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.112+0000 7f9dd2000640 1 --2- 172.21.15.2:0/2922728891 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9dac0652a0 0x7f9dac067750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009870 tx=0x7f9dc0009040 comp rx=0 tx=0).stop 2024-08-17T02:23:38.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.112+0000 7f9dd2000640 1 -- 172.21.15.2:0/2922728891 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9dc40e0240 msgr2=0x7f9dc40de350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.112+0000 7f9dd2000640 1 --2- 172.21.15.2:0/2922728891 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9dc40e0240 0x7f9dc40de350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc070d50 tx=0x7f9dcc0ab000 comp rx=0 tx=0).stop 2024-08-17T02:23:38.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.112+0000 7f9dd1600640 1 -- 172.21.15.2:0/2922728891 reap_dead start 2024-08-17T02:23:38.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.112+0000 7f9dd2000640 1 -- 172.21.15.2:0/2922728891 shutdown_connections 2024-08-17T02:23:38.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.112+0000 7f9dd2000640 1 -- 172.21.15.2:0/2922728891 >> 172.21.15.2:0/2922728891 conn(0x7f9dc400a800 msgr2=0x7f9dc40543c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.114+0000 7f9dd2000640 1 -- 172.21.15.2:0/2922728891 shutdown_connections 2024-08-17T02:23:38.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.114+0000 7f9dd2000640 1 -- 172.21.15.2:0/2922728891 wait complete. 2024-08-17T02:23:38.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.115+0000 7f9048600640 1 -- 172.21.15.2:0/2859721165 --> [v2:172.21.15.145:6824/37439,v1:172.21.15.145:6825/37439] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f901c002ca0 con 0x7f902406d3e0 2024-08-17T02:23:38.179 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2024-08-17T02:23:38.179 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:23:38.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.116+0000 7f903cc00640 1 -- 172.21.15.2:0/2859721165 <== osd.5 v2:172.21.15.145:6824/37439 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f901c002ca0 con 0x7f902406d3e0 2024-08-17T02:23:38.180 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2024-08-17T02:23:38.181 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:23:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.116+0000 7f9048600640 1 -- 172.21.15.2:0/2859721165 >> [v2:172.21.15.145:6824/37439,v1:172.21.15.145:6825/37439] conn(0x7f902406d3e0 msgr2=0x7f902406f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.116+0000 7f9048600640 1 --2- 172.21.15.2:0/2859721165 >> [v2:172.21.15.145:6824/37439,v1:172.21.15.145:6825/37439] conn(0x7f902406d3e0 0x7f902406f7f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.117+0000 7f9048600640 1 -- 172.21.15.2:0/2859721165 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f90240651d0 msgr2=0x7f9024067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.117+0000 7f9048600640 1 --2- 172.21.15.2:0/2859721165 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f90240651d0 0x7f9024067680 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9038007fd0 tx=0x7f9038009040 comp rx=0 tx=0).stop 2024-08-17T02:23:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.117+0000 7f9048600640 1 -- 172.21.15.2:0/2859721165 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f904014cb10 msgr2=0x7f904014e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.117+0000 7f9048600640 1 --2- 172.21.15.2:0/2859721165 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f904014cb10 0x7f904014e2b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f903000e880 tx=0x7f9030035000 comp rx=0 tx=0).stop 2024-08-17T02:23:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.117+0000 7f9046600640 1 -- 172.21.15.2:0/2859721165 reap_dead start 2024-08-17T02:23:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.117+0000 7f9048600640 1 -- 172.21.15.2:0/2859721165 shutdown_connections 2024-08-17T02:23:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.117+0000 7f9048600640 1 -- 172.21.15.2:0/2859721165 >> 172.21.15.2:0/2859721165 conn(0x7f9040066e60 msgr2=0x7f904006a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.120+0000 7f9048600640 1 -- 172.21.15.2:0/2859721165 shutdown_connections 2024-08-17T02:23:38.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.120+0000 7f9048600640 1 -- 172.21.15.2:0/2859721165 wait complete. 2024-08-17T02:23:38.183 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2024-08-17T02:23:38.183 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:23:38.184 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2024-08-17T02:23:38.184 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:23:38.185 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2024-08-17T02:23:38.185 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:23:38.186 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2024-08-17T02:23:38.186 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:23:38.187 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2024-08-17T02:23:38.187 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:23:38.188 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2024-08-17T02:23:38.189 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:23:38.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.491+0000 7f416d800640 1 Processor -- start 2024-08-17T02:23:38.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.491+0000 7f416d800640 1 -- start start 2024-08-17T02:23:38.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.493+0000 7f416d800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41600e1ef0 0x7f4160057420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.493+0000 7f416d800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4160058860 con 0x7f41600e6330 2024-08-17T02:23:38.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.493+0000 7f416d800640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4160058cf0 con 0x7f41600e22c0 2024-08-17T02:23:38.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.493+0000 7f416d800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4160057c50 con 0x7f41600e1ef0 2024-08-17T02:23:38.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.495+0000 7f4167400640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f41600e22c0 0x7f41600e5c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:56368/0 (socket says 172.21.15.2:56368) 2024-08-17T02:23:38.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.495+0000 7f4167e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41600e1ef0 0x7f4160057420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.495+0000 7f4167e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41600e1ef0 0x7f4160057420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47148/0 (socket says 172.21.15.2:47148) 2024-08-17T02:23:38.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.495+0000 7f4167e00640 1 -- 172.21.15.2:0/1657576390 learned_addr learned my addr 172.21.15.2:0/1657576390 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.496+0000 7fcc91e00640 1 Processor -- start 2024-08-17T02:23:38.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.496+0000 7fcc91e00640 1 -- start start 2024-08-17T02:23:38.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.494+0000 7f416ce00640 1 --1- 172.21.15.2:0/1657576390 >> v1:172.21.15.2:6789/0 conn(0x7f41600e6330 0x7f4160038bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36082/0 (socket says 172.21.15.2:36082) 2024-08-17T02:23:38.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.496+0000 7f4167e00640 1 -- 172.21.15.2:0/1657576390 >> v1:172.21.15.145:6789/0 conn(0x7f41600e22c0 legacy=0x7f41600e5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.496+0000 7f4167e00640 1 -- 172.21.15.2:0/1657576390 >> v1:172.21.15.2:6789/0 conn(0x7f41600e6330 legacy=0x7f4160038bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.496+0000 7f4167e00640 1 -- 172.21.15.2:0/1657576390 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4160057f30 con 0x7f41600e1ef0 2024-08-17T02:23:38.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.497+0000 7f857b800640 1 Processor -- start 2024-08-17T02:23:38.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.497+0000 7f17a2800640 1 Processor -- start 2024-08-17T02:23:38.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.498+0000 7fcc91e00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fcc8c14fe00 0x7fcc8c0cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.498+0000 7fcc91e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcc8c0d0320 0x7fcc8c0ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.498+0000 7fcc91e00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc8c0cdef0 con 0x7fcc8c0cca30 2024-08-17T02:23:38.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.498+0000 7fcc91e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc8c0af8e0 con 0x7fcc8c0d0320 2024-08-17T02:23:38.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.498+0000 7fcc91e00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc8c0ccf10 con 0x7fcc8c14fe00 2024-08-17T02:23:38.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.498+0000 7fcc8a000640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fcc8c0cca30 0x7fcc8c0cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:56380/0 (socket says 172.21.15.2:56380) 2024-08-17T02:23:38.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.498+0000 7fcc8a000640 1 -- 172.21.15.2:0/622389813 learned_addr learned my addr 172.21.15.2:0/622389813 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:38.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.499+0000 7fcc8aa00640 1 --2- 172.21.15.2:0/622389813 >> v2:172.21.15.145:3300/0 conn(0x7fcc8c14fe00 0x7fcc8c0cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.499+0000 7f4167e00640 1 --2- 172.21.15.2:0/1657576390 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41600e1ef0 0x7f4160057420 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4168064f60 tx=0x7f4168064990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ee05585189e258b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.499+0000 7f4166a00640 1 -- 172.21.15.2:0/1657576390 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41680a93f0 con 0x7f41600e1ef0 2024-08-17T02:23:38.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.499+0000 7f4166a00640 1 -- 172.21.15.2:0/1657576390 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41680a9590 con 0x7f41600e1ef0 2024-08-17T02:23:38.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.499+0000 7f4166a00640 1 -- 172.21.15.2:0/1657576390 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41680a99d0 con 0x7f41600e1ef0 2024-08-17T02:23:38.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.499+0000 7fcc8b400640 1 --2- 172.21.15.2:0/622389813 >> v2:172.21.15.2:3300/0 conn(0x7fcc8c0d0320 0x7fcc8c0ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.497+0000 7f857b800640 1 -- start start 2024-08-17T02:23:38.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.499+0000 7f857b800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f856c051da0 0x7f856c052170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.499+0000 7f857b800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f856c0363e0 con 0x7f856c035960 2024-08-17T02:23:38.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.499+0000 7f857b800640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f856c054b10 con 0x7f856c0e0240 2024-08-17T02:23:38.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.499+0000 7f857b800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856c054df0 con 0x7f856c051da0 2024-08-17T02:23:38.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.498+0000 7f17a2800640 1 -- start start 2024-08-17T02:23:38.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.500+0000 7f8578e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f856c051da0 0x7f856c052170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.500+0000 7f8578e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f856c051da0 0x7f856c052170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53898/0 (socket says 172.21.15.2:53898) 2024-08-17T02:23:38.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.500+0000 7f8578e00640 1 -- 172.21.15.2:0/1436805884 learned_addr learned my addr 172.21.15.2:0/1436805884 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.499+0000 7fcc89600640 1 -- 172.21.15.2:0/622389813 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284333923 0 0) 0x7fcc8c0cdef0 con 0x7fcc8c0cca30 2024-08-17T02:23:38.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.499+0000 7fcc89600640 1 -- 172.21.15.2:0/622389813 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc700034e0 con 0x7fcc8c0cca30 2024-08-17T02:23:38.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.500+0000 7fcc89600640 1 -- 172.21.15.2:0/622389813 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2485301834 0 0) 0x7fcc700034e0 con 0x7fcc8c0cca30 2024-08-17T02:23:38.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.500+0000 7fcc89600640 1 -- 172.21.15.2:0/622389813 >> v2:172.21.15.145:3300/0 conn(0x7fcc8c14fe00 msgr2=0x7fcc8c0cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.500+0000 7fcc89600640 1 --2- 172.21.15.2:0/622389813 >> v2:172.21.15.145:3300/0 conn(0x7fcc8c14fe00 0x7fcc8c0cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.500+0000 7fcc89600640 1 -- 172.21.15.2:0/622389813 >> v2:172.21.15.2:3300/0 conn(0x7fcc8c0d0320 msgr2=0x7fcc8c0ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.500+0000 7f17a2800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f179c157e10 0x7f179c0ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.500+0000 7f17a2800640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f179c0aae50 0x7f179c14ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.500+0000 7f17a2800640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f179c0ae2e0 con 0x7f179c0cc0c0 2024-08-17T02:23:38.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.500+0000 7f17a2800640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f179c156030 con 0x7f179c0aae50 2024-08-17T02:23:38.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.500+0000 7f17a2800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179c155160 con 0x7f179c157e10 2024-08-17T02:23:38.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.501+0000 7f416d800640 1 -- 172.21.15.2:0/1657576390 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41600e1ef0 msgr2=0x7f4160057420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.501+0000 7f416d800640 1 --2- 172.21.15.2:0/1657576390 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41600e1ef0 0x7f4160057420 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4168064f60 tx=0x7f4168064990 comp rx=0 tx=0).stop 2024-08-17T02:23:38.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.501+0000 7f17a1e00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f179c0aae50 0x7f179c14ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.501+0000 7f17a1e00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f179c0aae50 0x7f179c14ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:47414/0 (socket says 172.21.15.2:47414) 2024-08-17T02:23:38.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.501+0000 7f17a1e00640 1 -- 172.21.15.2:0/2169100039 learned_addr learned my addr 172.21.15.2:0/2169100039 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.501+0000 7f8578e00640 1 -- 172.21.15.2:0/1436805884 >> v1:172.21.15.145:6789/0 conn(0x7f856c0e0240 legacy=0x7f856c0555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.502+0000 7f8578e00640 1 -- 172.21.15.2:0/1436805884 >> v1:172.21.15.2:6789/0 conn(0x7f856c035960 legacy=0x7f856c0dfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.502+0000 7f8578e00640 1 -- 172.21.15.2:0/1436805884 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c0550d0 con 0x7f856c051da0 2024-08-17T02:23:38.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.501+0000 7fcc89600640 1 --2- 172.21.15.2:0/622389813 >> v2:172.21.15.2:3300/0 conn(0x7fcc8c0d0320 0x7fcc8c0ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.501+0000 7f416d800640 1 -- 172.21.15.2:0/1657576390 shutdown_connections 2024-08-17T02:23:38.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.501+0000 7f416d800640 1 --2- 172.21.15.2:0/1657576390 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41600e1ef0 0x7f4160057420 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.501+0000 7f416d800640 1 -- 172.21.15.2:0/1657576390 >> 172.21.15.2:0/1657576390 conn(0x7f4160055a10 msgr2=0x7f4160055e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.501+0000 7fcc89600640 1 -- 172.21.15.2:0/622389813 --> v1:172.21.15.145:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8c0cdba0 con 0x7fcc8c0cca30 2024-08-17T02:23:38.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.501+0000 7fcc89600640 1 -- 172.21.15.2:0/622389813 <== mon.1 v1:172.21.15.145:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7fcc78001470 con 0x7fcc8c0cca30 2024-08-17T02:23:38.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.501+0000 7fcc89600640 1 -- 172.21.15.2:0/622389813 >> v1:172.21.15.145:6789/0 conn(0x7fcc8c0cca30 legacy=0x7fcc8c0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.501+0000 7fcc89600640 1 --2- 172.21.15.2:0/622389813 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcc70003a50 0x7fcc70003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.501+0000 7fcc89600640 1 --2- 172.21.15.2:0/622389813 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcc70004780 0x7fcc70004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.501+0000 7fcc89600640 1 --2- 172.21.15.2:0/622389813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc70005130 0x7fcc700141e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.501+0000 7fcc89600640 1 -- 172.21.15.2:0/622389813 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c0af8e0 con 0x7fcc70005130 2024-08-17T02:23:38.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.501+0000 7fcc89600640 1 -- 172.21.15.2:0/622389813 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c0ccf10 con 0x7fcc70004780 2024-08-17T02:23:38.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.501+0000 7fcc89600640 1 -- 172.21.15.2:0/622389813 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc70014930 con 0x7fcc70003a50 2024-08-17T02:23:38.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.501+0000 7fcc8b400640 1 --2- 172.21.15.2:0/622389813 >> v2:172.21.15.2:3300/0 conn(0x7fcc8c0d0320 0x7fcc8c0ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:38.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.502+0000 7fcc8a000640 1 --2- 172.21.15.2:0/622389813 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcc70004780 0x7fcc70004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.502+0000 7f416d800640 1 -- 172.21.15.2:0/1657576390 shutdown_connections 2024-08-17T02:23:38.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.502+0000 7fcc8aa00640 1 --2- 172.21.15.2:0/622389813 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcc70003a50 0x7fcc70003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.503+0000 7fcc8b400640 1 --2- 172.21.15.2:0/622389813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc70005130 0x7fcc700141e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.503+0000 7fcc8a000640 1 -- 172.21.15.2:0/622389813 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcc70003a50 msgr2=0x7fcc70003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.503+0000 7fcc8a000640 1 --2- 172.21.15.2:0/622389813 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcc70003a50 0x7fcc70003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.503+0000 7fcc8a000640 1 -- 172.21.15.2:0/622389813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc70005130 msgr2=0x7fcc700141e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.503+0000 7fcc8a000640 1 --2- 172.21.15.2:0/622389813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc70005130 0x7fcc700141e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.503+0000 7fcc8a000640 1 -- 172.21.15.2:0/622389813 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8c0cdba0 con 0x7fcc70004780 2024-08-17T02:23:38.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.503+0000 7fcc8b400640 1 --2- 172.21.15.2:0/622389813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc70005130 0x7fcc700141e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:38.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.503+0000 7fcc8b400640 1 -- 172.21.15.2:0/622389813 reap_dead start 2024-08-17T02:23:38.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.502+0000 7f416d800640 1 -- 172.21.15.2:0/1657576390 wait complete. 2024-08-17T02:23:38.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.504+0000 7f8578e00640 1 --2- 172.21.15.2:0/1436805884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f856c051da0 0x7f856c052170 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8560009910 tx=0x7f85600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1aa89b77fc76890 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.504+0000 7fb1b4000640 1 Processor -- start 2024-08-17T02:23:38.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.504+0000 7fb1b4000640 1 -- start start 2024-08-17T02:23:38.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.502+0000 7f17a1e00640 1 -- 172.21.15.2:0/2169100039 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f179c157e10 msgr2=0x7f179c0ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.502+0000 7f17a1e00640 1 --2- 172.21.15.2:0/2169100039 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f179c157e10 0x7f179c0ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.504+0000 7f8573400640 1 -- 172.21.15.2:0/1436805884 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856002ad50 con 0x7f856c051da0 2024-08-17T02:23:38.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.502+0000 7f17a1e00640 1 -- 172.21.15.2:0/2169100039 >> v1:172.21.15.145:6789/0 conn(0x7f179c0cc0c0 legacy=0x7f179c0aa740 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:23:38.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.502+0000 7f17a1e00640 1 -- 172.21.15.2:0/2169100039 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179c155420 con 0x7f179c0aae50 2024-08-17T02:23:38.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.504+0000 7f8573400640 1 -- 172.21.15.2:0/1436805884 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8560032440 con 0x7f856c051da0 2024-08-17T02:23:38.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.504+0000 7f8573400640 1 -- 172.21.15.2:0/1436805884 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856002ad50 con 0x7f856c051da0 2024-08-17T02:23:38.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.504+0000 7f416d800640 1 Processor -- start 2024-08-17T02:23:38.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.505+0000 7f416d800640 1 -- start start 2024-08-17T02:23:38.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.505+0000 7f857b800640 1 -- 172.21.15.2:0/1436805884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f856c051da0 msgr2=0x7f856c052170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.505+0000 7f857b800640 1 --2- 172.21.15.2:0/1436805884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f856c051da0 0x7f856c052170 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8560009910 tx=0x7f85600091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.506+0000 7f857b800640 1 -- 172.21.15.2:0/1436805884 shutdown_connections 2024-08-17T02:23:38.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.506+0000 7f17a1e00640 1 --2- 172.21.15.2:0/2169100039 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f179c0aae50 0x7f179c14ea10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1794009d10 tx=0x7f1794009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78e5a759f7073245 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.506+0000 7fb1b4000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb1ac0aea20 0x7fb1ac0aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.506+0000 7fb1b4000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac0af3a0 con 0x7fb1ac0ca8e0 2024-08-17T02:23:38.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.506+0000 7f857b800640 1 --2- 172.21.15.2:0/1436805884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f856c051da0 0x7f856c052170 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.506+0000 7fb1b4000640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac0afd20 con 0x7fb1ac158b90 2024-08-17T02:23:38.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.506+0000 7fb1b4000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ac0affe0 con 0x7fb1ac0aea20 2024-08-17T02:23:38.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.506+0000 7f857b800640 1 -- 172.21.15.2:0/1436805884 >> 172.21.15.2:0/1436805884 conn(0x7f856c00a800 msgr2=0x7f856c056da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.506+0000 7f857b800640 1 -- 172.21.15.2:0/1436805884 shutdown_connections 2024-08-17T02:23:38.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.506+0000 7fb1b1600640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fb1ac158b90 0x7fb1ac0b1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:56406/0 (socket says 172.21.15.2:56406) 2024-08-17T02:23:38.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.506+0000 7fb1b1600640 1 -- 172.21.15.2:0/2332900451 learned_addr learned my addr 172.21.15.2:0/2332900451 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:38.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.506+0000 7f857b800640 1 -- 172.21.15.2:0/1436805884 wait complete. 2024-08-17T02:23:38.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.506+0000 7f179be00640 1 -- 172.21.15.2:0/2169100039 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179402c540 con 0x7f179c0aae50 2024-08-17T02:23:38.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.506+0000 7fcc8a000640 1 --2- 172.21.15.2:0/622389813 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcc70004780 0x7fcc70004bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcc7801d370 tx=0x7fcc78007940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a09e0aa3cd236fb4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.507+0000 7f179be00640 1 -- 172.21.15.2:0/2169100039 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179402c6a0 con 0x7f179c0aae50 2024-08-17T02:23:38.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.507+0000 7f179be00640 1 -- 172.21.15.2:0/2169100039 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179402ca80 con 0x7f179c0aae50 2024-08-17T02:23:38.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.506+0000 7fb1b0c00640 1 --2- 172.21.15.2:0/2332900451 >> v2:172.21.15.2:3300/0 conn(0x7fb1ac0aea20 0x7fb1ac0aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.506+0000 7fb1abe00640 1 -- 172.21.15.2:0/2332900451 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2139003187 0 0) 0x7fb1ac0afd20 con 0x7fb1ac158b90 2024-08-17T02:23:38.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.507+0000 7fb1abe00640 1 -- 172.21.15.2:0/2332900451 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1940034e0 con 0x7fb1ac158b90 2024-08-17T02:23:38.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.507+0000 7fcc89600640 1 -- 172.21.15.2:0/622389813 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7803d040 con 0x7fcc70004780 2024-08-17T02:23:38.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.507+0000 7fcc89600640 1 -- 172.21.15.2:0/622389813 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc78005960 con 0x7fcc70004780 2024-08-17T02:23:38.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.507+0000 7fcc89600640 1 -- 172.21.15.2:0/622389813 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc78005da0 con 0x7fcc70004780 2024-08-17T02:23:38.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.507+0000 7fb1abe00640 1 -- 172.21.15.2:0/2332900451 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1292499897 0 0) 0x7fb1940034e0 con 0x7fb1ac158b90 2024-08-17T02:23:38.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.507+0000 7fb1abe00640 1 -- 172.21.15.2:0/2332900451 >> v2:172.21.15.2:3300/0 conn(0x7fb1ac0aea20 msgr2=0x7fb1ac0aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.507+0000 7fb1abe00640 1 --2- 172.21.15.2:0/2332900451 >> v2:172.21.15.2:3300/0 conn(0x7fb1ac0aea20 0x7fb1ac0aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.507+0000 7fb1abe00640 1 -- 172.21.15.2:0/2332900451 >> v1:172.21.15.2:6789/0 conn(0x7fb1ac0ca8e0 legacy=0x7fb1ac0cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.507+0000 7f416d800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41600e1ef0 0x7f416003dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.507+0000 7f416d800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41600e22c0 0x7f416003bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.507+0000 7f416d800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41600e6330 0x7f41600ce370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.508+0000 7f416d800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416003ec00 con 0x7f41600e6330 2024-08-17T02:23:38.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.507+0000 7fb1abe00640 1 -- 172.21.15.2:0/2332900451 --> v1:172.21.15.145:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac0b02c0 con 0x7fb1ac158b90 2024-08-17T02:23:38.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.507+0000 7fb1abe00640 1 -- 172.21.15.2:0/2332900451 <== mon.1 v1:172.21.15.145:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7fb1a40017f0 con 0x7fb1ac158b90 2024-08-17T02:23:38.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.507+0000 7fb1abe00640 1 -- 172.21.15.2:0/2332900451 >> v1:172.21.15.145:6789/0 conn(0x7fb1ac158b90 legacy=0x7fb1ac0b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.507+0000 7fb1abe00640 1 --2- 172.21.15.2:0/2332900451 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb194003a50 0x7fb194003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.507+0000 7fb1abe00640 1 --2- 172.21.15.2:0/2332900451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb194004780 0x7fb194004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.507+0000 7fb1abe00640 1 --2- 172.21.15.2:0/2332900451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb1940051a0 0x7fb19400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.507+0000 7fb1abe00640 1 -- 172.21.15.2:0/2332900451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac0affe0 con 0x7fb194004780 2024-08-17T02:23:38.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.507+0000 7fb1abe00640 1 -- 172.21.15.2:0/2332900451 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19400c0d0 con 0x7fb1940051a0 2024-08-17T02:23:38.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.507+0000 7fb1abe00640 1 -- 172.21.15.2:0/2332900451 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19400c290 con 0x7fb194003a50 2024-08-17T02:23:38.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.507+0000 7fb1b0c00640 1 --2- 172.21.15.2:0/2332900451 >> v2:172.21.15.2:3300/0 conn(0x7fb1ac0aea20 0x7fb1ac0aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:38.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.508+0000 7fb1b1600640 1 --2- 172.21.15.2:0/2332900451 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb194003a50 0x7fb194003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.508+0000 7fb1b2000640 1 --2- 172.21.15.2:0/2332900451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb1940051a0 0x7fb19400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.508+0000 7fb1b0c00640 1 --2- 172.21.15.2:0/2332900451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb194004780 0x7fb194004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.508+0000 7f416d800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41600e2be0 con 0x7f41600e1ef0 2024-08-17T02:23:38.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.508+0000 7f416d800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416003e640 con 0x7f41600e22c0 2024-08-17T02:23:38.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.508+0000 7f416ce00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41600e6330 0x7f41600ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.508+0000 7f416ce00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41600e6330 0x7f41600ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53934/0 (socket says 172.21.15.2:53934) 2024-08-17T02:23:38.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.508+0000 7f416ce00640 1 -- 172.21.15.2:0/1444777243 learned_addr learned my addr 172.21.15.2:0/1444777243 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.508+0000 7f4167400640 1 --2- 172.21.15.2:0/1444777243 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41600e22c0 0x7f416003bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.508+0000 7f4167e00640 1 --2- 172.21.15.2:0/1444777243 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41600e1ef0 0x7f416003dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.508+0000 7f416ce00640 1 -- 172.21.15.2:0/1444777243 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41600e22c0 msgr2=0x7f416003bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.508+0000 7f416ce00640 1 --2- 172.21.15.2:0/1444777243 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41600e22c0 0x7f416003bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.508+0000 7f416ce00640 1 -- 172.21.15.2:0/1444777243 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41600e1ef0 msgr2=0x7f416003dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.509+0000 7f857b800640 1 Processor -- start 2024-08-17T02:23:38.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.508+0000 7fcc91e00640 1 -- 172.21.15.2:0/622389813 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcc70004780 msgr2=0x7fcc70004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.508+0000 7fcc91e00640 1 --2- 172.21.15.2:0/622389813 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcc70004780 0x7fcc70004bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcc7801d370 tx=0x7fcc78007940 comp rx=0 tx=0).stop 2024-08-17T02:23:38.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.509+0000 7f416ce00640 1 --2- 172.21.15.2:0/1444777243 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41600e1ef0 0x7f416003dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.509+0000 7f416ce00640 1 -- 172.21.15.2:0/1444777243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416804c200 con 0x7f41600e6330 2024-08-17T02:23:38.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.509+0000 7fcc91e00640 1 -- 172.21.15.2:0/622389813 shutdown_connections 2024-08-17T02:23:38.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.509+0000 7fcc91e00640 1 --2- 172.21.15.2:0/622389813 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcc70004780 0x7fcc70004bf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.509+0000 7fcc91e00640 1 -- 172.21.15.2:0/622389813 >> 172.21.15.2:0/622389813 conn(0x7fcc8c068680 msgr2=0x7fcc8c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.509+0000 7f4167e00640 1 --2- 172.21.15.2:0/1444777243 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41600e1ef0 0x7f416003dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:38.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.509+0000 7f1fb8800640 1 Processor -- start 2024-08-17T02:23:38.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.509+0000 7f1fb8800640 1 -- start start 2024-08-17T02:23:38.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.509+0000 7f17a2800640 1 -- 172.21.15.2:0/2169100039 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f179c0aae50 msgr2=0x7f179c14ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.509+0000 7fb1b1600640 1 -- 172.21.15.2:0/2332900451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb1940051a0 msgr2=0x7fb19400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.509+0000 7fb1b1600640 1 --2- 172.21.15.2:0/2332900451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb1940051a0 0x7fb19400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.509+0000 7fb1b1600640 1 -- 172.21.15.2:0/2332900451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb194004780 msgr2=0x7fb194004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.509+0000 7fb1b1600640 1 --2- 172.21.15.2:0/2332900451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb194004780 0x7fb194004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.509+0000 7f17a2800640 1 --2- 172.21.15.2:0/2169100039 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f179c0aae50 0x7f179c14ea10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1794009d10 tx=0x7f1794009f90 comp rx=0 tx=0).stop 2024-08-17T02:23:38.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.509+0000 7fb1b1600640 1 -- 172.21.15.2:0/2332900451 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac0b02c0 con 0x7fb194003a50 2024-08-17T02:23:38.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.510+0000 7f416ce00640 1 --2- 172.21.15.2:0/1444777243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41600e6330 0x7f41600ce370 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f415c00c4c0 tx=0x7f415c007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.510+0000 7fb1b2000640 1 -- 172.21.15.2:0/2332900451 reap_dead start 2024-08-17T02:23:38.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.510+0000 7f415b400640 1 -- 172.21.15.2:0/1444777243 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c0073b0 con 0x7f41600e6330 2024-08-17T02:23:38.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.510+0000 7f415b400640 1 -- 172.21.15.2:0/1444777243 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415c007510 con 0x7f41600e6330 2024-08-17T02:23:38.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.510+0000 7fb1b1600640 1 --2- 172.21.15.2:0/2332900451 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb194003a50 0x7fb194003e60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb1a400a990 tx=0x7fb1a40021c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c6b0d9dbeeb918a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.510+0000 7f415b400640 1 -- 172.21.15.2:0/1444777243 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c0049f0 con 0x7f41600e6330 2024-08-17T02:23:38.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.510+0000 7fcc91e00640 1 -- 172.21.15.2:0/622389813 shutdown_connections 2024-08-17T02:23:38.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.510+0000 7f857b800640 1 -- start start 2024-08-17T02:23:38.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.510+0000 7f416d800640 1 -- 172.21.15.2:0/1444777243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f416003e920 con 0x7f41600e6330 2024-08-17T02:23:38.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.510+0000 7f416d800640 1 -- 172.21.15.2:0/1444777243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f416003e230 con 0x7f41600e6330 2024-08-17T02:23:38.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.511+0000 7fb1abe00640 1 -- 172.21.15.2:0/2332900451 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a40070f0 con 0x7fb194003a50 2024-08-17T02:23:38.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.511+0000 7fb1abe00640 1 -- 172.21.15.2:0/2332900451 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a4007270 con 0x7fb194003a50 2024-08-17T02:23:38.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.511+0000 7fb1abe00640 1 -- 172.21.15.2:0/2332900451 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4007670 con 0x7fb194003a50 2024-08-17T02:23:38.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.511+0000 7f1fb8800640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1fb00ca5c0 0x7f1fb0167cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.511+0000 7f1fb8800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb006aa70 con 0x7f1fb015cef0 2024-08-17T02:23:38.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.511+0000 7f17a2800640 1 -- 172.21.15.2:0/2169100039 shutdown_connections 2024-08-17T02:23:38.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.511+0000 7f1fb6800640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1fb00ca5c0 0x7f1fb0167cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.512+0000 7f1fb6800640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1fb00ca5c0 0x7f1fb0167cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:47474/0 (socket says 172.21.15.2:47474) 2024-08-17T02:23:38.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.511+0000 7f1fb5400640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f1fb015d2c0 0x7f1fb006a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:56414/0 (socket says 172.21.15.2:56414) 2024-08-17T02:23:38.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.511+0000 7f17a2800640 1 --2- 172.21.15.2:0/2169100039 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f179c0aae50 0x7f179c14ea10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.511+0000 7f17a2800640 1 --2- 172.21.15.2:0/2169100039 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f179c157e10 0x7f179c0ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.511+0000 7f17a2800640 1 -- 172.21.15.2:0/2169100039 >> 172.21.15.2:0/2169100039 conn(0x7f179c0678e0 msgr2=0x7f179c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.512+0000 7f1fb8800640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb00b1520 con 0x7f1fb015d2c0 2024-08-17T02:23:38.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.512+0000 7f1fb8800640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb00b0910 con 0x7f1fb00ca5c0 2024-08-17T02:23:38.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.512+0000 7f1fb5400640 1 -- 172.21.15.2:0/964118737 learned_addr learned my addr 172.21.15.2:0/964118737 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:38.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.512+0000 7fb1b4000640 1 -- 172.21.15.2:0/2332900451 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb194003a50 msgr2=0x7fb194003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.512+0000 7f29db400640 1 Processor -- start 2024-08-17T02:23:38.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.512+0000 7fb1b4000640 1 --2- 172.21.15.2:0/2332900451 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb194003a50 0x7fb194003e60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb1a400a990 tx=0x7fb1a40021c0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.512+0000 7f1fb6800640 1 -- 172.21.15.2:0/964118737 >> v1:172.21.15.145:6789/0 conn(0x7f1fb015d2c0 legacy=0x7f1fb006a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.512+0000 7f1fb6800640 1 -- 172.21.15.2:0/964118737 >> v1:172.21.15.2:6789/0 conn(0x7f1fb015cef0 legacy=0x7f1fb0069c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.512+0000 7f1fb6800640 1 -- 172.21.15.2:0/964118737 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb00b0bf0 con 0x7f1fb00ca5c0 2024-08-17T02:23:38.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.512+0000 7f17a2800640 1 -- 172.21.15.2:0/2169100039 shutdown_connections 2024-08-17T02:23:38.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.512+0000 7f17a2800640 1 -- 172.21.15.2:0/2169100039 wait complete. 2024-08-17T02:23:38.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.510+0000 7fcc91e00640 1 -- 172.21.15.2:0/622389813 wait complete. 2024-08-17T02:23:38.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.513+0000 7fcc91e00640 1 Processor -- start 2024-08-17T02:23:38.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.513+0000 7fb1b4000640 1 -- 172.21.15.2:0/2332900451 shutdown_connections 2024-08-17T02:23:38.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.513+0000 7fb1b4000640 1 --2- 172.21.15.2:0/2332900451 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb194003a50 0x7fb194003e60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.513+0000 7fb1b4000640 1 -- 172.21.15.2:0/2332900451 >> 172.21.15.2:0/2332900451 conn(0x7fb1ac06e590 msgr2=0x7fb1ac06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.512+0000 7f29db400640 1 -- start start 2024-08-17T02:23:38.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.513+0000 7fb1b4000640 1 -- 172.21.15.2:0/2332900451 shutdown_connections 2024-08-17T02:23:38.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.513+0000 7fb1b4000640 1 -- 172.21.15.2:0/2332900451 wait complete. 2024-08-17T02:23:38.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.514+0000 7f1fb6800640 1 --2- 172.21.15.2:0/964118737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fb00ca5c0 0x7f1fb0167cd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009e60 tx=0x7f1fac009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d704d566209c4e87 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.514+0000 7f1fb4a00640 1 -- 172.21.15.2:0/964118737 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac007550 con 0x7f1fb00ca5c0 2024-08-17T02:23:38.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.514+0000 7f1fb4a00640 1 -- 172.21.15.2:0/964118737 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac02d050 con 0x7f1fb00ca5c0 2024-08-17T02:23:38.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.514+0000 7f1fb4a00640 1 -- 172.21.15.2:0/964118737 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac0078e0 con 0x7f1fb00ca5c0 2024-08-17T02:23:38.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.514+0000 7fcc91e00640 1 -- start start 2024-08-17T02:23:38.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.515+0000 7f1fb8800640 1 -- 172.21.15.2:0/964118737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fb00ca5c0 msgr2=0x7f1fb0167cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.515+0000 7fb1b4000640 1 Processor -- start 2024-08-17T02:23:38.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.515+0000 7f1fb8800640 1 --2- 172.21.15.2:0/964118737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fb00ca5c0 0x7f1fb0167cd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009e60 tx=0x7f1fac009780 comp rx=0 tx=0).stop 2024-08-17T02:23:38.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.515+0000 7fb1b4000640 1 -- start start 2024-08-17T02:23:38.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.515+0000 7f1fb8800640 1 -- 172.21.15.2:0/964118737 shutdown_connections 2024-08-17T02:23:38.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.515+0000 7f1fb8800640 1 --2- 172.21.15.2:0/964118737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fb00ca5c0 0x7f1fb0167cd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.515+0000 7f1fb8800640 1 -- 172.21.15.2:0/964118737 >> 172.21.15.2:0/964118737 conn(0x7f1fb0066e60 msgr2=0x7f1fb0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.515+0000 7fcc91e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc70004780 0x7fcc8c145100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.515+0000 7fcc91e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcc8c0c97f0 0x7fcc8c1467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.515+0000 7fcc91e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcc8c0c5bd0 0x7fcc8c0c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.516+0000 7f1fb8800640 1 -- 172.21.15.2:0/964118737 shutdown_connections 2024-08-17T02:23:38.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.516+0000 7f1fb8800640 1 -- 172.21.15.2:0/964118737 wait complete. 2024-08-17T02:23:38.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.514+0000 7f17a2800640 1 Processor -- start 2024-08-17T02:23:38.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.515+0000 7f17a2800640 1 -- start start 2024-08-17T02:23:38.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.515+0000 7f857b800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f856c035960 0x7f856c050b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.515+0000 7f857b800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f856c051da0 0x7f856c0cd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.515+0000 7f857b800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f856c0e0240 0x7f856c0ddb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.516+0000 7f17a2800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f179c0aae50 0x7f179c13f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.515+0000 7f857b800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c0deef0 con 0x7f856c035960 2024-08-17T02:23:38.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.515+0000 7f857b800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c0de080 con 0x7f856c051da0 2024-08-17T02:23:38.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.515+0000 7f857b800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856c0de2e0 con 0x7f856c0e0240 2024-08-17T02:23:38.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.516+0000 7f8579800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f856c0e0240 0x7f856c0ddb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.516+0000 7f415b400640 1 -- 172.21.15.2:0/1444777243 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f415c013400 con 0x7f41600e6330 2024-08-17T02:23:38.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.516+0000 7f29db400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f29d415cdc0 0x7f29d40ae860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.516+0000 7f29db400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29d406d7d0 0x7f29d406dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.516+0000 7f29db400640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d40aff30 con 0x7f29d40aeda0 2024-08-17T02:23:38.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.516+0000 7f29db400640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d406e120 con 0x7f29d415cdc0 2024-08-17T02:23:38.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.516+0000 7f29db400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d40af320 con 0x7f29d406d7d0 2024-08-17T02:23:38.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.517+0000 7fb1b4000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb194003a50 0x7fb1ac16f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.517+0000 7fb1b4000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb1ac16de00 0x7fb1ac15a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.517+0000 7fb1b4000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1ac15af10 0x7fb1ac16cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.517+0000 7fb1b4000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac15a770 con 0x7fb1ac15af10 2024-08-17T02:23:38.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.517+0000 7fb1b4000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac0c7410 con 0x7fb194003a50 2024-08-17T02:23:38.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.517+0000 7fb1b4000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac15b390 con 0x7fb1ac16de00 2024-08-17T02:23:38.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.516+0000 7fcc8a000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcc8c0c97f0 0x7fcc8c1467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.516+0000 7fcc8a000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcc8c0c97f0 0x7fcc8c1467e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:47504/0 (socket says 172.21.15.2:47504) 2024-08-17T02:23:38.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.517+0000 7fcc8aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc70004780 0x7fcc8c145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.517+0000 7f17a2800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f179c0cc0c0 0x7f179c1564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.517+0000 7f17a1400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f179c0aae50 0x7f179c13f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.517+0000 7f17a1400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f179c0aae50 0x7f179c13f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53974/0 (socket says 172.21.15.2:53974) 2024-08-17T02:23:38.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.517+0000 7f29d8a00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f29d415cdc0 0x7f29d40ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.516+0000 7f8578e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f856c035960 0x7f856c050b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.516+0000 7f8578e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f856c035960 0x7f856c050b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53950/0 (socket says 172.21.15.2:53950) 2024-08-17T02:23:38.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.516+0000 7f8578e00640 1 -- 172.21.15.2:0/2862735358 learned_addr learned my addr 172.21.15.2:0/2862735358 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7f8573e00640 1 --2- 172.21.15.2:0/2862735358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f856c051da0 0x7f856c0cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.517+0000 7f29d9400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29d406d7d0 0x7f29d406dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.517+0000 7f29d9400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29d406d7d0 0x7f29d406dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47200/0 (socket says 172.21.15.2:47200) 2024-08-17T02:23:38.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.517+0000 7f29d9400640 1 -- 172.21.15.2:0/924243361 learned_addr learned my addr 172.21.15.2:0/924243361 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.517+0000 7f29d3e00640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f29d40aeda0 0x7f29d40b03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:56420/0 (socket says 172.21.15.2:56420) 2024-08-17T02:23:38.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7f1fb8800640 1 Processor -- start 2024-08-17T02:23:38.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7f17a0a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f179c0cc0c0 0x7f179c1564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.517+0000 7fb1b0c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb1ac16de00 0x7fb1ac15a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.517+0000 7fb1b1600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb194003a50 0x7fb1ac16f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.517+0000 7fb1b0c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb1ac16de00 0x7fb1ac15a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47212/0 (socket says 172.21.15.2:47212) 2024-08-17T02:23:38.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.517+0000 7fb1b0c00640 1 -- 172.21.15.2:0/796158311 learned_addr learned my addr 172.21.15.2:0/796158311 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.517+0000 7fb1b2000640 1 --2- 172.21.15.2:0/796158311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1ac15af10 0x7fb1ac16cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7f1fb8800640 1 -- start start 2024-08-17T02:23:38.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7f17a2800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f179c157e10 0x7f179c156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7f17a2800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c1467a0 con 0x7f179c0aae50 2024-08-17T02:23:38.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7f17a2800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c141ef0 con 0x7f179c157e10 2024-08-17T02:23:38.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7f17a2800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179c1412e0 con 0x7f179c0cc0c0 2024-08-17T02:23:38.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7f415b400640 1 --2- 172.21.15.2:0/1444777243 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f41480652a0 0x7f4148067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.517+0000 7fcc8aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc70004780 0x7fcc8c145100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53964/0 (socket says 172.21.15.2:53964) 2024-08-17T02:23:38.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7fcc91e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c0c9c60 con 0x7fcc70004780 2024-08-17T02:23:38.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7fcc91e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c146d20 con 0x7fcc8c0c97f0 2024-08-17T02:23:38.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7fcc91e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c0c6580 con 0x7fcc8c0c5bd0 2024-08-17T02:23:38.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7f29d9400640 1 -- 172.21.15.2:0/924243361 >> v2:172.21.15.145:3300/0 conn(0x7f29d415cdc0 msgr2=0x7f29d40ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7f29d9400640 1 --2- 172.21.15.2:0/924243361 >> v2:172.21.15.145:3300/0 conn(0x7f29d415cdc0 0x7f29d40ae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7f17a0a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f179c0cc0c0 0x7f179c1564e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47214/0 (socket says 172.21.15.2:47214) 2024-08-17T02:23:38.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7f17a1400640 1 -- 172.21.15.2:0/661902156 learned_addr learned my addr 172.21.15.2:0/661902156 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7f17a1e00640 1 --2- 172.21.15.2:0/661902156 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f179c157e10 0x7f179c156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.519+0000 7f29d9400640 1 -- 172.21.15.2:0/924243361 >> v1:172.21.15.145:6789/0 conn(0x7f29d40aeda0 legacy=0x7f29d40b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.519+0000 7f415b400640 1 -- 172.21.15.2:0/1444777243 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f415c081bd0 con 0x7f41600e6330 2024-08-17T02:23:38.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.519+0000 7f1fb8800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fb00ca5c0 0x7f1fb0148530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.519+0000 7f1fb8800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fb015cef0 0x7f1fb00a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.519+0000 7f1fb8800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fb015d2c0 0x7f1fb00aab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.519+0000 7f1fb8800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb0148a70 con 0x7f1fb00ca5c0 2024-08-17T02:23:38.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.519+0000 7f1fb8800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb00aa080 con 0x7f1fb015d2c0 2024-08-17T02:23:38.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.519+0000 7f1fb8800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb00a4f50 con 0x7f1fb015cef0 2024-08-17T02:23:38.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.519+0000 7f17a1e00640 1 -- 172.21.15.2:0/661902156 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f179c0cc0c0 msgr2=0x7f179c1564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7f8573e00640 1 -- 172.21.15.2:0/2862735358 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f856c0e0240 msgr2=0x7f856c0ddb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7f8573e00640 1 --2- 172.21.15.2:0/2862735358 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f856c0e0240 0x7f856c0ddb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7f8573e00640 1 -- 172.21.15.2:0/2862735358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f856c035960 msgr2=0x7f856c050b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7f8573e00640 1 --2- 172.21.15.2:0/2862735358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f856c035960 0x7f856c050b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7f8573e00640 1 -- 172.21.15.2:0/2862735358 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8560009450 con 0x7f856c051da0 2024-08-17T02:23:38.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.519+0000 7f8573e00640 1 --2- 172.21.15.2:0/2862735358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f856c051da0 0x7f856c0cd910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8568009fd0 tx=0x7f8568009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.519+0000 7f8567e00640 1 -- 172.21.15.2:0/2862735358 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856800f510 con 0x7f856c051da0 2024-08-17T02:23:38.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.519+0000 7f8567e00640 1 -- 172.21.15.2:0/2862735358 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856800f670 con 0x7f856c051da0 2024-08-17T02:23:38.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.519+0000 7f8567e00640 1 -- 172.21.15.2:0/2862735358 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856800fa30 con 0x7f856c051da0 2024-08-17T02:23:38.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.519+0000 7f857b800640 1 -- 172.21.15.2:0/2862735358 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856c0de5c0 con 0x7f856c051da0 2024-08-17T02:23:38.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.519+0000 7f1fb6800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fb015d2c0 0x7f1fb00aab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.519+0000 7f1fb5400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fb015cef0 0x7f1fb00a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.520+0000 7f1fb6800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fb015d2c0 0x7f1fb00aab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:47512/0 (socket says 172.21.15.2:47512) 2024-08-17T02:23:38.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.520+0000 7f1fb6800640 1 -- 172.21.15.2:0/2897170793 learned_addr learned my addr 172.21.15.2:0/2897170793 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7fb1b1600640 1 -- 172.21.15.2:0/796158311 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb1ac16de00 msgr2=0x7fb1ac15a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7fb1b1600640 1 --2- 172.21.15.2:0/796158311 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb1ac16de00 0x7fb1ac15a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7fb1b1600640 1 -- 172.21.15.2:0/796158311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1ac15af10 msgr2=0x7fb1ac16cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7fb1b1600640 1 --2- 172.21.15.2:0/796158311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1ac15af10 0x7fb1ac16cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7fb1b1600640 1 -- 172.21.15.2:0/796158311 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac16d860 con 0x7fb194003a50 2024-08-17T02:23:38.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7fb1b1600640 1 --2- 172.21.15.2:0/796158311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb194003a50 0x7fb1ac16f9f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4030000 tx=0x7fb1a4034000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.519+0000 7fb1a8c00640 1 -- 172.21.15.2:0/796158311 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a402c780 con 0x7fb194003a50 2024-08-17T02:23:38.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.519+0000 7fb1a8c00640 1 -- 172.21.15.2:0/796158311 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a402c8e0 con 0x7fb194003a50 2024-08-17T02:23:38.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.519+0000 7fb1a8c00640 1 -- 172.21.15.2:0/796158311 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a402cca0 con 0x7fb194003a50 2024-08-17T02:23:38.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.519+0000 7f29d9400640 1 -- 172.21.15.2:0/924243361 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d40af600 con 0x7f29d406d7d0 2024-08-17T02:23:38.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.520+0000 7f29d8a00640 1 --2- 172.21.15.2:0/924243361 >> v2:172.21.15.145:3300/0 conn(0x7f29d415cdc0 0x7f29d40ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:38.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.519+0000 7fcc8a000640 1 -- 172.21.15.2:0/1822551440 learned_addr learned my addr 172.21.15.2:0/1822551440 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.520+0000 7fcc8b400640 1 --2- 172.21.15.2:0/1822551440 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcc8c0c5bd0 0x7fcc8c0c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.520+0000 7f857b800640 1 -- 172.21.15.2:0/2862735358 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856c0deb80 con 0x7f856c051da0 2024-08-17T02:23:38.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.518+0000 7f416d800640 1 -- 172.21.15.2:0/1444777243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4144005210 con 0x7f41600e6330 2024-08-17T02:23:38.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.519+0000 7f4167e00640 1 --2- 172.21.15.2:0/1444777243 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f41480652a0 0x7f4148067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.520+0000 7fcc8aa00640 1 -- 172.21.15.2:0/1822551440 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcc8c0c5bd0 msgr2=0x7fcc8c0c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.520+0000 7fcc8aa00640 1 --2- 172.21.15.2:0/1822551440 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcc8c0c5bd0 0x7fcc8c0c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.520+0000 7fcc8aa00640 1 -- 172.21.15.2:0/1822551440 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcc8c0c97f0 msgr2=0x7fcc8c1467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.520+0000 7fcc8aa00640 1 --2- 172.21.15.2:0/1822551440 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcc8c0c97f0 0x7fcc8c1467e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.520+0000 7fcc8aa00640 1 -- 172.21.15.2:0/1822551440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8c14a9d0 con 0x7fcc70004780 2024-08-17T02:23:38.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.520+0000 7f17a1e00640 1 --2- 172.21.15.2:0/661902156 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f179c0cc0c0 0x7f179c1564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.520+0000 7f17a1e00640 1 -- 172.21.15.2:0/661902156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f179c0aae50 msgr2=0x7f179c13f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.520+0000 7f17a1e00640 1 --2- 172.21.15.2:0/661902156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f179c0aae50 0x7f179c13f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.520+0000 7fb1b4000640 1 -- 172.21.15.2:0/796158311 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ac16db40 con 0x7fb194003a50 2024-08-17T02:23:38.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.520+0000 7f29d9400640 1 --2- 172.21.15.2:0/924243361 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29d406d7d0 0x7f29d406dbe0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009f20 tx=0x7f29cc009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7b9164931ea8555 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.520+0000 7f1fb6800640 1 -- 172.21.15.2:0/2897170793 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fb015cef0 msgr2=0x7f1fb00a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.520+0000 7f1fb6800640 1 --2- 172.21.15.2:0/2897170793 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fb015cef0 0x7f1fb00a44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.520+0000 7f1fb6800640 1 -- 172.21.15.2:0/2897170793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fb00ca5c0 msgr2=0x7f1fb0148530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.520+0000 7f1fb6800640 1 --2- 172.21.15.2:0/2897170793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fb00ca5c0 0x7f1fb0148530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.520+0000 7f1fb6800640 1 -- 172.21.15.2:0/2897170793 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fac009a20 con 0x7f1fb015d2c0 2024-08-17T02:23:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.521+0000 7fcc8aa00640 1 --2- 172.21.15.2:0/1822551440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc70004780 0x7fcc8c145100 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c010a00 tx=0x7fcc7c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.521+0000 7f29d3400640 1 -- 172.21.15.2:0/924243361 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc031400 con 0x7f29d406d7d0 2024-08-17T02:23:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.521+0000 7f29d3400640 1 -- 172.21.15.2:0/924243361 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc02d050 con 0x7f29d406d7d0 2024-08-17T02:23:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.521+0000 7f29d3400640 1 -- 172.21.15.2:0/924243361 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc031790 con 0x7f29d406d7d0 2024-08-17T02:23:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.521+0000 7f4167e00640 1 --2- 172.21.15.2:0/1444777243 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f41480652a0 0x7f4148067750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f41600117e0 tx=0x7f41680ab000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.520+0000 7f17a1e00640 1 -- 172.21.15.2:0/661902156 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1794009850 con 0x7f179c157e10 2024-08-17T02:23:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.521+0000 7f17a1400640 1 --2- 172.21.15.2:0/661902156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f179c0aae50 0x7f179c13f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.521+0000 7f17a0a00640 1 --2- 172.21.15.2:0/661902156 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f179c0cc0c0 0x7f179c1564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.522+0000 7fb1b4000640 1 -- 172.21.15.2:0/796158311 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ac0c70a0 con 0x7fb194003a50 2024-08-17T02:23:38.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.521+0000 7f17a1e00640 1 --2- 172.21.15.2:0/661902156 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f179c157e10 0x7f179c156a20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f179c06ca10 tx=0x7f1794036000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.522+0000 7f1fb6800640 1 --2- 172.21.15.2:0/2897170793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fb015d2c0 0x7f1fb00aab40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0099f0 tx=0x7f1fac037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.523+0000 7f857b800640 1 -- 172.21.15.2:0/2862735358 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f856c0056a0 con 0x7f856c051da0 2024-08-17T02:23:38.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.522+0000 7f1798c00640 1 -- 172.21.15.2:0/661902156 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179402c540 con 0x7f179c157e10 2024-08-17T02:23:38.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.522+0000 7f1798c00640 1 -- 172.21.15.2:0/661902156 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1794007e40 con 0x7f179c157e10 2024-08-17T02:23:38.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.522+0000 7f1798c00640 1 -- 172.21.15.2:0/661902156 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179403e6a0 con 0x7f179c157e10 2024-08-17T02:23:38.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.524+0000 7f17a2800640 1 -- 172.21.15.2:0/661902156 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179c1415c0 con 0x7f179c157e10 2024-08-17T02:23:38.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.524+0000 7f17a2800640 1 -- 172.21.15.2:0/661902156 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179c141b80 con 0x7f179c157e10 2024-08-17T02:23:38.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.523+0000 7fb1b4000640 1 -- 172.21.15.2:0/796158311 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1ac063fb0 con 0x7fb194003a50 2024-08-17T02:23:38.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.523+0000 7fb1a8c00640 1 -- 172.21.15.2:0/796158311 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb1a402d680 con 0x7fb194003a50 2024-08-17T02:23:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.522+0000 7f29db400640 1 -- 172.21.15.2:0/924243361 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29d406d7d0 msgr2=0x7f29d406dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.522+0000 7f29db400640 1 --2- 172.21.15.2:0/924243361 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29d406d7d0 0x7f29d406dbe0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009f20 tx=0x7f29cc009840 comp rx=0 tx=0).stop 2024-08-17T02:23:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.523+0000 7f29db400640 1 -- 172.21.15.2:0/924243361 shutdown_connections 2024-08-17T02:23:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.523+0000 7f29db400640 1 --2- 172.21.15.2:0/924243361 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29d406d7d0 0x7f29d406dbe0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.523+0000 7f29db400640 1 --2- 172.21.15.2:0/924243361 >> v2:172.21.15.145:3300/0 conn(0x7f29d415cdc0 0x7f29d40ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.523+0000 7f29db400640 1 -- 172.21.15.2:0/924243361 >> 172.21.15.2:0/924243361 conn(0x7f29d4066e60 msgr2=0x7f29d4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.523+0000 7f29db400640 1 -- 172.21.15.2:0/924243361 shutdown_connections 2024-08-17T02:23:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.523+0000 7f29db400640 1 -- 172.21.15.2:0/924243361 wait complete. 2024-08-17T02:23:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.523+0000 7f1fa9600640 1 -- 172.21.15.2:0/2897170793 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac031ad0 con 0x7f1fb015d2c0 2024-08-17T02:23:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.523+0000 7f1fa9600640 1 -- 172.21.15.2:0/2897170793 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac040070 con 0x7f1fb015d2c0 2024-08-17T02:23:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.523+0000 7f1fa9600640 1 -- 172.21.15.2:0/2897170793 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac031e60 con 0x7f1fb015d2c0 2024-08-17T02:23:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.523+0000 7f1fb8800640 1 -- 172.21.15.2:0/2897170793 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb00a5230 con 0x7f1fb015d2c0 2024-08-17T02:23:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.523+0000 7f1fb8800640 1 -- 172.21.15.2:0/2897170793 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb00aa620 con 0x7f1fb015d2c0 2024-08-17T02:23:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.522+0000 7f9a7fe00640 1 Processor -- start 2024-08-17T02:23:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.523+0000 7f9a7fe00640 1 -- start start 2024-08-17T02:23:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.525+0000 7fb1a8c00640 1 --2- 172.21.15.2:0/796158311 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb18c065180 0x7fb18c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.525+0000 7fb1a8c00640 1 -- 172.21.15.2:0/796158311 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb1a40a4e20 con 0x7fb194003a50 2024-08-17T02:23:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.525+0000 7f29db400640 1 Processor -- start 2024-08-17T02:23:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.524+0000 7f8567e00640 1 -- 172.21.15.2:0/2862735358 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f856801a400 con 0x7f856c051da0 2024-08-17T02:23:38.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.525+0000 7fb1b0c00640 1 --2- 172.21.15.2:0/796158311 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb18c065180 0x7fb18c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.525+0000 7f1fb8800640 1 -- 172.21.15.2:0/2897170793 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f8c005210 con 0x7f1fb015d2c0 2024-08-17T02:23:38.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.526+0000 7f17a2800640 1 -- 172.21.15.2:0/661902156 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f179c070720 con 0x7f179c157e10 2024-08-17T02:23:38.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.526+0000 7fb1b0c00640 1 --2- 172.21.15.2:0/796158311 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb18c065180 0x7fb18c067630 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0006cd0 tx=0x7fb1a0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.526+0000 7f9a7fe00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9a780b03c0 0x7f9a780b0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.526+0000 7f9a7fe00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a780aff30 con 0x7f9a7806d7d0 2024-08-17T02:23:38.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.526+0000 7f9a7fe00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a780af320 con 0x7f9a7815cdc0 2024-08-17T02:23:38.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.526+0000 7f9a7fe00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a780af600 con 0x7f9a780b03c0 2024-08-17T02:23:38.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.526+0000 7f9a7ca00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9a780b03c0 0x7f9a780b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.526+0000 7f9a7ca00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9a780b03c0 0x7f9a780b0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:47522/0 (socket says 172.21.15.2:47522) 2024-08-17T02:23:38.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.526+0000 7f9a7ca00640 1 -- 172.21.15.2:0/3688839865 learned_addr learned my addr 172.21.15.2:0/3688839865 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.526+0000 7f8567e00640 1 --2- 172.21.15.2:0/2862735358 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8554065220 0x7f85540676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.526+0000 7f8567e00640 1 -- 172.21.15.2:0/2862735358 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8568081d20 con 0x7f856c051da0 2024-08-17T02:23:38.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.526+0000 7f8578e00640 1 --2- 172.21.15.2:0/2862735358 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8554065220 0x7f85540676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.525+0000 7f29db400640 1 -- start start 2024-08-17T02:23:38.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.526+0000 7f29db400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29d406d7d0 0x7f29d4156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.527+0000 7f29db400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29d40aeda0 0x7f29d41547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.527+0000 7f9a7ca00640 1 -- 172.21.15.2:0/3688839865 >> v1:172.21.15.145:6789/0 conn(0x7f9a7815cdc0 legacy=0x7f9a780ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.527+0000 7f9a7ca00640 1 -- 172.21.15.2:0/3688839865 >> v1:172.21.15.2:6789/0 conn(0x7f9a7806d7d0 legacy=0x7f9a78160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.527+0000 7f9a7ca00640 1 -- 172.21.15.2:0/3688839865 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a780af8e0 con 0x7f9a780b03c0 2024-08-17T02:23:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.527+0000 7f29db400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f29d415cdc0 0x7f29d416d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.527+0000 7f29db400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d4157bc0 con 0x7f29d40aeda0 2024-08-17T02:23:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.527+0000 7f29db400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d4151990 con 0x7f29d415cdc0 2024-08-17T02:23:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.527+0000 7f29db400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d4157320 con 0x7f29d406d7d0 2024-08-17T02:23:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.527+0000 7f29d8a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29d406d7d0 0x7f29d4156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.527+0000 7f29d8a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29d406d7d0 0x7f29d4156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47240/0 (socket says 172.21.15.2:47240) 2024-08-17T02:23:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.527+0000 7f29d8a00640 1 -- 172.21.15.2:0/88891819 learned_addr learned my addr 172.21.15.2:0/88891819 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.527+0000 7f29d9400640 1 --2- 172.21.15.2:0/88891819 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f29d415cdc0 0x7f29d416d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.527+0000 7f1fa9600640 1 -- 172.21.15.2:0/2897170793 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1fac042030 con 0x7f1fb015d2c0 2024-08-17T02:23:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.527+0000 7f29d3e00640 1 --2- 172.21.15.2:0/88891819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29d40aeda0 0x7f29d41547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.527+0000 7f29d8a00640 1 -- 172.21.15.2:0/88891819 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f29d415cdc0 msgr2=0x7f29d416d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.527+0000 7f29d8a00640 1 --2- 172.21.15.2:0/88891819 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f29d415cdc0 0x7f29d416d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.527+0000 7f29d8a00640 1 -- 172.21.15.2:0/88891819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29d40aeda0 msgr2=0x7f29d41547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.527+0000 7f29d8a00640 1 --2- 172.21.15.2:0/88891819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29d40aeda0 0x7f29d41547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.527+0000 7f29d8a00640 1 -- 172.21.15.2:0/88891819 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29cc009ae0 con 0x7f29d406d7d0 2024-08-17T02:23:38.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.527+0000 7f29d9400640 1 --2- 172.21.15.2:0/88891819 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f29d415cdc0 0x7f29d416d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:38.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.527+0000 7f29d3e00640 1 --2- 172.21.15.2:0/88891819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29d40aeda0 0x7f29d41547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:38.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.528+0000 7f9a7ca00640 1 --2- 172.21.15.2:0/3688839865 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a780b03c0 0x7f9a780b0840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9a64009910 tx=0x7f9a640091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=606587ddd1e149a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.528+0000 7f29d8a00640 1 --2- 172.21.15.2:0/88891819 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29d406d7d0 0x7f29d4156c90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f29c000d810 tx=0x7f29c0008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.528+0000 7f29c7e00640 1 -- 172.21.15.2:0/88891819 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c000de00 con 0x7f29d406d7d0 2024-08-17T02:23:38.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.528+0000 7f29c7e00640 1 -- 172.21.15.2:0/88891819 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c00098b0 con 0x7f29d406d7d0 2024-08-17T02:23:38.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.528+0000 7f29c7e00640 1 -- 172.21.15.2:0/88891819 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c0009c70 con 0x7f29d406d7d0 2024-08-17T02:23:38.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.528+0000 7f1fa9600640 1 --2- 172.21.15.2:0/2897170793 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1f940652a0 0x7f1f94067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.529+0000 7f1fa9600640 1 -- 172.21.15.2:0/2897170793 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1fac0a3f90 con 0x7f1fb015d2c0 2024-08-17T02:23:38.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.529+0000 7f29db400640 1 -- 172.21.15.2:0/88891819 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d4157600 con 0x7f29d406d7d0 2024-08-17T02:23:38.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.529+0000 7f29db400640 1 -- 172.21.15.2:0/88891819 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d414f930 con 0x7f29d406d7d0 2024-08-17T02:23:38.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.529+0000 7f8578e00640 1 --2- 172.21.15.2:0/2862735358 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8554065220 0x7f85540676d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8560009210 tx=0x7f8560032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.529+0000 7f1fb5e00640 1 --2- 172.21.15.2:0/2897170793 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1f940652a0 0x7f1f94067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.530+0000 7f29db400640 1 -- 172.21.15.2:0/88891819 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d4151760 con 0x7f29d406d7d0 2024-08-17T02:23:38.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.530+0000 7f1fb5e00640 1 --2- 172.21.15.2:0/2897170793 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1f940652a0 0x7f1f94067750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4009740 tx=0x7f1fa4006c50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.530+0000 7f415b400640 1 -- 172.21.15.2:0/1444777243 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f415c04fc70 con 0x7f41600e6330 2024-08-17T02:23:38.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.530+0000 7fcc82000640 1 -- 172.21.15.2:0/1822551440 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c00e9c0 con 0x7fcc70004780 2024-08-17T02:23:38.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.531+0000 7fcc91e00640 1 -- 172.21.15.2:0/1822551440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc8c14a0a0 con 0x7fcc70004780 2024-08-17T02:23:38.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.531+0000 7fcc91e00640 1 -- 172.21.15.2:0/1822551440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8c14a660 con 0x7fcc70004780 2024-08-17T02:23:38.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.531+0000 7fb1a8c00640 1 -- 172.21.15.2:0/796158311 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb1a40a8060 con 0x7fb194003a50 2024-08-17T02:23:38.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.531+0000 7fcc82000640 1 -- 172.21.15.2:0/1822551440 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c006bc0 con 0x7fcc70004780 2024-08-17T02:23:38.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.531+0000 7f29c7e00640 1 -- 172.21.15.2:0/88891819 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f29c0014640 con 0x7f29d406d7d0 2024-08-17T02:23:38.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.532+0000 7fcc82000640 1 -- 172.21.15.2:0/1822551440 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c00ed30 con 0x7fcc70004780 2024-08-17T02:23:38.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.532+0000 7f1798c00640 1 -- 172.21.15.2:0/661902156 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f179403ead0 con 0x7f179c157e10 2024-08-17T02:23:38.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.532+0000 7f29c7e00640 1 --2- 172.21.15.2:0/88891819 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f29b4065220 0x7f29b40676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.532+0000 7f29c7e00640 1 -- 172.21.15.2:0/88891819 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f29c00828a0 con 0x7f29d406d7d0 2024-08-17T02:23:38.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.533+0000 7f29d3e00640 1 --2- 172.21.15.2:0/88891819 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f29b4065220 0x7f29b40676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.533+0000 7fcc91e00640 1 -- 172.21.15.2:0/1822551440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc64005210 con 0x7fcc70004780 2024-08-17T02:23:38.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.533+0000 7f1798c00640 1 --2- 172.21.15.2:0/661902156 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f177c065220 0x7f177c0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.533+0000 7f29d3e00640 1 --2- 172.21.15.2:0/88891819 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f29b4065220 0x7f29b40676d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f29c8007fd0 tx=0x7f29c8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.534+0000 7fcc82000640 1 -- 172.21.15.2:0/1822551440 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcc7c01d450 con 0x7fcc70004780 2024-08-17T02:23:38.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.534+0000 7f17a1400640 1 --2- 172.21.15.2:0/661902156 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f177c065220 0x7f177c0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.534+0000 7fcc82000640 1 --2- 172.21.15.2:0/1822551440 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fcc6c0651e0 0x7fcc6c067690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.534+0000 7f17a1400640 1 --2- 172.21.15.2:0/661902156 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f177c065220 0x7f177c0676d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1790009aa0 tx=0x7f1790008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.535+0000 7fcc82000640 1 -- 172.21.15.2:0/1822551440 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcc7c054810 con 0x7fcc70004780 2024-08-17T02:23:38.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.535+0000 7fcc8a000640 1 --2- 172.21.15.2:0/1822551440 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fcc6c0651e0 0x7fcc6c067690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.535+0000 7f9a77e00640 1 -- 172.21.15.2:0/3688839865 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6402ad70 con 0x7f9a780b03c0 2024-08-17T02:23:38.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.536+0000 7f1fa9600640 1 -- 172.21.15.2:0/2897170793 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1fac0720f0 con 0x7f1fb015d2c0 2024-08-17T02:23:38.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.536+0000 7fcc8a000640 1 --2- 172.21.15.2:0/1822551440 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fcc6c0651e0 0x7fcc6c067690 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcc7801d370 tx=0x7fcc78047000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.538+0000 7f29c7e00640 1 -- 172.21.15.2:0/88891819 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f29c0050a00 con 0x7f29d406d7d0 2024-08-17T02:23:38.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.540+0000 7f1798c00640 1 -- 172.21.15.2:0/661902156 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1794047ea0 con 0x7f179c157e10 2024-08-17T02:23:38.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.540+0000 7f9a77e00640 1 -- 172.21.15.2:0/3688839865 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a64032440 con 0x7f9a780b03c0 2024-08-17T02:23:38.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.540+0000 7f9a77e00640 1 -- 172.21.15.2:0/3688839865 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a640327e0 con 0x7f9a780b03c0 2024-08-17T02:23:38.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.540+0000 7fcc82000640 1 -- 172.21.15.2:0/1822551440 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcc7c0512e0 con 0x7fcc70004780 2024-08-17T02:23:38.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.541+0000 7f9a7fe00640 1 -- 172.21.15.2:0/3688839865 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a780b03c0 msgr2=0x7f9a780b0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.541+0000 7f9a7fe00640 1 --2- 172.21.15.2:0/3688839865 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a780b03c0 0x7f9a780b0840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9a64009910 tx=0x7f9a640091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.541+0000 7f9a7fe00640 1 -- 172.21.15.2:0/3688839865 shutdown_connections 2024-08-17T02:23:38.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.541+0000 7f9a7fe00640 1 --2- 172.21.15.2:0/3688839865 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a780b03c0 0x7f9a780b0840 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.541+0000 7f9a7fe00640 1 -- 172.21.15.2:0/3688839865 >> 172.21.15.2:0/3688839865 conn(0x7f9a78066e60 msgr2=0x7f9a78067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.541+0000 7f9a7fe00640 1 -- 172.21.15.2:0/3688839865 shutdown_connections 2024-08-17T02:23:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.540+0000 7f8567e00640 1 -- 172.21.15.2:0/2862735358 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f856804fe40 con 0x7f856c051da0 2024-08-17T02:23:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.542+0000 7f9a7fe00640 1 -- 172.21.15.2:0/3688839865 wait complete. 2024-08-17T02:23:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.544+0000 7f1798c00640 1 -- 172.21.15.2:0/661902156 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1794072940 con 0x7f179c157e10 2024-08-17T02:23:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.544+0000 7f9a7fe00640 1 Processor -- start 2024-08-17T02:23:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.547+0000 7f9a7fe00640 1 -- start start 2024-08-17T02:23:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.553+0000 7f9a7fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a7806d7d0 0x7f9a7814aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.553+0000 7f9a7fe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a780b03c0 0x7f9a780c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.553+0000 7f9a7fe00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a7815cdc0 0x7f9a78170ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.554+0000 7f9a7fe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a780a9760 con 0x7f9a7806d7d0 2024-08-17T02:23:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.554+0000 7f9a7fe00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a78171e10 con 0x7f9a780b03c0 2024-08-17T02:23:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.554+0000 7f9a7fe00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a780a9970 con 0x7f9a7815cdc0 2024-08-17T02:23:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.554+0000 7f9a7d400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a7806d7d0 0x7f9a7814aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.555+0000 7f9a7d400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a7806d7d0 0x7f9a7814aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54008/0 (socket says 172.21.15.2:54008) 2024-08-17T02:23:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.555+0000 7f9a7d400640 1 -- 172.21.15.2:0/2974539827 learned_addr learned my addr 172.21.15.2:0/2974539827 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.555+0000 7f9a7ca00640 1 --2- 172.21.15.2:0/2974539827 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a780b03c0 0x7f9a780c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.556+0000 7f9a7d400640 1 -- 172.21.15.2:0/2974539827 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a7815cdc0 msgr2=0x7f9a78170ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.556+0000 7f9a7d400640 1 --2- 172.21.15.2:0/2974539827 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a7815cdc0 0x7f9a78170ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.556+0000 7f9a7d400640 1 -- 172.21.15.2:0/2974539827 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a780b03c0 msgr2=0x7f9a780c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.556+0000 7f9a7d400640 1 --2- 172.21.15.2:0/2974539827 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a780b03c0 0x7f9a780c07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.556+0000 7f9a7d400640 1 -- 172.21.15.2:0/2974539827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a64009450 con 0x7f9a7806d7d0 2024-08-17T02:23:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.557+0000 7f9a7d400640 1 --2- 172.21.15.2:0/2974539827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a7806d7d0 0x7f9a7814aa50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00b4f0 tx=0x7f9a6c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.557+0000 7f9a74c00640 1 -- 172.21.15.2:0/2974539827 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c00f510 con 0x7f9a7806d7d0 2024-08-17T02:23:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.557+0000 7f9a74c00640 1 -- 172.21.15.2:0/2974539827 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6c00f690 con 0x7f9a7806d7d0 2024-08-17T02:23:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.557+0000 7f9a74c00640 1 -- 172.21.15.2:0/2974539827 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c00fa50 con 0x7f9a7806d7d0 2024-08-17T02:23:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.558+0000 7f9a7fe00640 1 -- 172.21.15.2:0/2974539827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a780a9c50 con 0x7f9a7806d7d0 2024-08-17T02:23:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.558+0000 7f9a7fe00640 1 -- 172.21.15.2:0/2974539827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a780aa210 con 0x7f9a7806d7d0 2024-08-17T02:23:38.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.560+0000 7f9a7fe00640 1 -- 172.21.15.2:0/2974539827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a78063fb0 con 0x7f9a7806d7d0 2024-08-17T02:23:38.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.569+0000 7f9a74c00640 1 -- 172.21.15.2:0/2974539827 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9a6c024430 con 0x7f9a7806d7d0 2024-08-17T02:23:38.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.575+0000 7f9a74c00640 1 --2- 172.21.15.2:0/2974539827 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9a580652d0 0x7f9a58067780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.575+0000 7f9a74c00640 1 -- 172.21.15.2:0/2974539827 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9a6c082a30 con 0x7f9a7806d7d0 2024-08-17T02:23:38.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.575+0000 7f9a7ca00640 1 --2- 172.21.15.2:0/2974539827 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9a580652d0 0x7f9a58067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.575+0000 7f9a74c00640 1 -- 172.21.15.2:0/2974539827 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9a6c0ade40 con 0x7f9a7806d7d0 2024-08-17T02:23:38.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.576+0000 7f9a7ca00640 1 --2- 172.21.15.2:0/2974539827 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9a580652d0 0x7f9a58067780 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9a64034000 tx=0x7f9a64032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.951+0000 7fb1b4000640 1 -- 172.21.15.2:0/796158311 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fb1ac0af070 con 0x7fb194003a50 2024-08-17T02:23:38.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.951+0000 7fb1a8c00640 1 -- 172.21.15.2:0/796158311 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb1a4046020 con 0x7fb194003a50 2024-08-17T02:23:38.952 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2024-08-17T02:23:38.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.953+0000 7f416d800640 1 -- 172.21.15.2:0/1444777243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f41440054c0 con 0x7f41600e6330 2024-08-17T02:23:38.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.954+0000 7fb1b4000640 1 -- 172.21.15.2:0/796158311 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb18c065180 msgr2=0x7fb18c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.954+0000 7fb1b4000640 1 --2- 172.21.15.2:0/796158311 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb18c065180 0x7fb18c067630 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0006cd0 tx=0x7fb1a0008040 comp rx=0 tx=0).stop 2024-08-17T02:23:38.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.954+0000 7fb1b4000640 1 -- 172.21.15.2:0/796158311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb194003a50 msgr2=0x7fb1ac16f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.954+0000 7fb1b4000640 1 --2- 172.21.15.2:0/796158311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb194003a50 0x7fb1ac16f9f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4030000 tx=0x7fb1a4034000 comp rx=0 tx=0).stop 2024-08-17T02:23:38.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.955+0000 7fb1b4000640 1 -- 172.21.15.2:0/796158311 shutdown_connections 2024-08-17T02:23:38.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.955+0000 7fb1b4000640 1 --2- 172.21.15.2:0/796158311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1ac15af10 0x7fb1ac16cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.955+0000 7fb1b4000640 1 --2- 172.21.15.2:0/796158311 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb18c065180 0x7fb18c067630 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.955+0000 7fb1b4000640 1 --2- 172.21.15.2:0/796158311 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb1ac16de00 0x7fb1ac15a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.955+0000 7fb1b4000640 1 --2- 172.21.15.2:0/796158311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb194003a50 0x7fb1ac16f9f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.955+0000 7fb1b4000640 1 -- 172.21.15.2:0/796158311 >> 172.21.15.2:0/796158311 conn(0x7fb1ac06e590 msgr2=0x7fb1ac0ce040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.955+0000 7fb1b4000640 1 -- 172.21.15.2:0/796158311 shutdown_connections 2024-08-17T02:23:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.955+0000 7fb1b4000640 1 -- 172.21.15.2:0/796158311 wait complete. 2024-08-17T02:23:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.957+0000 7f415b400640 1 -- 172.21.15.2:0/1444777243 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f415c053290 con 0x7f41600e6330 2024-08-17T02:23:38.958 INFO:teuthology.orchestra.run.smithi002.stdout:55834574851 2024-08-17T02:23:38.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.958+0000 7f1fb8800640 1 -- 172.21.15.2:0/2897170793 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1f8c0054c0 con 0x7f1fb015d2c0 2024-08-17T02:23:38.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.958+0000 7f1fa9600640 1 -- 172.21.15.2:0/2897170793 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1fac075710 con 0x7f1fb015d2c0 2024-08-17T02:23:38.960 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2024-08-17T02:23:38.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.963+0000 7f416d800640 1 -- 172.21.15.2:0/1444777243 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f41480652a0 msgr2=0x7f4148067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.963+0000 7f416d800640 1 --2- 172.21.15.2:0/1444777243 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f41480652a0 0x7f4148067750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f41600117e0 tx=0x7f41680ab000 comp rx=0 tx=0).stop 2024-08-17T02:23:38.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.963+0000 7f416d800640 1 -- 172.21.15.2:0/1444777243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41600e6330 msgr2=0x7f41600ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.963+0000 7f416d800640 1 --2- 172.21.15.2:0/1444777243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41600e6330 0x7f41600ce370 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f415c00c4c0 tx=0x7f415c007dc0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.964+0000 7f416d800640 1 -- 172.21.15.2:0/1444777243 shutdown_connections 2024-08-17T02:23:38.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.964+0000 7f416d800640 1 --2- 172.21.15.2:0/1444777243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41600e6330 0x7f41600ce370 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.964+0000 7f416d800640 1 --2- 172.21.15.2:0/1444777243 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f41480652a0 0x7f4148067750 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f41600117e0 tx=0x7f41680ab000 comp rx=0 tx=0).stop 2024-08-17T02:23:38.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.964+0000 7f416d800640 1 --2- 172.21.15.2:0/1444777243 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41600e22c0 0x7f416003bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.964+0000 7f416d800640 1 --2- 172.21.15.2:0/1444777243 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41600e1ef0 0x7f416003dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.965+0000 7f416d800640 1 -- 172.21.15.2:0/1444777243 >> 172.21.15.2:0/1444777243 conn(0x7f4160055a10 msgr2=0x7f416004f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.966+0000 7fcc91e00640 1 -- 172.21.15.2:0/1822551440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcc64005790 con 0x7fcc70004780 2024-08-17T02:23:38.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.966+0000 7f416d800640 1 -- 172.21.15.2:0/1444777243 shutdown_connections 2024-08-17T02:23:38.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.966+0000 7f416d800640 1 -- 172.21.15.2:0/1444777243 wait complete. 2024-08-17T02:23:38.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.966+0000 7f1fb8800640 1 -- 172.21.15.2:0/2897170793 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1f940652a0 msgr2=0x7f1f94067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.966+0000 7f1fb8800640 1 --2- 172.21.15.2:0/2897170793 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1f940652a0 0x7f1f94067750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4009740 tx=0x7f1fa4006c50 comp rx=0 tx=0).stop 2024-08-17T02:23:38.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.966+0000 7f1fb8800640 1 -- 172.21.15.2:0/2897170793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fb015d2c0 msgr2=0x7f1fb00aab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.966+0000 7f1fb8800640 1 --2- 172.21.15.2:0/2897170793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fb015d2c0 0x7f1fb00aab40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0099f0 tx=0x7f1fac037000 comp rx=0 tx=0).stop 2024-08-17T02:23:38.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.967+0000 7fcc82000640 1 -- 172.21.15.2:0/1822551440 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcc7c051480 con 0x7fcc70004780 2024-08-17T02:23:38.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.967+0000 7f1fb8800640 1 -- 172.21.15.2:0/2897170793 shutdown_connections 2024-08-17T02:23:38.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.967+0000 7f1fb8800640 1 --2- 172.21.15.2:0/2897170793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fb015d2c0 0x7f1fb00aab40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.968 INFO:teuthology.orchestra.run.smithi002.stdout:55834574851 2024-08-17T02:23:38.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.967+0000 7f1fb8800640 1 --2- 172.21.15.2:0/2897170793 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1f940652a0 0x7f1f94067750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.967+0000 7f1fb8800640 1 --2- 172.21.15.2:0/2897170793 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fb015cef0 0x7f1fb00a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.967+0000 7f1fb8800640 1 --2- 172.21.15.2:0/2897170793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fb00ca5c0 0x7f1fb0148530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.967+0000 7f1fb8800640 1 -- 172.21.15.2:0/2897170793 >> 172.21.15.2:0/2897170793 conn(0x7f1fb0066e60 msgr2=0x7f1fb015fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.968+0000 7f29db400640 1 -- 172.21.15.2:0/88891819 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f29d4063fb0 con 0x7f29d406d7d0 2024-08-17T02:23:38.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.968+0000 7f1fb8800640 1 -- 172.21.15.2:0/2897170793 shutdown_connections 2024-08-17T02:23:38.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.968+0000 7f1fb8800640 1 -- 172.21.15.2:0/2897170793 wait complete. 2024-08-17T02:23:38.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.968+0000 7f29c7e00640 1 -- 172.21.15.2:0/88891819 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f29c0054020 con 0x7f29d406d7d0 2024-08-17T02:23:38.971 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2024-08-17T02:23:38.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.971+0000 7fcc91e00640 1 -- 172.21.15.2:0/1822551440 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fcc6c0651e0 msgr2=0x7fcc6c067690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.971+0000 7fcc91e00640 1 --2- 172.21.15.2:0/1822551440 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fcc6c0651e0 0x7fcc6c067690 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcc7801d370 tx=0x7fcc78047000 comp rx=0 tx=0).stop 2024-08-17T02:23:38.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.971+0000 7fcc91e00640 1 -- 172.21.15.2:0/1822551440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc70004780 msgr2=0x7fcc8c145100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.971+0000 7fcc91e00640 1 --2- 172.21.15.2:0/1822551440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc70004780 0x7fcc8c145100 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c010a00 tx=0x7fcc7c008040 comp rx=0 tx=0).stop 2024-08-17T02:23:38.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.971+0000 7f17a2800640 1 -- 172.21.15.2:0/661902156 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f179c070720 con 0x7f179c157e10 2024-08-17T02:23:38.973 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2024-08-17T02:23:38.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.972+0000 7f1798c00640 1 -- 172.21.15.2:0/661902156 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1794075f60 con 0x7f179c157e10 2024-08-17T02:23:38.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.973+0000 7f29db400640 1 -- 172.21.15.2:0/88891819 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f29b4065220 msgr2=0x7f29b40676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.973+0000 7f29db400640 1 --2- 172.21.15.2:0/88891819 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f29b4065220 0x7f29b40676d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f29c8007fd0 tx=0x7f29c8009040 comp rx=0 tx=0).stop 2024-08-17T02:23:38.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.973+0000 7f29db400640 1 -- 172.21.15.2:0/88891819 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29d406d7d0 msgr2=0x7f29d4156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.973+0000 7f29db400640 1 --2- 172.21.15.2:0/88891819 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29d406d7d0 0x7f29d4156c90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f29c000d810 tx=0x7f29c0008040 comp rx=0 tx=0).stop 2024-08-17T02:23:38.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.973+0000 7f29db400640 1 -- 172.21.15.2:0/88891819 shutdown_connections 2024-08-17T02:23:38.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.973+0000 7f29db400640 1 --2- 172.21.15.2:0/88891819 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f29d415cdc0 0x7f29d416d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.973+0000 7f29db400640 1 --2- 172.21.15.2:0/88891819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29d40aeda0 0x7f29d41547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.973+0000 7f29db400640 1 --2- 172.21.15.2:0/88891819 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f29b4065220 0x7f29b40676d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.973+0000 7f29db400640 1 --2- 172.21.15.2:0/88891819 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29d406d7d0 0x7f29d4156c90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.973+0000 7f29db400640 1 -- 172.21.15.2:0/88891819 >> 172.21.15.2:0/88891819 conn(0x7f29d4066e60 msgr2=0x7f29d406b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.973+0000 7fcc91e00640 1 -- 172.21.15.2:0/1822551440 shutdown_connections 2024-08-17T02:23:38.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.973+0000 7fcc91e00640 1 --2- 172.21.15.2:0/1822551440 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fcc6c0651e0 0x7fcc6c067690 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.973+0000 7fcc91e00640 1 --2- 172.21.15.2:0/1822551440 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcc8c0c5bd0 0x7fcc8c0c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.973+0000 7fcc91e00640 1 --2- 172.21.15.2:0/1822551440 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcc8c0c97f0 0x7fcc8c1467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.973+0000 7fcc91e00640 1 --2- 172.21.15.2:0/1822551440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc70004780 0x7fcc8c145100 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.973+0000 7fcc91e00640 1 -- 172.21.15.2:0/1822551440 >> 172.21.15.2:0/1822551440 conn(0x7fcc8c068680 msgr2=0x7fcc8c146060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.974+0000 7fcc91e00640 1 -- 172.21.15.2:0/1822551440 shutdown_connections 2024-08-17T02:23:38.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.974+0000 7f29db400640 1 -- 172.21.15.2:0/88891819 shutdown_connections 2024-08-17T02:23:38.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.974+0000 7f29db400640 1 -- 172.21.15.2:0/88891819 wait complete. 2024-08-17T02:23:38.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.974+0000 7fcc91e00640 1 -- 172.21.15.2:0/1822551440 wait complete. 2024-08-17T02:23:38.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.974+0000 7f857b800640 1 -- 172.21.15.2:0/2862735358 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f856c035740 con 0x7f856c051da0 2024-08-17T02:23:38.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.975+0000 7f8567e00640 1 -- 172.21.15.2:0/2862735358 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8568053460 con 0x7f856c051da0 2024-08-17T02:23:38.977 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2024-08-17T02:23:38.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.977+0000 7f17a2800640 1 -- 172.21.15.2:0/661902156 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f177c065220 msgr2=0x7f177c0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.977+0000 7f17a2800640 1 --2- 172.21.15.2:0/661902156 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f177c065220 0x7f177c0676d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1790009aa0 tx=0x7f1790008040 comp rx=0 tx=0).stop 2024-08-17T02:23:38.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.977+0000 7f17a2800640 1 -- 172.21.15.2:0/661902156 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f179c157e10 msgr2=0x7f179c156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.977+0000 7f17a2800640 1 --2- 172.21.15.2:0/661902156 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f179c157e10 0x7f179c156a20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f179c06ca10 tx=0x7f1794036000 comp rx=0 tx=0).stop 2024-08-17T02:23:38.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.979+0000 7f17a2800640 1 -- 172.21.15.2:0/661902156 shutdown_connections 2024-08-17T02:23:38.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.979+0000 7f17a2800640 1 --2- 172.21.15.2:0/661902156 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f179c157e10 0x7f179c156a20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.979+0000 7f17a2800640 1 --2- 172.21.15.2:0/661902156 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f177c065220 0x7f177c0676d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.979+0000 7f17a2800640 1 --2- 172.21.15.2:0/661902156 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f179c0cc0c0 0x7f179c1564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.979+0000 7f17a2800640 1 --2- 172.21.15.2:0/661902156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f179c0aae50 0x7f179c13f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.979+0000 7f17a2800640 1 -- 172.21.15.2:0/661902156 >> 172.21.15.2:0/661902156 conn(0x7f179c0678e0 msgr2=0x7f179c154300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.979+0000 7f857b800640 1 -- 172.21.15.2:0/2862735358 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8554065220 msgr2=0x7f85540676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.979+0000 7f857b800640 1 --2- 172.21.15.2:0/2862735358 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8554065220 0x7f85540676d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8560009210 tx=0x7f8560032000 comp rx=0 tx=0).stop 2024-08-17T02:23:38.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.979+0000 7f857b800640 1 -- 172.21.15.2:0/2862735358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f856c051da0 msgr2=0x7f856c0cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.979+0000 7f857b800640 1 --2- 172.21.15.2:0/2862735358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f856c051da0 0x7f856c0cd910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8568009fd0 tx=0x7f8568009060 comp rx=0 tx=0).stop 2024-08-17T02:23:38.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.979+0000 7f857b800640 1 -- 172.21.15.2:0/2862735358 shutdown_connections 2024-08-17T02:23:38.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.979+0000 7f857b800640 1 --2- 172.21.15.2:0/2862735358 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8554065220 0x7f85540676d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.979+0000 7f857b800640 1 --2- 172.21.15.2:0/2862735358 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f856c0e0240 0x7f856c0ddb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.979+0000 7f857b800640 1 --2- 172.21.15.2:0/2862735358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f856c051da0 0x7f856c0cd910 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.979+0000 7f857b800640 1 --2- 172.21.15.2:0/2862735358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f856c035960 0x7f856c050b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.979+0000 7f857b800640 1 -- 172.21.15.2:0/2862735358 >> 172.21.15.2:0/2862735358 conn(0x7f856c00a800 msgr2=0x7f856c04bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.980+0000 7f17a2800640 1 -- 172.21.15.2:0/661902156 shutdown_connections 2024-08-17T02:23:38.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.982+0000 7f17a2800640 1 -- 172.21.15.2:0/661902156 wait complete. 2024-08-17T02:23:38.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.979+0000 7f857b800640 1 -- 172.21.15.2:0/2862735358 shutdown_connections 2024-08-17T02:23:38.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.979+0000 7f857b800640 1 -- 172.21.15.2:0/2862735358 wait complete. 2024-08-17T02:23:38.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2024-08-17T02:23:38.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.990+0000 7f9a7fe00640 1 -- 172.21.15.2:0/2974539827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9a7806e4c0 con 0x7f9a7806d7d0 2024-08-17T02:23:38.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.996+0000 7f9a74c00640 1 -- 172.21.15.2:0/2974539827 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9a6c050b50 con 0x7f9a7806d7d0 2024-08-17T02:23:38.997 INFO:teuthology.orchestra.run.smithi002.stdout:55834574851 2024-08-17T02:23:38.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2024-08-17T02:23:38.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-08-17T02:23:38.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.999+0000 7f9a7fe00640 1 -- 172.21.15.2:0/2974539827 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9a580652d0 msgr2=0x7f9a58067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.999+0000 7f9a7fe00640 1 --2- 172.21.15.2:0/2974539827 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9a580652d0 0x7f9a58067780 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9a64034000 tx=0x7f9a64032000 comp rx=0 tx=0).stop 2024-08-17T02:23:38.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.999+0000 7f9a7fe00640 1 -- 172.21.15.2:0/2974539827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a7806d7d0 msgr2=0x7f9a7814aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:38.999+0000 7f9a7fe00640 1 --2- 172.21.15.2:0/2974539827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a7806d7d0 0x7f9a7814aa50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00b4f0 tx=0x7f9a6c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:39.000+0000 7f9a7fe00640 1 -- 172.21.15.2:0/2974539827 shutdown_connections 2024-08-17T02:23:39.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:39.000+0000 7f9a7fe00640 1 --2- 172.21.15.2:0/2974539827 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9a580652d0 0x7f9a58067780 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:39.000+0000 7f9a7fe00640 1 --2- 172.21.15.2:0/2974539827 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a7815cdc0 0x7f9a78170ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:39.000+0000 7f9a7fe00640 1 --2- 172.21.15.2:0/2974539827 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a780b03c0 0x7f9a780c07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:39.000+0000 7f9a7fe00640 1 --2- 172.21.15.2:0/2974539827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a7806d7d0 0x7f9a7814aa50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:39.000+0000 7f9a7fe00640 1 -- 172.21.15.2:0/2974539827 >> 172.21.15.2:0/2974539827 conn(0x7f9a78066e60 msgr2=0x7f9a78159ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:39.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:39.000+0000 7f9a7fe00640 1 -- 172.21.15.2:0/2974539827 shutdown_connections 2024-08-17T02:23:39.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:39.000+0000 7f9a7fe00640 1 -- 172.21.15.2:0/2974539827 wait complete. 2024-08-17T02:23:39.001 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2024-08-17T02:23:39.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.1 2024-08-17T02:23:39.007 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-08-17T02:23:39.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2024-08-17T02:23:39.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.5 2024-08-17T02:23:39.985 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:23:39.998 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:23:39.999 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:23:40.002 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:23:40.004 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:23:40.008 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:23:40.008 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:23:40.019 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:23:40.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.230+0000 7f1c65e00640 1 Processor -- start 2024-08-17T02:23:40.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.230+0000 7f1c65e00640 1 -- start start 2024-08-17T02:23:40.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.232+0000 7f1c65e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1c580d86d0 0x7f1c58005e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.232+0000 7f1c65e00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1c5804f1d0 0x7f1c580de700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.232+0000 7f1c65e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c58053840 con 0x7f1c5804fda0 2024-08-17T02:23:40.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.232+0000 7f1c65e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c580df740 con 0x7f1c580d86d0 2024-08-17T02:23:40.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.232+0000 7f1c65e00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c580dec40 con 0x7f1c5804f1d0 2024-08-17T02:23:40.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.232+0000 7f1c65400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1c5804fda0 0x7f1c580501d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36106/0 (socket says 172.21.15.2:36106) 2024-08-17T02:23:40.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.233+0000 7f1c65400640 1 -- 172.21.15.2:0/588609061 learned_addr learned my addr 172.21.15.2:0/588609061 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:40.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.233+0000 7f1c64a00640 1 --2- 172.21.15.2:0/588609061 >> v2:172.21.15.2:3300/0 conn(0x7f1c580d86d0 0x7f1c58005e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.235+0000 7f1c64a00640 1 -- 172.21.15.2:0/588609061 >> v2:172.21.15.145:3300/0 conn(0x7f1c5804f1d0 msgr2=0x7f1c580de700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:40.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.235+0000 7f1c64a00640 1 --2- 172.21.15.2:0/588609061 >> v2:172.21.15.145:3300/0 conn(0x7f1c5804f1d0 0x7f1c580de700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.235+0000 7f1c64a00640 1 -- 172.21.15.2:0/588609061 >> v1:172.21.15.2:6789/0 conn(0x7f1c5804fda0 legacy=0x7f1c580501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.235+0000 7f1c64a00640 1 -- 172.21.15.2:0/588609061 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c58053380 con 0x7f1c580d86d0 2024-08-17T02:23:40.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.237+0000 7f1c64a00640 1 --2- 172.21.15.2:0/588609061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c580d86d0 0x7f1c58005e70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1c6004c0c0 tx=0x7f1c60064990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c058605bd2de02bc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.238+0000 7f1c5f400640 1 -- 172.21.15.2:0/588609061 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c600a1c90 con 0x7f1c580d86d0 2024-08-17T02:23:40.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.238+0000 7f1c5f400640 1 -- 172.21.15.2:0/588609061 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c600a1df0 con 0x7f1c580d86d0 2024-08-17T02:23:40.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.239+0000 7f1c5f400640 1 -- 172.21.15.2:0/588609061 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c600a9600 con 0x7f1c580d86d0 2024-08-17T02:23:40.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.240+0000 7f1c65e00640 1 -- 172.21.15.2:0/588609061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c580d86d0 msgr2=0x7f1c58005e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.240+0000 7f1c65e00640 1 --2- 172.21.15.2:0/588609061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c580d86d0 0x7f1c58005e70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1c6004c0c0 tx=0x7f1c60064990 comp rx=0 tx=0).stop 2024-08-17T02:23:40.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.241+0000 7f1c65e00640 1 -- 172.21.15.2:0/588609061 shutdown_connections 2024-08-17T02:23:40.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.241+0000 7f1c65e00640 1 --2- 172.21.15.2:0/588609061 >> v2:172.21.15.145:3300/0 conn(0x7f1c5804f1d0 0x7f1c580de700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.241+0000 7f1c65e00640 1 --2- 172.21.15.2:0/588609061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c580d86d0 0x7f1c58005e70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.241+0000 7f1c65e00640 1 -- 172.21.15.2:0/588609061 >> 172.21.15.2:0/588609061 conn(0x7f1c58051600 msgr2=0x7f1c58051a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:40.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.242+0000 7f1c65e00640 1 -- 172.21.15.2:0/588609061 shutdown_connections 2024-08-17T02:23:40.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.242+0000 7f1c65e00640 1 -- 172.21.15.2:0/588609061 wait complete. 2024-08-17T02:23:40.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.245+0000 7f1c65e00640 1 Processor -- start 2024-08-17T02:23:40.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.245+0000 7f1c65e00640 1 -- start start 2024-08-17T02:23:40.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.247+0000 7f1c65e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c5804fda0 0x7f1c580fa330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.248+0000 7f1c65e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1c580d86d0 0x7f1c580d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.249+0000 7f1c65e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1c58037930 0x7f1c580cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.249+0000 7f1c65e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c580f6ed0 con 0x7f1c5804fda0 2024-08-17T02:23:40.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.249+0000 7f1c65400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1c58037930 0x7f1c580cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.249+0000 7f1c65400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1c58037930 0x7f1c580cdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:47544/0 (socket says 172.21.15.2:47544) 2024-08-17T02:23:40.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.249+0000 7f1c65400640 1 -- 172.21.15.2:0/775138050 learned_addr learned my addr 172.21.15.2:0/775138050 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:40.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.249+0000 7f1c65e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c580d3300 con 0x7f1c58037930 2024-08-17T02:23:40.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.250+0000 7f1c65e00640 1 -- 172.21.15.2:0/775138050 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c580fa910 con 0x7f1c580d86d0 2024-08-17T02:23:40.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.250+0000 7f1c64a00640 1 --2- 172.21.15.2:0/775138050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c5804fda0 0x7f1c580fa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.250+0000 7f1c5fe00640 1 --2- 172.21.15.2:0/775138050 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1c580d86d0 0x7f1c580d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.252+0000 7f1c64a00640 1 -- 172.21.15.2:0/775138050 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1c580d86d0 msgr2=0x7f1c580d2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.252+0000 7f1c64a00640 1 --2- 172.21.15.2:0/775138050 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1c580d86d0 0x7f1c580d2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.253+0000 7f1c64a00640 1 -- 172.21.15.2:0/775138050 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1c58037930 msgr2=0x7f1c580cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.253+0000 7f1c64a00640 1 --2- 172.21.15.2:0/775138050 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1c58037930 0x7f1c580cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.253+0000 7f1c64a00640 1 -- 172.21.15.2:0/775138050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6004c200 con 0x7f1c5804fda0 2024-08-17T02:23:40.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.253+0000 7f1c5fe00640 1 --2- 172.21.15.2:0/775138050 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1c580d86d0 0x7f1c580d2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:40.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.253+0000 7f1c65400640 1 --2- 172.21.15.2:0/775138050 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1c58037930 0x7f1c580cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:40.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.254+0000 7f1c64a00640 1 --2- 172.21.15.2:0/775138050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c5804fda0 0x7f1c580fa330 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1c60064d20 tx=0x7f1c600ab000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.254+0000 7f1c53e00640 1 -- 172.21.15.2:0/775138050 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c600b8070 con 0x7f1c5804fda0 2024-08-17T02:23:40.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.255+0000 7f1c65e00640 1 -- 172.21.15.2:0/775138050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c580fabf0 con 0x7f1c5804fda0 2024-08-17T02:23:40.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.255+0000 7f1c65e00640 1 -- 172.21.15.2:0/775138050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c580fb1b0 con 0x7f1c5804fda0 2024-08-17T02:23:40.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.255+0000 7f1c53e00640 1 -- 172.21.15.2:0/775138050 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c600a8a60 con 0x7f1c5804fda0 2024-08-17T02:23:40.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.255+0000 7f1c53e00640 1 -- 172.21.15.2:0/775138050 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c600b8070 con 0x7f1c5804fda0 2024-08-17T02:23:40.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.260+0000 7f1c65e00640 1 -- 172.21.15.2:0/775138050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c3c005210 con 0x7f1c5804fda0 2024-08-17T02:23:40.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.261+0000 7f1c53e00640 1 -- 172.21.15.2:0/775138050 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1c600b3450 con 0x7f1c5804fda0 2024-08-17T02:23:40.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.262+0000 7f1c53e00640 1 --2- 172.21.15.2:0/775138050 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1c40065230 0x7f1c400676e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.262+0000 7f1c53e00640 1 -- 172.21.15.2:0/775138050 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c601192d0 con 0x7f1c5804fda0 2024-08-17T02:23:40.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.267+0000 7f1c5fe00640 1 --2- 172.21.15.2:0/775138050 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1c40065230 0x7f1c400676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.268+0000 7f1c5fe00640 1 --2- 172.21.15.2:0/775138050 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1c40065230 0x7f1c400676e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1c580d3a10 tx=0x7f1c54008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.274+0000 7f1c53e00640 1 -- 172.21.15.2:0/775138050 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1c600e72f0 con 0x7f1c5804fda0 2024-08-17T02:23:40.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.308+0000 7f2dc2a00640 1 Processor -- start 2024-08-17T02:23:40.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.308+0000 7f2dc2a00640 1 -- start start 2024-08-17T02:23:40.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.310+0000 7f2dc2a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2db4052170 0x7f2db40dfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.311+0000 7f2dc2a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db40363e0 con 0x7f2db4051da0 2024-08-17T02:23:40.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.311+0000 7f2dc2a00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db4054b10 con 0x7f2db40e0070 2024-08-17T02:23:40.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.311+0000 7f2dc2a00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db40525c0 con 0x7f2db4052170 2024-08-17T02:23:40.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.311+0000 7fa9cf200640 1 Processor -- start 2024-08-17T02:23:40.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.312+0000 7fa9cf200640 1 -- start start 2024-08-17T02:23:40.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.312+0000 7f2dbbe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2db4051da0 0x7f2db4035960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36114/0 (socket says 172.21.15.2:36114) 2024-08-17T02:23:40.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.312+0000 7f2dbbe00640 1 -- 172.21.15.2:0/1909901530 learned_addr learned my addr 172.21.15.2:0/1909901530 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.313+0000 7f2dbaa00640 1 -- 172.21.15.2:0/1909901530 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044480228 0 0) 0x7f2db40363e0 con 0x7f2db4051da0 2024-08-17T02:23:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.313+0000 7f2dbaa00640 1 -- 172.21.15.2:0/1909901530 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2da40034e0 con 0x7f2db4051da0 2024-08-17T02:23:40.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.314+0000 7f2dbaa00640 1 -- 172.21.15.2:0/1909901530 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2358676244 0 0) 0x7f2da40034e0 con 0x7f2db4051da0 2024-08-17T02:23:40.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.314+0000 7f2dbaa00640 1 -- 172.21.15.2:0/1909901530 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2db4052170 msgr2=0x7f2db40dfb30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:23:40.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.314+0000 7f2dbaa00640 1 --2- 172.21.15.2:0/1909901530 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2db4052170 0x7f2db40dfb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.314+0000 7f2dbaa00640 1 -- 172.21.15.2:0/1909901530 >> v1:172.21.15.145:6789/0 conn(0x7f2db40e0070 legacy=0x7f2db40555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.314+0000 7f2dbaa00640 1 -- 172.21.15.2:0/1909901530 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db4054df0 con 0x7f2db4051da0 2024-08-17T02:23:40.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.311+0000 7f72c4600640 1 Processor -- start 2024-08-17T02:23:40.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.311+0000 7f72c4600640 1 -- start start 2024-08-17T02:23:40.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.313+0000 7f72c4600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f72b40d4ac0 0x7f72b40d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.313+0000 7f72c4600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b4054130 con 0x7f72b4033850 2024-08-17T02:23:40.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.313+0000 7f72c4600640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b40344d0 con 0x7f72b4033c20 2024-08-17T02:23:40.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.313+0000 7f72c4600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b40340a0 con 0x7f72b40d4ac0 2024-08-17T02:23:40.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.314+0000 7fa9cf200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa9d01588d0 0x7fa9d00ca800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.315+0000 7f2dbaa00640 1 -- 172.21.15.2:0/1909901530 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7f2da8001450 con 0x7f2db4051da0 2024-08-17T02:23:40.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.314+0000 7f72c1200640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f72b4033c20 0x7f72b4053020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:56442/0 (socket says 172.21.15.2:56442) 2024-08-17T02:23:40.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.314+0000 7f72c1200640 1 -- 172.21.15.2:0/2520913432 learned_addr learned my addr 172.21.15.2:0/2520913432 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:40.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.316+0000 7fa9cf200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d00af600 con 0x7fa9d0158ca0 2024-08-17T02:23:40.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.316+0000 7fa9cf200640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d00afb60 con 0x7fa9d00cf900 2024-08-17T02:23:40.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.316+0000 7fa9cf200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d00d04e0 con 0x7fa9d01588d0 2024-08-17T02:23:40.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.315+0000 7f2dbaa00640 1 -- 172.21.15.2:0/1909901530 >> v1:172.21.15.2:6789/0 conn(0x7f2db4051da0 legacy=0x7f2db4035960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.315+0000 7f72bbe00640 1 -- 172.21.15.2:0/2520913432 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2400952524 0 0) 0x7f72b4054130 con 0x7f72b4033850 2024-08-17T02:23:40.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.315+0000 7f72bbe00640 1 -- 172.21.15.2:0/2520913432 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72a40034e0 con 0x7f72b4033850 2024-08-17T02:23:40.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.316+0000 7fa9cde00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa9d01588d0 0x7fa9d00ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.316+0000 7f2dbaa00640 1 --2- 172.21.15.2:0/1909901530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2da4003a40 0x7f2da4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.316+0000 7f72c2600640 1 --2- 172.21.15.2:0/2520913432 >> v2:172.21.15.2:3300/0 conn(0x7f72b40d4ac0 0x7f72b40d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.316+0000 7fa9cd400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa9d0158ca0 0x7fa9d00cf1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36126/0 (socket says 172.21.15.2:36126) 2024-08-17T02:23:40.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.316+0000 7fa9cd400640 1 -- 172.21.15.2:0/3936519398 learned_addr learned my addr 172.21.15.2:0/3936519398 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:40.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.317+0000 7f2dbaa00640 1 --2- 172.21.15.2:0/1909901530 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2db4052170 0x7f2da4004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.317+0000 7f72bbe00640 1 -- 172.21.15.2:0/2520913432 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429887936 0 0) 0x7f72b40344d0 con 0x7f72b4033c20 2024-08-17T02:23:40.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.317+0000 7f72bbe00640 1 -- 172.21.15.2:0/2520913432 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72a4003800 con 0x7f72b4033c20 2024-08-17T02:23:40.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.317+0000 7f2dbaa00640 1 --2- 172.21.15.2:0/1909901530 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2da4004ec0 0x7f2da400fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.317+0000 7f2dbaa00640 1 -- 172.21.15.2:0/1909901530 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db40525c0 con 0x7f2da4003a40 2024-08-17T02:23:40.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.317+0000 7f2dbaa00640 1 -- 172.21.15.2:0/1909901530 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da4005510 con 0x7f2da4004ec0 2024-08-17T02:23:40.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.317+0000 7fa9cde00640 1 -- 172.21.15.2:0/3936519398 >> v1:172.21.15.145:6789/0 conn(0x7fa9d00cf900 legacy=0x7fa9d00afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:40.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.317+0000 7f2dbaa00640 1 -- 172.21.15.2:0/1909901530 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da4010320 con 0x7f2db4052170 2024-08-17T02:23:40.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.317+0000 7f2dc0a00640 1 --2- 172.21.15.2:0/1909901530 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2da4004ec0 0x7f2da400fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.317+0000 7fa9cde00640 1 -- 172.21.15.2:0/3936519398 >> v1:172.21.15.2:6789/0 conn(0x7fa9d0158ca0 legacy=0x7fa9d00cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.317+0000 7fa9cde00640 1 -- 172.21.15.2:0/3936519398 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d00af830 con 0x7fa9d01588d0 2024-08-17T02:23:40.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.318+0000 7f72bbe00640 1 -- 172.21.15.2:0/2520913432 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3648685661 0 0) 0x7f72a4003800 con 0x7f72b4033c20 2024-08-17T02:23:40.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.318+0000 7f72bbe00640 1 -- 172.21.15.2:0/2520913432 >> v2:172.21.15.2:3300/0 conn(0x7f72b40d4ac0 msgr2=0x7f72b40d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:40.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.318+0000 7f3fa1000640 1 Processor -- start 2024-08-17T02:23:40.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.318+0000 7f2dc0a00640 1 -- 172.21.15.2:0/1909901530 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2db4052170 msgr2=0x7f2da4004780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:23:40.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.318+0000 7f2dc0a00640 1 --2- 172.21.15.2:0/1909901530 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2db4052170 0x7f2da4004780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.318+0000 7f2dbbe00640 1 --2- 172.21.15.2:0/1909901530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2da4003a40 0x7f2da4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.318+0000 7f2dc0a00640 1 -- 172.21.15.2:0/1909901530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2da4003a40 msgr2=0x7f2da4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:40.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.318+0000 7f2dc0a00640 1 --2- 172.21.15.2:0/1909901530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2da4003a40 0x7f2da4003e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.318+0000 7f2dc0a00640 1 -- 172.21.15.2:0/1909901530 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da4010520 con 0x7f2da4004ec0 2024-08-17T02:23:40.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.318+0000 7f72bbe00640 1 --2- 172.21.15.2:0/2520913432 >> v2:172.21.15.2:3300/0 conn(0x7f72b40d4ac0 0x7f72b40d4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.318+0000 7f72bbe00640 1 -- 172.21.15.2:0/2520913432 >> v1:172.21.15.2:6789/0 conn(0x7f72b4033850 legacy=0x7f72b4005e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.318+0000 7f72bbe00640 1 -- 172.21.15.2:0/2520913432 --> v1:172.21.15.145:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b40d5460 con 0x7f72b4033c20 2024-08-17T02:23:40.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.318+0000 7f3fa1000640 1 -- start start 2024-08-17T02:23:40.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.318+0000 7f0982c00640 1 Processor -- start 2024-08-17T02:23:40.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.318+0000 7f72bbe00640 1 -- 172.21.15.2:0/2520913432 <== mon.1 v1:172.21.15.145:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7f72a8004a90 con 0x7f72b4033c20 2024-08-17T02:23:40.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.318+0000 7f72bbe00640 1 -- 172.21.15.2:0/2520913432 >> v1:172.21.15.145:6789/0 conn(0x7f72b4033c20 legacy=0x7f72b4053020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.318+0000 7f72bbe00640 1 --2- 172.21.15.2:0/2520913432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72a4003d10 0x7f72a4004120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.318+0000 7f72bbe00640 1 --2- 172.21.15.2:0/2520913432 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72a40047f0 0x7f72a4004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.318+0000 7f72bbe00640 1 --2- 172.21.15.2:0/2520913432 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72a4005380 0x7f72a4007a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.318+0000 7f72bbe00640 1 -- 172.21.15.2:0/2520913432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a4008260 con 0x7f72a4003d10 2024-08-17T02:23:40.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.318+0000 7f72bbe00640 1 -- 172.21.15.2:0/2520913432 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a40083d0 con 0x7f72a40047f0 2024-08-17T02:23:40.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.318+0000 7f72bbe00640 1 -- 172.21.15.2:0/2520913432 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a4008590 con 0x7f72a4005380 2024-08-17T02:23:40.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.319+0000 7f72c2600640 1 --2- 172.21.15.2:0/2520913432 >> v2:172.21.15.2:3300/0 conn(0x7f72b40d4ac0 0x7f72b40d4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:40.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.319+0000 7f0982c00640 1 -- start start 2024-08-17T02:23:40.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.319+0000 7f72c1200640 1 --2- 172.21.15.2:0/2520913432 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72a40047f0 0x7f72a4004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.320+0000 7f72c2600640 1 --2- 172.21.15.2:0/2520913432 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72a4005380 0x7f72a4007a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.320+0000 7f3fa1000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3f9c1589e0 0x7f3f9c158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.320+0000 7f72c1c00640 1 --2- 172.21.15.2:0/2520913432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72a4003d10 0x7f72a4004120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.320+0000 7f72c1200640 1 -- 172.21.15.2:0/2520913432 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72a4005380 msgr2=0x7f72a4007a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:40.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.320+0000 7f72c1200640 1 --2- 172.21.15.2:0/2520913432 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72a4005380 0x7f72a4007a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.320+0000 7f72c1200640 1 -- 172.21.15.2:0/2520913432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72a4003d10 msgr2=0x7f72a4004120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:40.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.320+0000 7f3fa1000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f9c0af9a0 con 0x7f3f9c0ca9c0 2024-08-17T02:23:40.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.320+0000 7f3fa1000640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f9c0ce740 con 0x7f3f9c0ce140 2024-08-17T02:23:40.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.320+0000 7f3fa1000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f9c0af810 con 0x7f3f9c1589e0 2024-08-17T02:23:40.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.320+0000 7f3f99e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3f9c1589e0 0x7f3f9c158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.320+0000 7f3f99e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3f9c1589e0 0x7f3f9c158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54058/0 (socket says 172.21.15.2:54058) 2024-08-17T02:23:40.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.320+0000 7f3f99e00640 1 -- 172.21.15.2:0/3599192318 learned_addr learned my addr 172.21.15.2:0/3599192318 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:40.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.320+0000 7f3f99400640 1 --1- 172.21.15.2:0/3599192318 >> v1:172.21.15.2:6789/0 conn(0x7f3f9c0ca9c0 0x7f3f9c0cda30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36128/0 (socket says 172.21.15.2:36128) 2024-08-17T02:23:40.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.320+0000 7fa9cde00640 1 --2- 172.21.15.2:0/3936519398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9d01588d0 0x7fa9d00ca800 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc009850 tx=0x7fa9bc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200be78c5aee36a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.321+0000 7f3f99e00640 1 -- 172.21.15.2:0/3599192318 >> v1:172.21.15.145:6789/0 conn(0x7f3f9c0ce140 legacy=0x7f3f9c0afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.321+0000 7f3f99e00640 1 -- 172.21.15.2:0/3599192318 >> v1:172.21.15.2:6789/0 conn(0x7f3f9c0ca9c0 legacy=0x7f3f9c0cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.321+0000 7f3f99e00640 1 -- 172.21.15.2:0/3599192318 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c0cea00 con 0x7f3f9c1589e0 2024-08-17T02:23:40.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.321+0000 7f72c1200640 1 --2- 172.21.15.2:0/2520913432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72a4003d10 0x7f72a4004120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.321+0000 7f72c1200640 1 -- 172.21.15.2:0/2520913432 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b40d5460 con 0x7f72a40047f0 2024-08-17T02:23:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.321+0000 7f72c2600640 1 --2- 172.21.15.2:0/2520913432 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72a4005380 0x7f72a4007a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.321+0000 7f72c1c00640 1 --2- 172.21.15.2:0/2520913432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72a4003d10 0x7f72a4004120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.321+0000 7f72c2600640 1 -- 172.21.15.2:0/2520913432 reap_dead start 2024-08-17T02:23:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.322+0000 7fa9cca00640 1 -- 172.21.15.2:0/3936519398 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc02adb0 con 0x7fa9d01588d0 2024-08-17T02:23:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.322+0000 7f2dc0a00640 1 --2- 172.21.15.2:0/1909901530 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2da4004ec0 0x7f2da400fde0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc0654b0 tx=0x7f2dbc064990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58223b58fe4513ba server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.322+0000 7f2dbaa00640 1 -- 172.21.15.2:0/1909901530 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc0a19c0 con 0x7f2da4004ec0 2024-08-17T02:23:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.322+0000 7f2dbaa00640 1 -- 172.21.15.2:0/1909901530 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dbc0a1b20 con 0x7f2da4004ec0 2024-08-17T02:23:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.322+0000 7f2dbaa00640 1 -- 172.21.15.2:0/1909901530 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc0a93f0 con 0x7f2da4004ec0 2024-08-17T02:23:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.322+0000 7fa9cca00640 1 -- 172.21.15.2:0/3936519398 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9bc032440 con 0x7fa9d01588d0 2024-08-17T02:23:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.322+0000 7fa9cca00640 1 -- 172.21.15.2:0/3936519398 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc032820 con 0x7fa9d01588d0 2024-08-17T02:23:40.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.323+0000 7f3f99e00640 1 --2- 172.21.15.2:0/3599192318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f9c1589e0 0x7f3f9c158db0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3f84009910 tx=0x7f3f840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7210dc6d9b6bb2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.323+0000 7f0982c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f097c158a00 0x7f097c158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.323+0000 7f0982c00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f097c0cb190 0x7f097c0cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.323+0000 7f0982c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f097c06e590 0x7f097c06e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.323+0000 7f0982c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f097c06eef0 con 0x7f097c158a00 2024-08-17T02:23:40.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.323+0000 7f0982c00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f097c0cbc50 con 0x7f097c0cb190 2024-08-17T02:23:40.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.323+0000 7f2dc2a00640 1 -- 172.21.15.2:0/1909901530 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2da4004ec0 msgr2=0x7f2da400fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.323+0000 7f2dc2a00640 1 --2- 172.21.15.2:0/1909901530 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2da4004ec0 0x7f2da400fde0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc0654b0 tx=0x7f2dbc064990 comp rx=0 tx=0).stop 2024-08-17T02:23:40.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.323+0000 7f2dc0a00640 1 -- 172.21.15.2:0/1909901530 reap_dead start 2024-08-17T02:23:40.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.323+0000 7f2dc2a00640 1 -- 172.21.15.2:0/1909901530 shutdown_connections 2024-08-17T02:23:40.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.323+0000 7f2dc2a00640 1 -- 172.21.15.2:0/1909901530 >> 172.21.15.2:0/1909901530 conn(0x7f2db400a800 msgr2=0x7f2db4056da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:40.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.323+0000 7f72c1200640 1 --2- 172.21.15.2:0/2520913432 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72a40047f0 0x7f72a4004c60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f72a800d380 tx=0x7f72a8001600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7b01ae836b090e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.323+0000 7f72bbe00640 1 -- 172.21.15.2:0/2520913432 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a802b640 con 0x7f72a40047f0 2024-08-17T02:23:40.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.324+0000 7f72bbe00640 1 -- 172.21.15.2:0/2520913432 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a8009040 con 0x7f72a40047f0 2024-08-17T02:23:40.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.324+0000 7f72bbe00640 1 -- 172.21.15.2:0/2520913432 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a802ba30 con 0x7f72a40047f0 2024-08-17T02:23:40.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.323+0000 7f3f98a00640 1 -- 172.21.15.2:0/3599192318 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f84032440 con 0x7f3f9c1589e0 2024-08-17T02:23:40.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.323+0000 7f3f98a00640 1 -- 172.21.15.2:0/3599192318 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f840325a0 con 0x7f3f9c1589e0 2024-08-17T02:23:40.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.323+0000 7f3f98a00640 1 -- 172.21.15.2:0/3599192318 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f84032980 con 0x7f3f9c1589e0 2024-08-17T02:23:40.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.324+0000 7f0982c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097c0cbf30 con 0x7f097c06e590 2024-08-17T02:23:40.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.324+0000 7f0981800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f097c158a00 0x7f097c158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.324+0000 7f0980e00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f097c0cb190 0x7f097c0cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.324+0000 7f0981800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f097c158a00 0x7f097c158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54072/0 (socket says 172.21.15.2:54072) 2024-08-17T02:23:40.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.324+0000 7f0981800640 1 -- 172.21.15.2:0/352682580 learned_addr learned my addr 172.21.15.2:0/352682580 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:40.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.324+0000 7f0982200640 1 --2- 172.21.15.2:0/352682580 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f097c06e590 0x7f097c06e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.324+0000 7fa9cf200640 1 -- 172.21.15.2:0/3936519398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9d01588d0 msgr2=0x7fa9d00ca800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.324+0000 7fa9cf200640 1 --2- 172.21.15.2:0/3936519398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9d01588d0 0x7fa9d00ca800 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc009850 tx=0x7fa9bc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.324+0000 7fa9cf200640 1 -- 172.21.15.2:0/3936519398 shutdown_connections 2024-08-17T02:23:40.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.324+0000 7fa9cf200640 1 --2- 172.21.15.2:0/3936519398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9d01588d0 0x7fa9d00ca800 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.324+0000 7fa9cf200640 1 -- 172.21.15.2:0/3936519398 >> 172.21.15.2:0/3936519398 conn(0x7fa9d0087a80 msgr2=0x7fa9d006e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:40.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.324+0000 7f2dc2a00640 1 -- 172.21.15.2:0/1909901530 shutdown_connections 2024-08-17T02:23:40.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.324+0000 7f0981800640 1 -- 172.21.15.2:0/352682580 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f097c06e590 msgr2=0x7f097c06e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:40.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.324+0000 7f2dc2a00640 1 -- 172.21.15.2:0/1909901530 wait complete. 2024-08-17T02:23:40.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.324+0000 7f3fa1000640 1 -- 172.21.15.2:0/3599192318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f9c1589e0 msgr2=0x7f3f9c158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.324+0000 7fa9cf200640 1 -- 172.21.15.2:0/3936519398 shutdown_connections 2024-08-17T02:23:40.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.325+0000 7f3fa1000640 1 --2- 172.21.15.2:0/3599192318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f9c1589e0 0x7f3f9c158db0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3f84009910 tx=0x7f3f840091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.325+0000 7fa9cf200640 1 -- 172.21.15.2:0/3936519398 wait complete. 2024-08-17T02:23:40.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.324+0000 7f72c4600640 1 -- 172.21.15.2:0/2520913432 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72a40047f0 msgr2=0x7f72a4004c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.324+0000 7f72c4600640 1 --2- 172.21.15.2:0/2520913432 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72a40047f0 0x7f72a4004c60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f72a800d380 tx=0x7f72a8001600 comp rx=0 tx=0).stop 2024-08-17T02:23:40.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.325+0000 7f0981800640 1 --2- 172.21.15.2:0/352682580 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f097c06e590 0x7f097c06e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.325+0000 7f0981800640 1 -- 172.21.15.2:0/352682580 >> v2:172.21.15.145:3300/0 conn(0x7f097c0cb190 msgr2=0x7f097c0cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:40.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.325+0000 7f0981800640 1 --2- 172.21.15.2:0/352682580 >> v2:172.21.15.145:3300/0 conn(0x7f097c0cb190 0x7f097c0cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.325+0000 7fde5d600640 1 Processor -- start 2024-08-17T02:23:40.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.325+0000 7f0981800640 1 -- 172.21.15.2:0/352682580 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c0cc210 con 0x7f097c158a00 2024-08-17T02:23:40.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.325+0000 7f72c4600640 1 -- 172.21.15.2:0/2520913432 shutdown_connections 2024-08-17T02:23:40.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.325+0000 7f0982200640 1 --2- 172.21.15.2:0/352682580 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f097c06e590 0x7f097c06e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:40.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.325+0000 7f72c4600640 1 --2- 172.21.15.2:0/2520913432 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72a40047f0 0x7f72a4004c60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.325+0000 7f72c4600640 1 -- 172.21.15.2:0/2520913432 >> 172.21.15.2:0/2520913432 conn(0x7f72b4054b90 msgr2=0x7f72b4054f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:40.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.325+0000 7f3fa1000640 1 -- 172.21.15.2:0/3599192318 shutdown_connections 2024-08-17T02:23:40.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.325+0000 7f3fa1000640 1 --2- 172.21.15.2:0/3599192318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f9c1589e0 0x7f3f9c158db0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.325+0000 7f3fa1000640 1 -- 172.21.15.2:0/3599192318 >> 172.21.15.2:0/3599192318 conn(0x7f3f9c06e590 msgr2=0x7f3f9c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:40.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.325+0000 7f3fa1000640 1 -- 172.21.15.2:0/3599192318 shutdown_connections 2024-08-17T02:23:40.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.325+0000 7f72c4600640 1 -- 172.21.15.2:0/2520913432 shutdown_connections 2024-08-17T02:23:40.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.325+0000 7f72c4600640 1 -- 172.21.15.2:0/2520913432 wait complete. 2024-08-17T02:23:40.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.327+0000 7f2dc2a00640 1 Processor -- start 2024-08-17T02:23:40.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.327+0000 7fa9cf200640 1 Processor -- start 2024-08-17T02:23:40.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.327+0000 7fa9cf200640 1 -- start start 2024-08-17T02:23:40.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.327+0000 7f0981800640 1 --2- 172.21.15.2:0/352682580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f097c158a00 0x7f097c158dd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f097c0ca0b0 tx=0x7f09680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed2960faba9f1e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.327+0000 7f2dc2a00640 1 -- start start 2024-08-17T02:23:40.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.325+0000 7fde5d600640 1 -- start start 2024-08-17T02:23:40.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.327+0000 7fde5d600640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fde581589e0 0x7fde58158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.327+0000 7fde5d600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde580ca9c0 0x7fde580cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.327+0000 7fde5d600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde580af9a0 con 0x7fde580cda30 2024-08-17T02:23:40.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.327+0000 7fde5d600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde580af810 con 0x7fde580ca9c0 2024-08-17T02:23:40.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.327+0000 7fde5d600640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde580cb340 con 0x7fde581589e0 2024-08-17T02:23:40.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.327+0000 7f3fa1000640 1 -- 172.21.15.2:0/3599192318 wait complete. 2024-08-17T02:23:40.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.328+0000 7f72c4600640 1 Processor -- start 2024-08-17T02:23:40.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.327+0000 7f097be00640 1 -- 172.21.15.2:0/352682580 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096802add0 con 0x7f097c158a00 2024-08-17T02:23:40.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.328+0000 7f72c4600640 1 -- start start 2024-08-17T02:23:40.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.328+0000 7fde56000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde580ca9c0 0x7fde580cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.328+0000 7fde56000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde580ca9c0 0x7fde580cae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54088/0 (socket says 172.21.15.2:54088) 2024-08-17T02:23:40.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.328+0000 7fde56a00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fde581589e0 0x7fde58158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.328+0000 7fde57400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fde580cda30 0x7fde580cde90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36142/0 (socket says 172.21.15.2:36142) 2024-08-17T02:23:40.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.328+0000 7fde57400640 1 -- 172.21.15.2:0/251325544 learned_addr learned my addr 172.21.15.2:0/251325544 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:40.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.328+0000 7fe403200640 1 Processor -- start 2024-08-17T02:23:40.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.328+0000 7fa9cf200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9d00cf900 0x7fa9d00b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.329+0000 7fa9cf200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa9d01588d0 0x7fa9d00a7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.329+0000 7fa9cf200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9d0158ca0 0x7fa9d00c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.329+0000 7fa9cf200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d00a7690 con 0x7fa9d00cf900 2024-08-17T02:23:40.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.329+0000 7fa9cf200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d00b5740 con 0x7fa9d0158ca0 2024-08-17T02:23:40.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.329+0000 7fe403200640 1 -- start start 2024-08-17T02:23:40.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.329+0000 7fa9cf200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d00b4b30 con 0x7fa9d01588d0 2024-08-17T02:23:40.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.329+0000 7f2dc2a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2da4004ec0 0x7f2db40ef460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.329+0000 7f2dc2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2db403a960 0x7f2db403b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.329+0000 7f2dc2a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2db40db8f0 0x7f2db40089f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.329+0000 7f2dc2a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db403bb20 con 0x7f2db403a960 2024-08-17T02:23:40.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.329+0000 7f2dc2a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db403a4d0 con 0x7f2da4004ec0 2024-08-17T02:23:40.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.329+0000 7f2dc2a00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db4039be0 con 0x7f2db40db8f0 2024-08-17T02:23:40.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.329+0000 7fa9cde00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9d00cf900 0x7fa9d00b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.329+0000 7fde56000640 1 -- 172.21.15.2:0/251325544 >> v2:172.21.15.145:3300/0 conn(0x7fde581589e0 msgr2=0x7fde58158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:40.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.329+0000 7fa9cd400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa9d01588d0 0x7fa9d00a7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.329+0000 7fa9cd400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa9d01588d0 0x7fa9d00a7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47322/0 (socket says 172.21.15.2:47322) 2024-08-17T02:23:40.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.329+0000 7fa9cd400640 1 -- 172.21.15.2:0/3835346250 learned_addr learned my addr 172.21.15.2:0/3835346250 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:40.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.329+0000 7fa9ce800640 1 --2- 172.21.15.2:0/3835346250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9d0158ca0 0x7fa9d00c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.329+0000 7f2dbbe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2da4004ec0 0x7f2db40ef460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.329+0000 7fde56000640 1 --2- 172.21.15.2:0/251325544 >> v2:172.21.15.145:3300/0 conn(0x7fde581589e0 0x7fde58158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.329+0000 7fde56000640 1 -- 172.21.15.2:0/251325544 >> v1:172.21.15.2:6789/0 conn(0x7fde580cda30 legacy=0x7fde580cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:40.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.330+0000 7f3fa1000640 1 Processor -- start 2024-08-17T02:23:40.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.330+0000 7fde56000640 1 -- 172.21.15.2:0/251325544 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde580ce740 con 0x7fde580ca9c0 2024-08-17T02:23:40.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.330+0000 7fde56a00640 1 --2- 172.21.15.2:0/251325544 >> v2:172.21.15.145:3300/0 conn(0x7fde581589e0 0x7fde58158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:40.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.330+0000 7f097be00640 1 -- 172.21.15.2:0/352682580 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0968032440 con 0x7f097c158a00 2024-08-17T02:23:40.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.330+0000 7f2dbbe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2da4004ec0 0x7f2db40ef460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:47588/0 (socket says 172.21.15.2:47588) 2024-08-17T02:23:40.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.330+0000 7fa9ce800640 1 -- 172.21.15.2:0/3835346250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa9d01588d0 msgr2=0x7fa9d00a7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.330+0000 7fa9ce800640 1 --2- 172.21.15.2:0/3835346250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa9d01588d0 0x7fa9d00a7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.330+0000 7fa9ce800640 1 -- 172.21.15.2:0/3835346250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9d00cf900 msgr2=0x7fa9d00b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.330+0000 7fa9ce800640 1 --2- 172.21.15.2:0/3835346250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9d00cf900 0x7fa9d00b44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.330+0000 7f72c4600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72a40047f0 0x7f72b40d7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.330+0000 7f72c4600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72b40fe1a0 0x7f72b40061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.330+0000 7f72c4600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72b40066f0 0x7f72b40d55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.330+0000 7f72c4600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b4006b60 con 0x7f72a40047f0 2024-08-17T02:23:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.330+0000 7f72c4600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b4102b80 con 0x7f72b40fe1a0 2024-08-17T02:23:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.330+0000 7f72c4600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b4101f70 con 0x7f72b40066f0 2024-08-17T02:23:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.330+0000 7f097be00640 1 -- 172.21.15.2:0/352682580 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0968032820 con 0x7f097c158a00 2024-08-17T02:23:40.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.330+0000 7f2dbbe00640 1 -- 172.21.15.2:0/3585483695 learned_addr learned my addr 172.21.15.2:0/3585483695 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:40.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.330+0000 7f2dc0a00640 1 --2- 172.21.15.2:0/3585483695 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2db40db8f0 0x7f2db40089f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.330+0000 7f3fa1000640 1 -- start start 2024-08-17T02:23:40.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.330+0000 7fa9ce800640 1 -- 172.21.15.2:0/3835346250 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9bc009390 con 0x7fa9d0158ca0 2024-08-17T02:23:40.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.330+0000 7fa9cd400640 1 --2- 172.21.15.2:0/3835346250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa9d01588d0 0x7fa9d00a7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:40.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.330+0000 7f72c1200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72b40fe1a0 0x7f72b40061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.330+0000 7f72c2600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72b40066f0 0x7f72b40d55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.331+0000 7f72c1200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72b40fe1a0 0x7f72b40061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:47600/0 (socket says 172.21.15.2:47600) 2024-08-17T02:23:40.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.331+0000 7f72c2600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72b40066f0 0x7f72b40d55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47330/0 (socket says 172.21.15.2:47330) 2024-08-17T02:23:40.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.331+0000 7f72c2600640 1 -- 172.21.15.2:0/3699920475 learned_addr learned my addr 172.21.15.2:0/3699920475 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:40.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.331+0000 7f72c2600640 1 -- 172.21.15.2:0/3699920475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72b40fe1a0 msgr2=0x7f72b40061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.331+0000 7f72c2600640 1 --2- 172.21.15.2:0/3699920475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72b40fe1a0 0x7f72b40061b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.331+0000 7f72c2600640 1 -- 172.21.15.2:0/3699920475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72a40047f0 msgr2=0x7f72b40d7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.331+0000 7f72c2600640 1 --2- 172.21.15.2:0/3699920475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72a40047f0 0x7f72b40d7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.331+0000 7f72c2600640 1 -- 172.21.15.2:0/3699920475 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b4102250 con 0x7f72b40066f0 2024-08-17T02:23:40.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.331+0000 7f0982c00640 1 -- 172.21.15.2:0/352682580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f097c158a00 msgr2=0x7f097c158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.331+0000 7f0982c00640 1 --2- 172.21.15.2:0/352682580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f097c158a00 0x7f097c158dd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f097c0ca0b0 tx=0x7f09680091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.331+0000 7f2dbb400640 1 --2- 172.21.15.2:0/3585483695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2db403a960 0x7f2db403b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.332+0000 7fde56000640 1 --2- 172.21.15.2:0/251325544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde580ca9c0 0x7fde580cae00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fde580d0d70 tx=0x7fde440090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36cce41ab027c61 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.332+0000 7f72c2600640 1 --2- 172.21.15.2:0/3699920475 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72b40066f0 0x7f72b40d55f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f72bc065b10 tx=0x7f72bc064990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.332+0000 7f3fa1000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3f9c0ca9c0 0x7f3f9c14e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.332+0000 7f3fa1000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f9c0ce140 0x7f3f9c169b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.332+0000 7f3fa1000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3f9c1589e0 0x7f3f9c151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.332+0000 7f2dbbe00640 1 -- 172.21.15.2:0/3585483695 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2db40db8f0 msgr2=0x7f2db40089f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.332+0000 7f2dbbe00640 1 --2- 172.21.15.2:0/3585483695 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2db40db8f0 0x7f2db40089f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.332+0000 7f2dbbe00640 1 -- 172.21.15.2:0/3585483695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2db403a960 msgr2=0x7f2db403b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.332+0000 7f72b8c00640 1 -- 172.21.15.2:0/3699920475 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc08b070 con 0x7f72b40066f0 2024-08-17T02:23:40.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.332+0000 7f3f99400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f9c0ce140 0x7f3f9c169b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.332+0000 7f3f99400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f9c0ce140 0x7f3f9c169b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54126/0 (socket says 172.21.15.2:54126) 2024-08-17T02:23:40.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.332+0000 7f3f99400640 1 -- 172.21.15.2:0/1240515294 learned_addr learned my addr 172.21.15.2:0/1240515294 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:40.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.332+0000 7f3fa1000640 1 -- 172.21.15.2:0/1240515294 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c0c7c60 con 0x7f3f9c0ce140 2024-08-17T02:23:40.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.332+0000 7f3fa1000640 1 -- 172.21.15.2:0/1240515294 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c0c7f40 con 0x7f3f9c0ca9c0 2024-08-17T02:23:40.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.332+0000 7f3fa1000640 1 -- 172.21.15.2:0/1240515294 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c0c8220 con 0x7f3f9c1589e0 2024-08-17T02:23:40.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.332+0000 7f3f9a800640 1 --2- 172.21.15.2:0/1240515294 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3f9c1589e0 0x7f3f9c151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.332+0000 7fe403200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe4041588d0 0x7fe4040ca800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.332+0000 7fe403200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4040cf900 0x7fe4040cad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.332+0000 7fe403200640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4040af600 con 0x7fe404158ca0 2024-08-17T02:23:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.332+0000 7fe403200640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4040cb280 con 0x7fe4041588d0 2024-08-17T02:23:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.332+0000 7fe403200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4040afb60 con 0x7fe4040cf900 2024-08-17T02:23:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.333+0000 7f72b8c00640 1 -- 172.21.15.2:0/3699920475 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72bc0646d0 con 0x7f72b40066f0 2024-08-17T02:23:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.333+0000 7f72b8c00640 1 -- 172.21.15.2:0/3699920475 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc08b070 con 0x7f72b40066f0 2024-08-17T02:23:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.333+0000 7f3f99e00640 1 --2- 172.21.15.2:0/1240515294 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3f9c0ca9c0 0x7f3f9c14e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.333+0000 7fe401400640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fe404158ca0 0x7fe4040cf1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:56462/0 (socket says 172.21.15.2:56462) 2024-08-17T02:23:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.332+0000 7f2dbbe00640 1 --2- 172.21.15.2:0/3585483695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2db403a960 0x7f2db403b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.332+0000 7f2dbbe00640 1 -- 172.21.15.2:0/3585483695 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db4039e80 con 0x7f2da4004ec0 2024-08-17T02:23:40.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.332+0000 7f2dbb400640 1 --2- 172.21.15.2:0/3585483695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2db403a960 0x7f2db403b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:40.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.333+0000 7fa9ce800640 1 --2- 172.21.15.2:0/3835346250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9d0158ca0 0x7fa9d00c9080 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800c7e0 tx=0x7fa9c80025b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.333+0000 7f3f99400640 1 -- 172.21.15.2:0/1240515294 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3f9c1589e0 msgr2=0x7f3f9c151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.333+0000 7f3f99400640 1 --2- 172.21.15.2:0/1240515294 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3f9c1589e0 0x7f3f9c151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.333+0000 7f3f99400640 1 -- 172.21.15.2:0/1240515294 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3f9c0ca9c0 msgr2=0x7f3f9c14e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.333+0000 7f3f99400640 1 --2- 172.21.15.2:0/1240515294 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3f9c0ca9c0 0x7f3f9c14e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.333+0000 7f3f99400640 1 -- 172.21.15.2:0/1240515294 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f84009450 con 0x7f3f9c0ce140 2024-08-17T02:23:40.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.333+0000 7fe402800640 1 --2- 172.21.15.2:0/2101710348 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4040cf900 0x7fe4040cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.333+0000 7fe401e00640 1 --2- 172.21.15.2:0/2101710348 >> v2:172.21.15.145:3300/0 conn(0x7fe4041588d0 0x7fe4040ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.333+0000 7fde55600640 1 -- 172.21.15.2:0/251325544 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4402ad20 con 0x7fde580ca9c0 2024-08-17T02:23:40.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.333+0000 7fe401400640 1 -- 172.21.15.2:0/2101710348 learned_addr learned my addr 172.21.15.2:0/2101710348 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:40.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.333+0000 7f72c4600640 1 -- 172.21.15.2:0/3699920475 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b4102530 con 0x7f72b40066f0 2024-08-17T02:23:40.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.333+0000 7f3f99400640 1 --2- 172.21.15.2:0/1240515294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f9c0ce140 0x7f3f9c169b30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00c4e0 tx=0x7f3f8c007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.333+0000 7f72c4600640 1 -- 172.21.15.2:0/3699920475 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b40d7bd0 con 0x7f72b40066f0 2024-08-17T02:23:40.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.333+0000 7fde55600640 1 -- 172.21.15.2:0/251325544 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4402ae80 con 0x7fde580ca9c0 2024-08-17T02:23:40.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.333+0000 7fde55600640 1 -- 172.21.15.2:0/251325544 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde44032670 con 0x7fde580ca9c0 2024-08-17T02:23:40.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.333+0000 7fa9c5600640 1 -- 172.21.15.2:0/3835346250 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c800a640 con 0x7fa9d0158ca0 2024-08-17T02:23:40.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.334+0000 7f3f91600640 1 -- 172.21.15.2:0/1240515294 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c0072e0 con 0x7f3f9c0ce140 2024-08-17T02:23:40.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.334+0000 7f3f91600640 1 -- 172.21.15.2:0/1240515294 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c007440 con 0x7f3f9c0ce140 2024-08-17T02:23:40.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.334+0000 7f3f91600640 1 -- 172.21.15.2:0/1240515294 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c0047a0 con 0x7f3f9c0ce140 2024-08-17T02:23:40.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.334+0000 7f2dbbe00640 1 --2- 172.21.15.2:0/3585483695 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2da4004ec0 0x7f2db40ef460 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2da800dbb0 tx=0x7f2da8009040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.334+0000 7f3fa1000640 1 -- 172.21.15.2:0/1240515294 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9c169630 con 0x7f3f9c0ce140 2024-08-17T02:23:40.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.334+0000 7f3fa1000640 1 -- 172.21.15.2:0/1240515294 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9c0c78a0 con 0x7f3f9c0ce140 2024-08-17T02:23:40.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.334+0000 7f0982c00640 1 -- 172.21.15.2:0/352682580 shutdown_connections 2024-08-17T02:23:40.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.334+0000 7f0982c00640 1 --2- 172.21.15.2:0/352682580 >> v2:172.21.15.145:3300/0 conn(0x7f097c0cb190 0x7f097c0cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.334+0000 7f0982c00640 1 --2- 172.21.15.2:0/352682580 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f097c06e590 0x7f097c06e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.334+0000 7f0982c00640 1 --2- 172.21.15.2:0/352682580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f097c158a00 0x7f097c158dd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.334+0000 7f0982c00640 1 -- 172.21.15.2:0/352682580 >> 172.21.15.2:0/352682580 conn(0x7f097c0cfb80 msgr2=0x7f097c0cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:40.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.333+0000 7fa9c5600640 1 -- 172.21.15.2:0/3835346250 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c800a7a0 con 0x7fa9d0158ca0 2024-08-17T02:23:40.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.333+0000 7fa9c5600640 1 -- 172.21.15.2:0/3835346250 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c800ab80 con 0x7fa9d0158ca0 2024-08-17T02:23:40.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.334+0000 7f2daf400640 1 -- 172.21.15.2:0/3585483695 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da8007430 con 0x7f2da4004ec0 2024-08-17T02:23:40.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.335+0000 7f2daf400640 1 -- 172.21.15.2:0/3585483695 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da8007590 con 0x7f2da4004ec0 2024-08-17T02:23:40.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.335+0000 7f2daf400640 1 -- 172.21.15.2:0/3585483695 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da8007430 con 0x7f2da4004ec0 2024-08-17T02:23:40.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.335+0000 7fa9cf200640 1 -- 172.21.15.2:0/3835346250 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d00b4e10 con 0x7fa9d0158ca0 2024-08-17T02:23:40.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.335+0000 7fa9cf200640 1 -- 172.21.15.2:0/3835346250 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d00b5450 con 0x7fa9d0158ca0 2024-08-17T02:23:40.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.335+0000 7f2dc2a00640 1 -- 172.21.15.2:0/3585483695 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db403a160 con 0x7f2da4004ec0 2024-08-17T02:23:40.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.336+0000 7f2dc2a00640 1 -- 172.21.15.2:0/3585483695 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db40dbd70 con 0x7f2da4004ec0 2024-08-17T02:23:40.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.335+0000 7f72ae000640 1 -- 172.21.15.2:0/3699920475 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7290005210 con 0x7f72b40066f0 2024-08-17T02:23:40.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.335+0000 7fde5d600640 1 -- 172.21.15.2:0/251325544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde580ca9c0 msgr2=0x7fde580cae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.335+0000 7fde5d600640 1 --2- 172.21.15.2:0/251325544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde580ca9c0 0x7fde580cae00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fde580d0d70 tx=0x7fde440090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.336+0000 7f3fa1000640 1 -- 172.21.15.2:0/1240515294 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9c063fb0 con 0x7f3f9c0ce140 2024-08-17T02:23:40.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.336+0000 7f0982c00640 1 -- 172.21.15.2:0/352682580 shutdown_connections 2024-08-17T02:23:40.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.337+0000 7fde5d600640 1 -- 172.21.15.2:0/251325544 shutdown_connections 2024-08-17T02:23:40.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.337+0000 7fde5d600640 1 --2- 172.21.15.2:0/251325544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde580ca9c0 0x7fde580cae00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.337+0000 7fde5d600640 1 --2- 172.21.15.2:0/251325544 >> v2:172.21.15.145:3300/0 conn(0x7fde581589e0 0x7fde58158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.337+0000 7fde5d600640 1 -- 172.21.15.2:0/251325544 >> 172.21.15.2:0/251325544 conn(0x7fde5806e590 msgr2=0x7fde5806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:40.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.334+0000 7fe402800640 1 -- 172.21.15.2:0/2101710348 >> v2:172.21.15.145:3300/0 conn(0x7fe4041588d0 msgr2=0x7fe4040ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:40.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.334+0000 7fe402800640 1 --2- 172.21.15.2:0/2101710348 >> v2:172.21.15.145:3300/0 conn(0x7fe4041588d0 0x7fe4040ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.334+0000 7fe402800640 1 -- 172.21.15.2:0/2101710348 >> v1:172.21.15.145:6789/0 conn(0x7fe404158ca0 legacy=0x7fe4040cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.334+0000 7fe402800640 1 -- 172.21.15.2:0/2101710348 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4040d04e0 con 0x7fe4040cf900 2024-08-17T02:23:40.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.335+0000 7fe402800640 1 --2- 172.21.15.2:0/2101710348 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4040cf900 0x7fe4040cad40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc009e60 tx=0x7fe3fc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ed7aa48a67cb085 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.336+0000 7fe400a00640 1 -- 172.21.15.2:0/2101710348 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc007550 con 0x7fe4040cf900 2024-08-17T02:23:40.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.336+0000 7fe400a00640 1 -- 172.21.15.2:0/2101710348 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3fc02d050 con 0x7fe4040cf900 2024-08-17T02:23:40.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.336+0000 7fe400a00640 1 -- 172.21.15.2:0/2101710348 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc007920 con 0x7fe4040cf900 2024-08-17T02:23:40.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.337+0000 7fa9cf200640 1 -- 172.21.15.2:0/3835346250 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d00c96e0 con 0x7fa9d0158ca0 2024-08-17T02:23:40.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.337+0000 7fe403200640 1 -- 172.21.15.2:0/2101710348 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4040cf900 msgr2=0x7fe4040cad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.337+0000 7fe403200640 1 --2- 172.21.15.2:0/2101710348 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4040cf900 0x7fe4040cad40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc009e60 tx=0x7fe3fc009780 comp rx=0 tx=0).stop 2024-08-17T02:23:40.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.337+0000 7f72b8c00640 1 -- 172.21.15.2:0/3699920475 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f72bc08f5d0 con 0x7f72b40066f0 2024-08-17T02:23:40.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.337+0000 7fe403200640 1 -- 172.21.15.2:0/2101710348 shutdown_connections 2024-08-17T02:23:40.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.337+0000 7fe403200640 1 --2- 172.21.15.2:0/2101710348 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4040cf900 0x7fe4040cad40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.337+0000 7fe403200640 1 --2- 172.21.15.2:0/2101710348 >> v2:172.21.15.145:3300/0 conn(0x7fe4041588d0 0x7fe4040ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.337+0000 7fe403200640 1 -- 172.21.15.2:0/2101710348 >> 172.21.15.2:0/2101710348 conn(0x7fe404087a80 msgr2=0x7fe40406e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:40.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.338+0000 7f3f91600640 1 -- 172.21.15.2:0/1240515294 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3f8c004bd0 con 0x7f3f9c0ce140 2024-08-17T02:23:40.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.337+0000 7f0982c00640 1 -- 172.21.15.2:0/352682580 wait complete. 2024-08-17T02:23:40.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.338+0000 7f72b8c00640 1 --2- 172.21.15.2:0/3699920475 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f729c0651b0 0x7f729c067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.339+0000 7f72b8c00640 1 -- 172.21.15.2:0/3699920475 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f72bc0f7d30 con 0x7f72b40066f0 2024-08-17T02:23:40.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.339+0000 7fe403200640 1 -- 172.21.15.2:0/2101710348 shutdown_connections 2024-08-17T02:23:40.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.339+0000 7fe403200640 1 -- 172.21.15.2:0/2101710348 wait complete. 2024-08-17T02:23:40.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.339+0000 7f72c1c00640 1 --2- 172.21.15.2:0/3699920475 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f729c0651b0 0x7f729c067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.339+0000 7f0982c00640 1 Processor -- start 2024-08-17T02:23:40.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.340+0000 7fde5d600640 1 -- 172.21.15.2:0/251325544 shutdown_connections 2024-08-17T02:23:40.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.340+0000 7f0982c00640 1 -- start start 2024-08-17T02:23:40.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.337+0000 7f2dc2a00640 1 -- 172.21.15.2:0/3585483695 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db40056a0 con 0x7f2da4004ec0 2024-08-17T02:23:40.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.339+0000 7f2daf400640 1 -- 172.21.15.2:0/3585483695 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2da80049b0 con 0x7f2da4004ec0 2024-08-17T02:23:40.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.340+0000 7fde5d600640 1 -- 172.21.15.2:0/251325544 wait complete. 2024-08-17T02:23:40.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.341+0000 7f72c1c00640 1 --2- 172.21.15.2:0/3699920475 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f729c0651b0 0x7f729c067660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f72b4003d90 tx=0x7f72b0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.340+0000 7f2daf400640 1 --2- 172.21.15.2:0/3585483695 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2d9c0651b0 0x7f2d9c067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.341+0000 7fe403200640 1 Processor -- start 2024-08-17T02:23:40.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.341+0000 7f2daf400640 1 -- 172.21.15.2:0/3585483695 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2da8081ca0 con 0x7f2da4004ec0 2024-08-17T02:23:40.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.341+0000 7fa9c5600640 1 -- 172.21.15.2:0/3835346250 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa9c8012420 con 0x7fa9d0158ca0 2024-08-17T02:23:40.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.341+0000 7fe403200640 1 -- start start 2024-08-17T02:23:40.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.341+0000 7f2dbb400640 1 --2- 172.21.15.2:0/3585483695 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2d9c0651b0 0x7f2d9c067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.341+0000 7f0982c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f097c06e590 0x7f097c153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.339+0000 7f3f91600640 1 --2- 172.21.15.2:0/1240515294 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3f78065220 0x7f3f780676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.339+0000 7f3f91600640 1 -- 172.21.15.2:0/1240515294 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3f8c081cd0 con 0x7f3f9c0ce140 2024-08-17T02:23:40.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.340+0000 7f3f99e00640 1 --2- 172.21.15.2:0/1240515294 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3f78065220 0x7f3f780676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.341+0000 7f3f99e00640 1 --2- 172.21.15.2:0/1240515294 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3f78065220 0x7f3f780676d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3f84034000 tx=0x7f3f84032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.342+0000 7f0982c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f097c0cb190 0x7f097c1579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.342+0000 7f0982c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f097c158a00 0x7f097c14fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.342+0000 7fe403200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4040cf900 0x7fe4041495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.342+0000 7f0982c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c1597e0 con 0x7f097c0cb190 2024-08-17T02:23:40.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.342+0000 7fe403200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe4041588d0 0x7fe4040c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.342+0000 7fe403200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe404158ca0 0x7fe4040c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.342+0000 7fe403200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe404157420 con 0x7fe404158ca0 2024-08-17T02:23:40.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.342+0000 7fe403200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4041578b0 con 0x7fe4041588d0 2024-08-17T02:23:40.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.342+0000 7fe403200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe404156810 con 0x7fe4040cf900 2024-08-17T02:23:40.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.343+0000 7f72b8c00640 1 -- 172.21.15.2:0/3699920475 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f72bc0c5ea0 con 0x7f72b40066f0 2024-08-17T02:23:40.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.343+0000 7f0982c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c15a780 con 0x7f097c158a00 2024-08-17T02:23:40.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.343+0000 7f0981800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f097c06e590 0x7f097c153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.343+0000 7f0981800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f097c06e590 0x7f097c153c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47350/0 (socket says 172.21.15.2:47350) 2024-08-17T02:23:40.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.343+0000 7f0981800640 1 -- 172.21.15.2:0/4112433498 learned_addr learned my addr 172.21.15.2:0/4112433498 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:40.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.343+0000 7f0982200640 1 --2- 172.21.15.2:0/4112433498 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f097c158a00 0x7f097c14fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.343+0000 7f2dbb400640 1 --2- 172.21.15.2:0/3585483695 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2d9c0651b0 0x7f2d9c067660 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2db403ad50 tx=0x7f2db0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.343+0000 7fe401e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4040cf900 0x7fe4041495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.343+0000 7fe401e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4040cf900 0x7fe4041495d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47364/0 (socket says 172.21.15.2:47364) 2024-08-17T02:23:40.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.343+0000 7fe401e00640 1 -- 172.21.15.2:0/4035109572 learned_addr learned my addr 172.21.15.2:0/4035109572 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:40.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.343+0000 7fa9c5600640 1 --2- 172.21.15.2:0/3835346250 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa9b00652a0 0x7fa9b0067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.343+0000 7fe402800640 1 --2- 172.21.15.2:0/4035109572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe404158ca0 0x7fe4040c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.343+0000 7fa9c5600640 1 -- 172.21.15.2:0/3835346250 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa9c8082d10 con 0x7fa9d0158ca0 2024-08-17T02:23:40.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.343+0000 7f0982c00640 1 -- 172.21.15.2:0/4112433498 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097c15a2f0 con 0x7f097c06e590 2024-08-17T02:23:40.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.343+0000 7fe401e00640 1 -- 172.21.15.2:0/4035109572 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe4041588d0 msgr2=0x7fe4040c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.343+0000 7fe401e00640 1 --2- 172.21.15.2:0/4035109572 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe4041588d0 0x7fe4040c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.343+0000 7fe401e00640 1 -- 172.21.15.2:0/4035109572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe404158ca0 msgr2=0x7fe4040c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.343+0000 7fe401e00640 1 --2- 172.21.15.2:0/4035109572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe404158ca0 0x7fe4040c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.343+0000 7fe401e00640 1 -- 172.21.15.2:0/4035109572 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc009a20 con 0x7fe4040cf900 2024-08-17T02:23:40.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.344+0000 7fa9c5600640 1 -- 172.21.15.2:0/3835346250 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa9c80ade60 con 0x7fa9d0158ca0 2024-08-17T02:23:40.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.343+0000 7f0980e00640 1 --2- 172.21.15.2:0/4112433498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f097c0cb190 0x7f097c1579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.344+0000 7fa9cde00640 1 --2- 172.21.15.2:0/3835346250 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa9b00652a0 0x7fa9b0067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.344+0000 7fe401e00640 1 --2- 172.21.15.2:0/4035109572 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4040cf900 0x7fe4041495d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400d890 tx=0x7fe3f4008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.342+0000 7fde5d600640 1 Processor -- start 2024-08-17T02:23:40.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.344+0000 7fe3f9600640 1 -- 172.21.15.2:0/4035109572 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f400de20 con 0x7fe4040cf900 2024-08-17T02:23:40.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.344+0000 7fe3f9600640 1 -- 172.21.15.2:0/4035109572 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f400b8d0 con 0x7fe4040cf900 2024-08-17T02:23:40.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.344+0000 7fe3f9600640 1 -- 172.21.15.2:0/4035109572 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f400bc70 con 0x7fe4040cf900 2024-08-17T02:23:40.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.344+0000 7fe403200640 1 -- 172.21.15.2:0/4035109572 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe404156af0 con 0x7fe4040cf900 2024-08-17T02:23:40.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.345+0000 7f0981800640 1 -- 172.21.15.2:0/4112433498 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f097c158a00 msgr2=0x7f097c14fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.344+0000 7fde5d600640 1 -- start start 2024-08-17T02:23:40.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.345+0000 7f0981800640 1 --2- 172.21.15.2:0/4112433498 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f097c158a00 0x7f097c14fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.345+0000 7f0981800640 1 -- 172.21.15.2:0/4112433498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f097c0cb190 msgr2=0x7f097c1579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.345+0000 7fe403200640 1 -- 172.21.15.2:0/4035109572 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4041570b0 con 0x7fe4040cf900 2024-08-17T02:23:40.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.345+0000 7fa9cde00640 1 --2- 172.21.15.2:0/3835346250 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa9b00652a0 0x7fa9b0067750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc034000 tx=0x7fa9bc032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.345+0000 7f3f91600640 1 -- 172.21.15.2:0/1240515294 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3f8c04fd70 con 0x7f3f9c0ce140 2024-08-17T02:23:40.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.345+0000 7f0981800640 1 --2- 172.21.15.2:0/4112433498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f097c0cb190 0x7f097c1579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.345+0000 7f0981800640 1 -- 172.21.15.2:0/4112433498 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0968009450 con 0x7f097c06e590 2024-08-17T02:23:40.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.345+0000 7f0980e00640 1 --2- 172.21.15.2:0/4112433498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f097c0cb190 0x7f097c1579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:40.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.346+0000 7fe403200640 1 -- 172.21.15.2:0/4035109572 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe404070720 con 0x7fe4040cf900 2024-08-17T02:23:40.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.347+0000 7f0981800640 1 --2- 172.21.15.2:0/4112433498 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f097c06e590 0x7f097c153c40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0968009210 tx=0x7f0968032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.347+0000 7fde5d600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fde580ca9c0 0x7fde580b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.347+0000 7fde5d600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde580cda30 0x7fde580c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.347+0000 7fde5d600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde581589e0 0x7fde580b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.347+0000 7fde5d600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde580c6dc0 con 0x7fde580cda30 2024-08-17T02:23:40.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.347+0000 7fde5d600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde580c7660 con 0x7fde581589e0 2024-08-17T02:23:40.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.347+0000 7fde5d600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde580b38e0 con 0x7fde580ca9c0 2024-08-17T02:23:40.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.347+0000 7f0978c00640 1 -- 172.21.15.2:0/4112433498 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0968000c40 con 0x7f097c06e590 2024-08-17T02:23:40.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.347+0000 7f0978c00640 1 -- 172.21.15.2:0/4112433498 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0968031a60 con 0x7f097c06e590 2024-08-17T02:23:40.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.347+0000 7f0978c00640 1 -- 172.21.15.2:0/4112433498 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0968031e60 con 0x7f097c06e590 2024-08-17T02:23:40.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.347+0000 7f0982c00640 1 -- 172.21.15.2:0/4112433498 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f097c150c00 con 0x7f097c06e590 2024-08-17T02:23:40.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.347+0000 7fde56a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fde580ca9c0 0x7fde580b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.347+0000 7fde56a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fde580ca9c0 0x7fde580b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47380/0 (socket says 172.21.15.2:47380) 2024-08-17T02:23:40.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.347+0000 7fde56a00640 1 -- 172.21.15.2:0/2349151223 learned_addr learned my addr 172.21.15.2:0/2349151223 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:40.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.348+0000 7fde56a00640 1 -- 172.21.15.2:0/2349151223 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde581589e0 msgr2=0x7fde580b0fb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:23:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.348+0000 7f2daf400640 1 -- 172.21.15.2:0/3585483695 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2da804de40 con 0x7f2da4004ec0 2024-08-17T02:23:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.348+0000 7fde56a00640 1 --2- 172.21.15.2:0/2349151223 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde581589e0 0x7fde580b0fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.348+0000 7fde56a00640 1 -- 172.21.15.2:0/2349151223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde580cda30 msgr2=0x7fde580c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.348+0000 7fde56a00640 1 --2- 172.21.15.2:0/2349151223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde580cda30 0x7fde580c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.349+0000 7fde56a00640 1 -- 172.21.15.2:0/2349151223 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde44009390 con 0x7fde580ca9c0 2024-08-17T02:23:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.347+0000 7f0982c00640 1 -- 172.21.15.2:0/4112433498 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f097c159ca0 con 0x7f097c06e590 2024-08-17T02:23:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.350+0000 7fde56a00640 1 --2- 172.21.15.2:0/2349151223 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fde580ca9c0 0x7fde580b2ab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fde4800d8c0 tx=0x7fde48008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.349+0000 7fe3f9600640 1 -- 172.21.15.2:0/4035109572 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe3f4014640 con 0x7fe4040cf900 2024-08-17T02:23:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.350+0000 7fe3f9600640 1 --2- 172.21.15.2:0/4035109572 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe3e40651d0 0x7fe3e4067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.350+0000 7fe3f9600640 1 -- 172.21.15.2:0/4035109572 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe3f4082a90 con 0x7fe4040cf900 2024-08-17T02:23:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.351+0000 7fe401400640 1 --2- 172.21.15.2:0/4035109572 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe3e40651d0 0x7fe3e4067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.351+0000 7f0982c00640 1 -- 172.21.15.2:0/4112433498 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097c070720 con 0x7f097c06e590 2024-08-17T02:23:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.352+0000 7f0978c00640 1 -- 172.21.15.2:0/4112433498 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0968039040 con 0x7f097c06e590 2024-08-17T02:23:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.353+0000 7f0978c00640 1 --2- 172.21.15.2:0/4112433498 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f095c065220 0x7f095c0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.353+0000 7f0978c00640 1 -- 172.21.15.2:0/4112433498 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f09680a23e0 con 0x7f097c06e590 2024-08-17T02:23:40.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.354+0000 7fde4e000640 1 -- 172.21.15.2:0/2349151223 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4800deb0 con 0x7fde580ca9c0 2024-08-17T02:23:40.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.354+0000 7fe401400640 1 --2- 172.21.15.2:0/4035109572 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe3e40651d0 0x7fe3e4067680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe4040cdcd0 tx=0x7fe3f0007aa0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.354+0000 7fde5d600640 1 -- 172.21.15.2:0/2349151223 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde580c7010 con 0x7fde580ca9c0 2024-08-17T02:23:40.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.354+0000 7fde5d600640 1 -- 172.21.15.2:0/2349151223 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde580b2ff0 con 0x7fde580ca9c0 2024-08-17T02:23:40.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.354+0000 7f0980e00640 1 --2- 172.21.15.2:0/4112433498 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f095c065220 0x7f095c0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.354+0000 7fe3f9600640 1 -- 172.21.15.2:0/4035109572 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe3f4050ab0 con 0x7fe4040cf900 2024-08-17T02:23:40.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.355+0000 7f0980e00640 1 --2- 172.21.15.2:0/4112433498 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f095c065220 0x7f095c0676d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f097c154180 tx=0x7f09700090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.356+0000 7fde5d600640 1 -- 172.21.15.2:0/2349151223 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde58063fb0 con 0x7fde580ca9c0 2024-08-17T02:23:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.358+0000 7fde4e000640 1 -- 172.21.15.2:0/2349151223 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4800b8d0 con 0x7fde580ca9c0 2024-08-17T02:23:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.358+0000 7fde4e000640 1 -- 172.21.15.2:0/2349151223 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4800deb0 con 0x7fde580ca9c0 2024-08-17T02:23:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.359+0000 7f0978c00640 1 -- 172.21.15.2:0/4112433498 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f09680705f0 con 0x7f097c06e590 2024-08-17T02:23:40.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.361+0000 7fde4e000640 1 -- 172.21.15.2:0/2349151223 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fde4800ba40 con 0x7fde580ca9c0 2024-08-17T02:23:40.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.362+0000 7fde4e000640 1 --2- 172.21.15.2:0/2349151223 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fde380651b0 0x7fde38067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.363+0000 7fde4e000640 1 -- 172.21.15.2:0/2349151223 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fde48082fe0 con 0x7fde580ca9c0 2024-08-17T02:23:40.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.364+0000 7fde56000640 1 --2- 172.21.15.2:0/2349151223 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fde380651b0 0x7fde38067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.365+0000 7fde56000640 1 --2- 172.21.15.2:0/2349151223 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fde380651b0 0x7fde38067660 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fde44034000 tx=0x7fde44032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.365+0000 7fde4e000640 1 -- 172.21.15.2:0/2349151223 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fde480510e0 con 0x7fde580ca9c0 2024-08-17T02:23:40.703 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2024-08-17T02:23:40.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.700+0000 7f1c65e00640 1 -- 172.21.15.2:0/775138050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f1c3c0054c0 con 0x7f1c5804fda0 2024-08-17T02:23:40.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.701+0000 7f1c53e00640 1 -- 172.21.15.2:0/775138050 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1c600ea910 con 0x7f1c5804fda0 2024-08-17T02:23:40.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.705+0000 7f1c65e00640 1 -- 172.21.15.2:0/775138050 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1c40065230 msgr2=0x7f1c400676e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.705+0000 7f1c65e00640 1 --2- 172.21.15.2:0/775138050 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1c40065230 0x7f1c400676e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1c580d3a10 tx=0x7f1c54008040 comp rx=0 tx=0).stop 2024-08-17T02:23:40.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.705+0000 7f1c65e00640 1 -- 172.21.15.2:0/775138050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c5804fda0 msgr2=0x7f1c580fa330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.705+0000 7f1c65e00640 1 --2- 172.21.15.2:0/775138050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c5804fda0 0x7f1c580fa330 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1c60064d20 tx=0x7f1c600ab000 comp rx=0 tx=0).stop 2024-08-17T02:23:40.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.706+0000 7f1c65e00640 1 -- 172.21.15.2:0/775138050 shutdown_connections 2024-08-17T02:23:40.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.706+0000 7f1c65e00640 1 --2- 172.21.15.2:0/775138050 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1c58037930 0x7f1c580cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.706+0000 7f1c65e00640 1 --2- 172.21.15.2:0/775138050 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1c40065230 0x7f1c400676e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.706+0000 7f1c65e00640 1 --2- 172.21.15.2:0/775138050 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1c580d86d0 0x7f1c580d2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.706+0000 7f1c65e00640 1 --2- 172.21.15.2:0/775138050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c5804fda0 0x7f1c580fa330 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.706+0000 7f1c65e00640 1 -- 172.21.15.2:0/775138050 >> 172.21.15.2:0/775138050 conn(0x7f1c58051600 msgr2=0x7f1c58005b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:40.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.706+0000 7f1c65e00640 1 -- 172.21.15.2:0/775138050 shutdown_connections 2024-08-17T02:23:40.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.707+0000 7f1c65e00640 1 -- 172.21.15.2:0/775138050 wait complete. 2024-08-17T02:23:40.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2024-08-17T02:23:40.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.753+0000 7f0982c00640 1 -- 172.21.15.2:0/4112433498 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f097c0cd270 con 0x7f097c06e590 2024-08-17T02:23:40.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.753+0000 7f0978c00640 1 -- 172.21.15.2:0/4112433498 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0968073c10 con 0x7f097c06e590 2024-08-17T02:23:40.754 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2024-08-17T02:23:40.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.756+0000 7f0982c00640 1 -- 172.21.15.2:0/4112433498 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f095c065220 msgr2=0x7f095c0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.756+0000 7f0982c00640 1 --2- 172.21.15.2:0/4112433498 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f095c065220 0x7f095c0676d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f097c154180 tx=0x7f09700090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.756+0000 7f0982c00640 1 -- 172.21.15.2:0/4112433498 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f097c06e590 msgr2=0x7f097c153c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.756+0000 7f0982c00640 1 --2- 172.21.15.2:0/4112433498 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f097c06e590 0x7f097c153c40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0968009210 tx=0x7f0968032000 comp rx=0 tx=0).stop 2024-08-17T02:23:40.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.756+0000 7f0982c00640 1 -- 172.21.15.2:0/4112433498 shutdown_connections 2024-08-17T02:23:40.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.756+0000 7f0982c00640 1 --2- 172.21.15.2:0/4112433498 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f097c158a00 0x7f097c14fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.756+0000 7f0982c00640 1 --2- 172.21.15.2:0/4112433498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f097c0cb190 0x7f097c1579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.756+0000 7f0982c00640 1 --2- 172.21.15.2:0/4112433498 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f095c065220 0x7f095c0676d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.756+0000 7f0982c00640 1 --2- 172.21.15.2:0/4112433498 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f097c06e590 0x7f097c153c40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.757+0000 7f0982c00640 1 -- 172.21.15.2:0/4112433498 >> 172.21.15.2:0/4112433498 conn(0x7f097c0cfb80 msgr2=0x7f097c0cdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:40.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.757+0000 7f0982c00640 1 -- 172.21.15.2:0/4112433498 shutdown_connections 2024-08-17T02:23:40.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.757+0000 7f0982c00640 1 -- 172.21.15.2:0/4112433498 wait complete. 2024-08-17T02:23:40.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.762+0000 7f3fa1000640 1 -- 172.21.15.2:0/1240515294 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3f9c1697c0 con 0x7f3f9c0ce140 2024-08-17T02:23:40.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.763+0000 7f3f91600640 1 -- 172.21.15.2:0/1240515294 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f8c053390 con 0x7f3f9c0ce140 2024-08-17T02:23:40.763 INFO:teuthology.orchestra.run.smithi002.stdout:55834574851 2024-08-17T02:23:40.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.765+0000 7fa9cf200640 1 -- 172.21.15.2:0/3835346250 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa9d00b4fa0 con 0x7fa9d0158ca0 2024-08-17T02:23:40.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.765+0000 7f72ae000640 1 -- 172.21.15.2:0/3699920475 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f7290005790 con 0x7f72b40066f0 2024-08-17T02:23:40.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.766+0000 7f72b8c00640 1 -- 172.21.15.2:0/3699920475 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f72bc095020 con 0x7f72b40066f0 2024-08-17T02:23:40.767 INFO:teuthology.orchestra.run.smithi002.stdout:55834574851 2024-08-17T02:23:40.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.766+0000 7fa9c5600640 1 -- 172.21.15.2:0/3835346250 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa9c8016090 con 0x7fa9d0158ca0 2024-08-17T02:23:40.768 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2024-08-17T02:23:40.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.766+0000 7f3fa1000640 1 -- 172.21.15.2:0/1240515294 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3f78065220 msgr2=0x7f3f780676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.766+0000 7f3fa1000640 1 --2- 172.21.15.2:0/1240515294 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3f78065220 0x7f3f780676d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3f84034000 tx=0x7f3f84032000 comp rx=0 tx=0).stop 2024-08-17T02:23:40.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.766+0000 7f3fa1000640 1 -- 172.21.15.2:0/1240515294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f9c0ce140 msgr2=0x7f3f9c169b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.766+0000 7f3fa1000640 1 --2- 172.21.15.2:0/1240515294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f9c0ce140 0x7f3f9c169b30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00c4e0 tx=0x7f3f8c007ee0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.767+0000 7f3fa1000640 1 -- 172.21.15.2:0/1240515294 shutdown_connections 2024-08-17T02:23:40.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.767+0000 7f3fa1000640 1 --2- 172.21.15.2:0/1240515294 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3f78065220 0x7f3f780676d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.767+0000 7f3fa1000640 1 --2- 172.21.15.2:0/1240515294 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3f9c1589e0 0x7f3f9c151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.767+0000 7f3fa1000640 1 --2- 172.21.15.2:0/1240515294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f9c0ce140 0x7f3f9c169b30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.767+0000 7f3fa1000640 1 --2- 172.21.15.2:0/1240515294 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3f9c0ca9c0 0x7f3f9c14e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.767+0000 7f3fa1000640 1 -- 172.21.15.2:0/1240515294 >> 172.21.15.2:0/1240515294 conn(0x7f3f9c06e590 msgr2=0x7f3f9c157c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:40.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.767+0000 7f3fa1000640 1 -- 172.21.15.2:0/1240515294 shutdown_connections 2024-08-17T02:23:40.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.767+0000 7f3fa1000640 1 -- 172.21.15.2:0/1240515294 wait complete. 2024-08-17T02:23:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.769+0000 7f72ae000640 1 -- 172.21.15.2:0/3699920475 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f729c0651b0 msgr2=0x7f729c067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.769+0000 7f72ae000640 1 --2- 172.21.15.2:0/3699920475 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f729c0651b0 0x7f729c067660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f72b4003d90 tx=0x7f72b0009040 comp rx=0 tx=0).stop 2024-08-17T02:23:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.769+0000 7f72ae000640 1 -- 172.21.15.2:0/3699920475 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72b40066f0 msgr2=0x7f72b40d55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.769+0000 7f72ae000640 1 --2- 172.21.15.2:0/3699920475 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72b40066f0 0x7f72b40d55f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f72bc065b10 tx=0x7f72bc064990 comp rx=0 tx=0).stop 2024-08-17T02:23:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.769+0000 7f72ae000640 1 -- 172.21.15.2:0/3699920475 shutdown_connections 2024-08-17T02:23:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.769+0000 7f72ae000640 1 --2- 172.21.15.2:0/3699920475 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f729c0651b0 0x7f729c067660 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.769+0000 7f72ae000640 1 --2- 172.21.15.2:0/3699920475 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72b40066f0 0x7f72b40d55f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.769+0000 7f72ae000640 1 --2- 172.21.15.2:0/3699920475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72b40fe1a0 0x7f72b40061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.769+0000 7f72ae000640 1 --2- 172.21.15.2:0/3699920475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72a40047f0 0x7f72b40d7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.769+0000 7f72ae000640 1 -- 172.21.15.2:0/3699920475 >> 172.21.15.2:0/3699920475 conn(0x7f72b4054b90 msgr2=0x7f72b404aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:40.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.769+0000 7f72ae000640 1 -- 172.21.15.2:0/3699920475 shutdown_connections 2024-08-17T02:23:40.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.770+0000 7f72ae000640 1 -- 172.21.15.2:0/3699920475 wait complete. 2024-08-17T02:23:40.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.771+0000 7fa9cf200640 1 -- 172.21.15.2:0/3835346250 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa9b00652a0 msgr2=0x7fa9b0067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.771+0000 7fa9cf200640 1 --2- 172.21.15.2:0/3835346250 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa9b00652a0 0x7fa9b0067750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc034000 tx=0x7fa9bc032000 comp rx=0 tx=0).stop 2024-08-17T02:23:40.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.771+0000 7fa9cf200640 1 -- 172.21.15.2:0/3835346250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9d0158ca0 msgr2=0x7fa9d00c9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.771+0000 7fa9cf200640 1 --2- 172.21.15.2:0/3835346250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9d0158ca0 0x7fa9d00c9080 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800c7e0 tx=0x7fa9c80025b0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.771+0000 7fa9cf200640 1 -- 172.21.15.2:0/3835346250 shutdown_connections 2024-08-17T02:23:40.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.771+0000 7fa9cf200640 1 --2- 172.21.15.2:0/3835346250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9d0158ca0 0x7fa9d00c9080 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.771+0000 7fa9cf200640 1 --2- 172.21.15.2:0/3835346250 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa9b00652a0 0x7fa9b0067750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.771+0000 7fa9cf200640 1 --2- 172.21.15.2:0/3835346250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa9d01588d0 0x7fa9d00a7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.771+0000 7fa9cf200640 1 --2- 172.21.15.2:0/3835346250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9d00cf900 0x7fa9d00b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.771+0000 7fa9cf200640 1 -- 172.21.15.2:0/3835346250 >> 172.21.15.2:0/3835346250 conn(0x7fa9d0087a80 msgr2=0x7fa9d0157800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:40.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.771+0000 7fa9cf200640 1 -- 172.21.15.2:0/3835346250 shutdown_connections 2024-08-17T02:23:40.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.771+0000 7fa9cf200640 1 -- 172.21.15.2:0/3835346250 wait complete. 2024-08-17T02:23:40.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.774+0000 7f2dc2a00640 1 -- 172.21.15.2:0/3585483695 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2db403cb70 con 0x7f2da4004ec0 2024-08-17T02:23:40.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.775+0000 7f2daf400640 1 -- 172.21.15.2:0/3585483695 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2da8019020 con 0x7f2da4004ec0 2024-08-17T02:23:40.776 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2024-08-17T02:23:40.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2024-08-17T02:23:40.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.777+0000 7fe403200640 1 -- 172.21.15.2:0/4035109572 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe40406ea80 con 0x7fe4040cf900 2024-08-17T02:23:40.778 INFO:teuthology.orchestra.run.smithi002.stdout:55834574851 2024-08-17T02:23:40.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.778+0000 7fe3f9600640 1 -- 172.21.15.2:0/4035109572 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe3f40540d0 con 0x7fe4040cf900 2024-08-17T02:23:40.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.780+0000 7f2dc2a00640 1 -- 172.21.15.2:0/3585483695 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2d9c0651b0 msgr2=0x7f2d9c067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.780+0000 7f2dc2a00640 1 --2- 172.21.15.2:0/3585483695 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2d9c0651b0 0x7f2d9c067660 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2db403ad50 tx=0x7f2db0008040 comp rx=0 tx=0).stop 2024-08-17T02:23:40.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.780+0000 7f2dc2a00640 1 -- 172.21.15.2:0/3585483695 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2da4004ec0 msgr2=0x7f2db40ef460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.780+0000 7f2dc2a00640 1 --2- 172.21.15.2:0/3585483695 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2da4004ec0 0x7f2db40ef460 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2da800dbb0 tx=0x7f2da8009040 comp rx=0 tx=0).stop 2024-08-17T02:23:40.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.781+0000 7f2dc2a00640 1 -- 172.21.15.2:0/3585483695 shutdown_connections 2024-08-17T02:23:40.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.781+0000 7f2dc2a00640 1 --2- 172.21.15.2:0/3585483695 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2d9c0651b0 0x7f2d9c067660 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.781+0000 7f2dc2a00640 1 --2- 172.21.15.2:0/3585483695 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2db40db8f0 0x7f2db40089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.781+0000 7f2dc2a00640 1 --2- 172.21.15.2:0/3585483695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2db403a960 0x7f2db403b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.781+0000 7f2dc2a00640 1 --2- 172.21.15.2:0/3585483695 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2da4004ec0 0x7f2db40ef460 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.781+0000 7f2dc2a00640 1 -- 172.21.15.2:0/3585483695 >> 172.21.15.2:0/3585483695 conn(0x7f2db400a800 msgr2=0x7f2db40def10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:40.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.781+0000 7f2dc2a00640 1 -- 172.21.15.2:0/3585483695 shutdown_connections 2024-08-17T02:23:40.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.781+0000 7f2dc2a00640 1 -- 172.21.15.2:0/3585483695 wait complete. 2024-08-17T02:23:40.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.782+0000 7fe403200640 1 -- 172.21.15.2:0/4035109572 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe3e40651d0 msgr2=0x7fe3e4067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.782+0000 7fe403200640 1 --2- 172.21.15.2:0/4035109572 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe3e40651d0 0x7fe3e4067680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe4040cdcd0 tx=0x7fe3f0007aa0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.782+0000 7fe403200640 1 -- 172.21.15.2:0/4035109572 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4040cf900 msgr2=0x7fe4041495d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.782+0000 7fe403200640 1 --2- 172.21.15.2:0/4035109572 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4040cf900 0x7fe4041495d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400d890 tx=0x7fe3f4008040 comp rx=0 tx=0).stop 2024-08-17T02:23:40.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.782+0000 7fe403200640 1 -- 172.21.15.2:0/4035109572 shutdown_connections 2024-08-17T02:23:40.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.782+0000 7fe403200640 1 --2- 172.21.15.2:0/4035109572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe404158ca0 0x7fe4040c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.782+0000 7fe403200640 1 --2- 172.21.15.2:0/4035109572 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe4041588d0 0x7fe4040c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.782+0000 7fe403200640 1 --2- 172.21.15.2:0/4035109572 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe3e40651d0 0x7fe3e4067680 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.782+0000 7fe403200640 1 --2- 172.21.15.2:0/4035109572 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4040cf900 0x7fe4041495d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.782+0000 7fe403200640 1 -- 172.21.15.2:0/4035109572 >> 172.21.15.2:0/4035109572 conn(0x7fe404087a80 msgr2=0x7fe404149f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:40.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.782+0000 7fe403200640 1 -- 172.21.15.2:0/4035109572 shutdown_connections 2024-08-17T02:23:40.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.782+0000 7fe403200640 1 -- 172.21.15.2:0/4035109572 wait complete. 2024-08-17T02:23:40.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.783+0000 7fde5d600640 1 -- 172.21.15.2:0/2349151223 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fde581562f0 con 0x7fde580ca9c0 2024-08-17T02:23:40.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.784+0000 7fde4e000640 1 -- 172.21.15.2:0/2349151223 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fde48054700 con 0x7fde580ca9c0 2024-08-17T02:23:40.785 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2024-08-17T02:23:40.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.788+0000 7fde5d600640 1 -- 172.21.15.2:0/2349151223 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fde380651b0 msgr2=0x7fde38067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.788+0000 7fde5d600640 1 --2- 172.21.15.2:0/2349151223 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fde380651b0 0x7fde38067660 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fde44034000 tx=0x7fde44032000 comp rx=0 tx=0).stop 2024-08-17T02:23:40.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.788+0000 7fde5d600640 1 -- 172.21.15.2:0/2349151223 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fde580ca9c0 msgr2=0x7fde580b2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.788+0000 7fde5d600640 1 --2- 172.21.15.2:0/2349151223 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fde580ca9c0 0x7fde580b2ab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fde4800d8c0 tx=0x7fde48008040 comp rx=0 tx=0).stop 2024-08-17T02:23:40.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.788+0000 7fde5d600640 1 -- 172.21.15.2:0/2349151223 shutdown_connections 2024-08-17T02:23:40.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.788+0000 7fde5d600640 1 --2- 172.21.15.2:0/2349151223 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde581589e0 0x7fde580b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.788+0000 7fde5d600640 1 --2- 172.21.15.2:0/2349151223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde580cda30 0x7fde580c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.788+0000 7fde5d600640 1 --2- 172.21.15.2:0/2349151223 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fde380651b0 0x7fde38067660 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.788+0000 7fde5d600640 1 --2- 172.21.15.2:0/2349151223 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fde580ca9c0 0x7fde580b2ab0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.788+0000 7fde5d600640 1 -- 172.21.15.2:0/2349151223 >> 172.21.15.2:0/2349151223 conn(0x7fde5806e590 msgr2=0x7fde580c63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:40.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.789+0000 7fde5d600640 1 -- 172.21.15.2:0/2349151223 shutdown_connections 2024-08-17T02:23:40.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.1 2024-08-17T02:23:40.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:40.789+0000 7fde5d600640 1 -- 172.21.15.2:0/2349151223 wait complete. 2024-08-17T02:23:40.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2024-08-17T02:23:40.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2024-08-17T02:23:40.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-08-17T02:23:40.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.5 2024-08-17T02:23:40.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-08-17T02:23:41.733 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:23:41.778 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:23:41.791 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:23:41.799 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:23:41.800 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:23:41.804 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:23:41.804 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:23:41.808 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:23:41.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.948+0000 7fa4f7c00640 1 Processor -- start 2024-08-17T02:23:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.948+0000 7fa4f7c00640 1 -- start start 2024-08-17T02:23:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.950+0000 7fa4f7c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa4f0154a80 0x7fa4f00abef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.950+0000 7fa4f7c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4f006dee0 0x7fa4f0154e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.951+0000 7fa4f5200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa4f0154a80 0x7fa4f00abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.951+0000 7fa4f5200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa4f0154a80 0x7fa4f00abef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54164/0 (socket says 172.21.15.2:54164) 2024-08-17T02:23:41.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.952+0000 7fa4efe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa4f0159320 0x7fa4f006d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36150/0 (socket says 172.21.15.2:36150) 2024-08-17T02:23:41.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.952+0000 7fa4f5200640 1 -- 172.21.15.2:0/3791427069 learned_addr learned my addr 172.21.15.2:0/3791427069 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:41.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.953+0000 7fa4f5c00640 1 --2- 172.21.15.2:0/3791427069 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4f006dee0 0x7fa4f0154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.953+0000 7fa4f7c00640 1 -- 172.21.15.2:0/3791427069 --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f00afb80 con 0x7fa4f0159320 2024-08-17T02:23:41.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.954+0000 7fa4f7c00640 1 -- 172.21.15.2:0/3791427069 --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f00ac4f0 con 0x7fa4f0154a80 2024-08-17T02:23:41.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.954+0000 7fa4ef400640 1 -- 172.21.15.2:0/3791427069 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3278251242 0 0) 0x7fa4f00afb80 con 0x7fa4f0159320 2024-08-17T02:23:41.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.954+0000 7fa4f7c00640 1 -- 172.21.15.2:0/3791427069 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f00ac7d0 con 0x7fa4f006dee0 2024-08-17T02:23:41.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.955+0000 7fa4ef400640 1 -- 172.21.15.2:0/3791427069 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4d40034e0 con 0x7fa4f0159320 2024-08-17T02:23:41.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.956+0000 7fa4ef400640 1 -- 172.21.15.2:0/3791427069 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1999877055 0 0) 0x7fa4d40034e0 con 0x7fa4f0159320 2024-08-17T02:23:41.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.956+0000 7fa4f5200640 1 -- 172.21.15.2:0/3791427069 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4f006dee0 msgr2=0x7fa4f0154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:41.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.956+0000 7fa4f5200640 1 --2- 172.21.15.2:0/3791427069 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4f006dee0 0x7fa4f0154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.956+0000 7fa4f5200640 1 -- 172.21.15.2:0/3791427069 >> v1:172.21.15.2:6789/0 conn(0x7fa4f0159320 legacy=0x7fa4f006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.957+0000 7fa4f5200640 1 -- 172.21.15.2:0/3791427069 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f00acab0 con 0x7fa4f0154a80 2024-08-17T02:23:41.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.959+0000 7fa4f5200640 1 --2- 172.21.15.2:0/3791427069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4f0154a80 0x7fa4f00abef0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8009f20 tx=0x7fa4e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7f5332446404b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.959+0000 7fa4ef400640 1 -- 172.21.15.2:0/3791427069 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0001490 con 0x7fa4f0154a80 2024-08-17T02:23:41.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.960+0000 7fa4ef400640 1 -- 172.21.15.2:0/3791427069 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e802d050 con 0x7fa4f0154a80 2024-08-17T02:23:41.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.960+0000 7fa4ef400640 1 -- 172.21.15.2:0/3791427069 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8031400 con 0x7fa4f0154a80 2024-08-17T02:23:41.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.961+0000 7fa4f7c00640 1 -- 172.21.15.2:0/3791427069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4f0154a80 msgr2=0x7fa4f00abef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.961+0000 7fa4f7c00640 1 --2- 172.21.15.2:0/3791427069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4f0154a80 0x7fa4f00abef0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8009f20 tx=0x7fa4e8009840 comp rx=0 tx=0).stop 2024-08-17T02:23:41.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.962+0000 7fa4f7c00640 1 -- 172.21.15.2:0/3791427069 shutdown_connections 2024-08-17T02:23:41.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.962+0000 7fa4f7c00640 1 --2- 172.21.15.2:0/3791427069 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4f006dee0 0x7fa4f0154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.962+0000 7fa4f7c00640 1 --2- 172.21.15.2:0/3791427069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4f0154a80 0x7fa4f00abef0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.962+0000 7fa4f7c00640 1 -- 172.21.15.2:0/3791427069 >> 172.21.15.2:0/3791427069 conn(0x7fa4f0066e60 msgr2=0x7fa4f0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:41.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.962+0000 7fa4f7c00640 1 -- 172.21.15.2:0/3791427069 shutdown_connections 2024-08-17T02:23:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.962+0000 7fa4f7c00640 1 -- 172.21.15.2:0/3791427069 wait complete. 2024-08-17T02:23:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.964+0000 7fa4f7c00640 1 Processor -- start 2024-08-17T02:23:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.965+0000 7fa4f7c00640 1 -- start start 2024-08-17T02:23:41.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.967+0000 7fa4f7c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4f006dee0 0x7fa4f0150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.968+0000 7fa4f7c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4f0154a80 0x7fa4f0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.968+0000 7fa4f5200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4f006dee0 0x7fa4f0150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.968+0000 7fa4f5200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4f006dee0 0x7fa4f0150fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47396/0 (socket says 172.21.15.2:47396) 2024-08-17T02:23:41.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.968+0000 7fa4f5200640 1 -- 172.21.15.2:0/4211280546 learned_addr learned my addr 172.21.15.2:0/4211280546 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:41.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.969+0000 7fa4f7c00640 1 --2- 172.21.15.2:0/4211280546 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4f0159320 0x7fa4f015d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.969+0000 7fa4f7c00640 1 -- 172.21.15.2:0/4211280546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f015aa20 con 0x7fa4f0154a80 2024-08-17T02:23:41.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.969+0000 7fa4f7c00640 1 -- 172.21.15.2:0/4211280546 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f015acc0 con 0x7fa4f0159320 2024-08-17T02:23:41.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.969+0000 7fa4f7c00640 1 -- 172.21.15.2:0/4211280546 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f0151520 con 0x7fa4f006dee0 2024-08-17T02:23:41.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.969+0000 7fa4f5c00640 1 --2- 172.21.15.2:0/4211280546 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4f0159320 0x7fa4f015d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.970+0000 7fa4f5c00640 1 -- 172.21.15.2:0/4211280546 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4f006dee0 msgr2=0x7fa4f0150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.970+0000 7fa4f5c00640 1 --2- 172.21.15.2:0/4211280546 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4f006dee0 0x7fa4f0150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.970+0000 7fa4f5c00640 1 -- 172.21.15.2:0/4211280546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4f0154a80 msgr2=0x7fa4f0156e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:23:41.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.971+0000 7fa4efe00640 1 --2- 172.21.15.2:0/4211280546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4f0154a80 0x7fa4f0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.971+0000 7fa4f5c00640 1 --2- 172.21.15.2:0/4211280546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4f0154a80 0x7fa4f0156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.971+0000 7fa4f5c00640 1 -- 172.21.15.2:0/4211280546 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e8009ae0 con 0x7fa4f0159320 2024-08-17T02:23:41.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.971+0000 7fa4f5c00640 1 --2- 172.21.15.2:0/4211280546 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4f0159320 0x7fa4f015d3d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00e930 tx=0x7fa4dc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.972+0000 7fa4efe00640 1 --2- 172.21.15.2:0/4211280546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4f0154a80 0x7fa4f0156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:41.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.972+0000 7fa4e7e00640 1 -- 172.21.15.2:0/4211280546 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc00c940 con 0x7fa4f0159320 2024-08-17T02:23:41.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.972+0000 7fa4e7e00640 1 -- 172.21.15.2:0/4211280546 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4dc00caa0 con 0x7fa4f0159320 2024-08-17T02:23:41.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.972+0000 7fa4e7e00640 1 -- 172.21.15.2:0/4211280546 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc00ce40 con 0x7fa4f0159320 2024-08-17T02:23:41.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.972+0000 7fa4f7c00640 1 -- 172.21.15.2:0/4211280546 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f0157770 con 0x7fa4f0159320 2024-08-17T02:23:41.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.973+0000 7fa4f7c00640 1 -- 172.21.15.2:0/4211280546 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f0157d30 con 0x7fa4f0159320 2024-08-17T02:23:41.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.974+0000 7fa4f7c00640 1 -- 172.21.15.2:0/4211280546 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f015ae70 con 0x7fa4f0159320 2024-08-17T02:23:41.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.977+0000 7fa4e7e00640 1 -- 172.21.15.2:0/4211280546 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa4dc013680 con 0x7fa4f0159320 2024-08-17T02:23:41.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.978+0000 7fa4e7e00640 1 --2- 172.21.15.2:0/4211280546 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa4d00652a0 0x7fa4d0067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.979+0000 7fa4e7e00640 1 -- 172.21.15.2:0/4211280546 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa4dc0823f0 con 0x7fa4f0159320 2024-08-17T02:23:41.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.979+0000 7fa4f5200640 1 --2- 172.21.15.2:0/4211280546 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa4d00652a0 0x7fa4d0067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.981+0000 7fa4f5200640 1 --2- 172.21.15.2:0/4211280546 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa4d00652a0 0x7fa4d0067750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8009880 tx=0x7fa4e8036000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:41.982+0000 7fa4e7e00640 1 -- 172.21.15.2:0/4211280546 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa4f015ae70 con 0x7fa4f0159320 2024-08-17T02:23:42.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.017+0000 7f8318a00640 1 Processor -- start 2024-08-17T02:23:42.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.017+0000 7f8318a00640 1 -- start start 2024-08-17T02:23:42.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.019+0000 7f8318a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f830c052170 0x7f830c0dfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.019+0000 7f8318a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f830c0363e0 con 0x7f830c051da0 2024-08-17T02:23:42.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.019+0000 7f8318a00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f830c054b10 con 0x7f830c0e0070 2024-08-17T02:23:42.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.019+0000 7f8318a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f830c0525f0 con 0x7f830c052170 2024-08-17T02:23:42.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.020+0000 7f8311e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f830c051da0 0x7f830c035960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36158/0 (socket says 172.21.15.2:36158) 2024-08-17T02:23:42.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.020+0000 7f8311e00640 1 -- 172.21.15.2:0/1912548841 learned_addr learned my addr 172.21.15.2:0/1912548841 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:42.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.022+0000 7f8311400640 1 --2- 172.21.15.2:0/1912548841 >> v2:172.21.15.2:3300/0 conn(0x7f830c052170 0x7f830c0dfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.020+0000 7f8312800640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f830c0e0070 0x7f830c0555f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:56468/0 (socket says 172.21.15.2:56468) 2024-08-17T02:23:42.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.022+0000 7f8310a00640 1 -- 172.21.15.2:0/1912548841 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499248407 0 0) 0x7f830c054b10 con 0x7f830c0e0070 2024-08-17T02:23:42.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.023+0000 7f8310a00640 1 -- 172.21.15.2:0/1912548841 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82f80034e0 con 0x7f830c0e0070 2024-08-17T02:23:42.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.023+0000 7f8310a00640 1 -- 172.21.15.2:0/1912548841 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893233788 0 0) 0x7f830c0363e0 con 0x7f830c051da0 2024-08-17T02:23:42.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.024+0000 7f8311400640 1 -- 172.21.15.2:0/1912548841 >> v1:172.21.15.145:6789/0 conn(0x7f830c0e0070 legacy=0x7f830c0555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.024+0000 7f8311400640 1 -- 172.21.15.2:0/1912548841 >> v1:172.21.15.2:6789/0 conn(0x7f830c051da0 legacy=0x7f830c035960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.024+0000 7f8311400640 1 -- 172.21.15.2:0/1912548841 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830c054df0 con 0x7f830c052170 2024-08-17T02:23:42.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.026+0000 7f8311400640 1 --2- 172.21.15.2:0/1912548841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f830c052170 0x7f830c0dfb30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f831404ca10 tx=0x7f8314064990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885203795f7e84ff server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.027+0000 7f8310a00640 1 -- 172.21.15.2:0/1912548841 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83000013a0 con 0x7f830c052170 2024-08-17T02:23:42.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.027+0000 7f8310a00640 1 -- 172.21.15.2:0/1912548841 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83140a1ab0 con 0x7f830c052170 2024-08-17T02:23:42.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.030+0000 7f8310a00640 1 -- 172.21.15.2:0/1912548841 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83000013a0 con 0x7f830c052170 2024-08-17T02:23:42.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.030+0000 7f8318a00640 1 -- 172.21.15.2:0/1912548841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f830c052170 msgr2=0x7f830c0dfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.030+0000 7f8318a00640 1 --2- 172.21.15.2:0/1912548841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f830c052170 0x7f830c0dfb30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f831404ca10 tx=0x7f8314064990 comp rx=0 tx=0).stop 2024-08-17T02:23:42.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.031+0000 7f8318a00640 1 -- 172.21.15.2:0/1912548841 shutdown_connections 2024-08-17T02:23:42.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.031+0000 7f8318a00640 1 --2- 172.21.15.2:0/1912548841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f830c052170 0x7f830c0dfb30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.031+0000 7f8318a00640 1 -- 172.21.15.2:0/1912548841 >> 172.21.15.2:0/1912548841 conn(0x7f830c00a800 msgr2=0x7f830c056da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.032+0000 7f8318a00640 1 -- 172.21.15.2:0/1912548841 shutdown_connections 2024-08-17T02:23:42.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.032+0000 7f8318a00640 1 -- 172.21.15.2:0/1912548841 wait complete. 2024-08-17T02:23:42.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.034+0000 7f8318a00640 1 Processor -- start 2024-08-17T02:23:42.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.035+0000 7f8318a00640 1 -- start start 2024-08-17T02:23:42.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.037+0000 7f8318a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f830c051da0 0x7f830c038ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.037+0000 7f8318a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f830c052170 0x7f830c03a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.038+0000 7f8318a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f830c0e0070 0x7f830c0db780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.038+0000 7f8312800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f830c0e0070 0x7f830c0db780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.038+0000 7f8312800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f830c0e0070 0x7f830c0db780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54194/0 (socket says 172.21.15.2:54194) 2024-08-17T02:23:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.038+0000 7f8311e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f830c051da0 0x7f830c038ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.039+0000 7f8312800640 1 -- 172.21.15.2:0/1468686504 learned_addr learned my addr 172.21.15.2:0/1468686504 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.039+0000 7f8311e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f830c051da0 0x7f830c038ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47410/0 (socket says 172.21.15.2:47410) 2024-08-17T02:23:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.039+0000 7f8318a00640 1 -- 172.21.15.2:0/1468686504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c03aa90 con 0x7f830c0e0070 2024-08-17T02:23:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.039+0000 7f8318a00640 1 -- 172.21.15.2:0/1468686504 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c03bd90 con 0x7f830c052170 2024-08-17T02:23:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.039+0000 7f8311400640 1 --2- 172.21.15.2:0/1468686504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f830c052170 0x7f830c03a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.039+0000 7f8318a00640 1 -- 172.21.15.2:0/1468686504 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f830c03acf0 con 0x7f830c051da0 2024-08-17T02:23:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.040+0000 7f8311e00640 1 -- 172.21.15.2:0/1468686504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f830c052170 msgr2=0x7f830c03a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.040+0000 7f8311e00640 1 --2- 172.21.15.2:0/1468686504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f830c052170 0x7f830c03a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.041+0000 7f8311e00640 1 -- 172.21.15.2:0/1468686504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f830c0e0070 msgr2=0x7f830c0db780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.041+0000 7f8311e00640 1 --2- 172.21.15.2:0/1468686504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f830c0e0070 0x7f830c0db780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.041+0000 7f8311e00640 1 -- 172.21.15.2:0/1468686504 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831404c200 con 0x7f830c051da0 2024-08-17T02:23:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.041+0000 7f8312800640 1 --2- 172.21.15.2:0/1468686504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f830c0e0070 0x7f830c0db780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.041+0000 7f8311400640 1 --2- 172.21.15.2:0/1468686504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f830c052170 0x7f830c03a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.041+0000 7f8311e00640 1 --2- 172.21.15.2:0/1468686504 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f830c051da0 0x7f830c038ea0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8304000c00 tx=0x7f8304007c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.043+0000 7f8309600640 1 -- 172.21.15.2:0/1468686504 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8304005aa0 con 0x7f830c051da0 2024-08-17T02:23:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.043+0000 7f8309600640 1 -- 172.21.15.2:0/1468686504 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8304005c40 con 0x7f830c051da0 2024-08-17T02:23:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.043+0000 7f8309600640 1 -- 172.21.15.2:0/1468686504 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83040070d0 con 0x7f830c051da0 2024-08-17T02:23:42.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.043+0000 7f8318a00640 1 -- 172.21.15.2:0/1468686504 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f830c03afd0 con 0x7f830c051da0 2024-08-17T02:23:42.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.043+0000 7f8318a00640 1 -- 172.21.15.2:0/1468686504 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830c03b590 con 0x7f830c051da0 2024-08-17T02:23:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.046+0000 7f8318a00640 1 -- 172.21.15.2:0/1468686504 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f830c0056a0 con 0x7f830c051da0 2024-08-17T02:23:42.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.049+0000 7f8309600640 1 -- 172.21.15.2:0/1468686504 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f83040074c0 con 0x7f830c051da0 2024-08-17T02:23:42.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.050+0000 7f8309600640 1 --2- 172.21.15.2:0/1468686504 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f82f40652a0 0x7f82f4067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.050+0000 7f8309600640 1 -- 172.21.15.2:0/1468686504 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8304081f80 con 0x7f830c051da0 2024-08-17T02:23:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.052+0000 7f8311400640 1 --2- 172.21.15.2:0/1468686504 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f82f40652a0 0x7f82f4067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.052+0000 7f8309600640 1 -- 172.21.15.2:0/1468686504 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8304050150 con 0x7f830c051da0 2024-08-17T02:23:42.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.053+0000 7f8311400640 1 --2- 172.21.15.2:0/1468686504 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f82f40652a0 0x7f82f4067750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f830c00f490 tx=0x7f83140ab000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.097+0000 7f91cb000640 1 Processor -- start 2024-08-17T02:23:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.098+0000 7f91cb000640 1 -- start start 2024-08-17T02:23:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.099+0000 7f91cb000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f91c4155100 0x7f91c40cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.100+0000 7f91cb000640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f91c40684c0 0x7f91c40cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.100+0000 7f91cb000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c4068030 con 0x7f91c41554d0 2024-08-17T02:23:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.100+0000 7f91cb000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c4067420 con 0x7f91c4155100 2024-08-17T02:23:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.100+0000 7f91cb000640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c4067700 con 0x7f91c40684c0 2024-08-17T02:23:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.100+0000 7f91c9000640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f91c40684c0 0x7f91c40cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.100+0000 7f91c9000640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f91c40684c0 0x7f91c40cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:47668/0 (socket says 172.21.15.2:47668) 2024-08-17T02:23:42.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.100+0000 7f91c9000640 1 -- 172.21.15.2:0/3010462920 learned_addr learned my addr 172.21.15.2:0/3010462920 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:42.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.100+0000 7f22a2e00640 1 Processor -- start 2024-08-17T02:23:42.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.101+0000 7f91c3e00640 1 --2- 172.21.15.2:0/3010462920 >> v2:172.21.15.2:3300/0 conn(0x7f91c4155100 0x7f91c40cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.101+0000 7f91c9000640 1 -- 172.21.15.2:0/3010462920 >> v2:172.21.15.2:3300/0 conn(0x7f91c4155100 msgr2=0x7f91c40cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:42.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.101+0000 7f91c9000640 1 --2- 172.21.15.2:0/3010462920 >> v2:172.21.15.2:3300/0 conn(0x7f91c4155100 0x7f91c40cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.101+0000 7f91c9000640 1 -- 172.21.15.2:0/3010462920 >> v1:172.21.15.2:6789/0 conn(0x7f91c41554d0 legacy=0x7f91c40aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:42.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.101+0000 7f91c9000640 1 -- 172.21.15.2:0/3010462920 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c40679e0 con 0x7f91c40684c0 2024-08-17T02:23:42.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.101+0000 7f22a2e00640 1 -- start start 2024-08-17T02:23:42.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.102+0000 7f22a2e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f229c158dd0 0x7f229c06e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.102+0000 7f22a2e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f229c06ead0 0x7f229c0b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.102+0000 7f22a2e00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f229c06eef0 con 0x7f229c158a00 2024-08-17T02:23:42.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.103+0000 7f22a2e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f229c159230 con 0x7f229c158dd0 2024-08-17T02:23:42.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.103+0000 7f22a2e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f229c0cbc50 con 0x7f229c06ead0 2024-08-17T02:23:42.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.103+0000 7f22a1000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f229c158dd0 0x7f229c06e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.103+0000 7f22a1000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f229c158dd0 0x7f229c06e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54214/0 (socket says 172.21.15.2:54214) 2024-08-17T02:23:42.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.103+0000 7f22a1000640 1 -- 172.21.15.2:0/1865937729 learned_addr learned my addr 172.21.15.2:0/1865937729 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:42.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.104+0000 7f22a1000640 1 -- 172.21.15.2:0/1865937729 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f229c06ead0 msgr2=0x7f229c0b3130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:23:42.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.104+0000 7f22a1000640 1 --2- 172.21.15.2:0/1865937729 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f229c06ead0 0x7f229c0b3130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.104+0000 7f22a1000640 1 -- 172.21.15.2:0/1865937729 >> v1:172.21.15.145:6789/0 conn(0x7f229c158a00 legacy=0x7f229c0cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:42.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.104+0000 7f22a1000640 1 -- 172.21.15.2:0/1865937729 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229c0cbf30 con 0x7f229c158dd0 2024-08-17T02:23:42.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.105+0000 7f91c9000640 1 --2- 172.21.15.2:0/3010462920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91c40684c0 0x7f91c40cc610 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f91c4070c10 tx=0x7f91bc009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ab6161745f17ae1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.105+0000 7f6bcae00640 1 Processor -- start 2024-08-17T02:23:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.106+0000 7f22a1000640 1 --2- 172.21.15.2:0/1865937729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f229c158dd0 0x7f229c06e590 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2294009f20 tx=0x7f2294009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b18e77b33a890a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.106+0000 7f6bcae00640 1 -- start start 2024-08-17T02:23:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.106+0000 7f229be00640 1 -- 172.21.15.2:0/1865937729 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294031400 con 0x7f229c158dd0 2024-08-17T02:23:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.106+0000 7f229be00640 1 -- 172.21.15.2:0/1865937729 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229402d050 con 0x7f229c158dd0 2024-08-17T02:23:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.106+0000 7f229be00640 1 -- 172.21.15.2:0/1865937729 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22940317d0 con 0x7f229c158dd0 2024-08-17T02:23:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.107+0000 7f91c2a00640 1 -- 172.21.15.2:0/3010462920 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc033460 con 0x7f91c40684c0 2024-08-17T02:23:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.107+0000 7f91c2a00640 1 -- 172.21.15.2:0/3010462920 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91bc0335c0 con 0x7f91c40684c0 2024-08-17T02:23:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.107+0000 7f91c2a00640 1 -- 172.21.15.2:0/3010462920 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc0339a0 con 0x7f91c40684c0 2024-08-17T02:23:42.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.107+0000 7f22a2e00640 1 -- 172.21.15.2:0/1865937729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f229c158dd0 msgr2=0x7f229c06e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.107+0000 7f22a2e00640 1 --2- 172.21.15.2:0/1865937729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f229c158dd0 0x7f229c06e590 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2294009f20 tx=0x7f2294009840 comp rx=0 tx=0).stop 2024-08-17T02:23:42.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.107+0000 7f22a2e00640 1 -- 172.21.15.2:0/1865937729 shutdown_connections 2024-08-17T02:23:42.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.107+0000 7f6bcae00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6bc40aee60 0x7f6bc40caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.108+0000 7f6bcae00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc40afd20 con 0x7f6bc40aea20 2024-08-17T02:23:42.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.108+0000 7f6bcae00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc40affe0 con 0x7f6bc4158b90 2024-08-17T02:23:42.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.108+0000 7f6bcae00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc40b02c0 con 0x7f6bc40aee60 2024-08-17T02:23:42.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.107+0000 7f22a2e00640 1 --2- 172.21.15.2:0/1865937729 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f229c06ead0 0x7f229c0b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.108+0000 7f22a2e00640 1 --2- 172.21.15.2:0/1865937729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f229c158dd0 0x7f229c06e590 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.108+0000 7f22a2e00640 1 -- 172.21.15.2:0/1865937729 >> 172.21.15.2:0/1865937729 conn(0x7f229c0cfb80 msgr2=0x7f229c0cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.108+0000 7f91cb000640 1 -- 172.21.15.2:0/3010462920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91c40684c0 msgr2=0x7f91c40cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.108+0000 7f91cb000640 1 --2- 172.21.15.2:0/3010462920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91c40684c0 0x7f91c40cc610 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f91c4070c10 tx=0x7f91bc009840 comp rx=0 tx=0).stop 2024-08-17T02:23:42.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.108+0000 7f172e400640 1 Processor -- start 2024-08-17T02:23:42.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.108+0000 7f172e400640 1 -- start start 2024-08-17T02:23:42.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.108+0000 7fbc05000640 1 Processor -- start 2024-08-17T02:23:42.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.108+0000 7f22a2e00640 1 -- 172.21.15.2:0/1865937729 shutdown_connections 2024-08-17T02:23:42.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.108+0000 7f22a2e00640 1 -- 172.21.15.2:0/1865937729 wait complete. 2024-08-17T02:23:42.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.109+0000 7f6bc3e00640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f6bc4158b90 0x7f6bc40b1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:56486/0 (socket says 172.21.15.2:56486) 2024-08-17T02:23:42.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.109+0000 7f6bc3e00640 1 -- 172.21.15.2:0/1551395240 learned_addr learned my addr 172.21.15.2:0/1551395240 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:42.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.110+0000 7f172e400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17280d0070 0x7f17280cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.110+0000 7f172e400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17280cdef0 con 0x7f17280cfc10 2024-08-17T02:23:42.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.110+0000 7f172e400640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17280ccf10 con 0x7f172814fe00 2024-08-17T02:23:42.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.109+0000 7fbc05000640 1 -- start start 2024-08-17T02:23:42.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.110+0000 7f172e400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17280af8e0 con 0x7f17280d0070 2024-08-17T02:23:42.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.110+0000 7fbc05000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc000aa620 0x7fbc000aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.111+0000 7fbc05000640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbc000b2100 0x7fbc001605a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.111+0000 7fbc05000640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc00156fc0 con 0x7fbc000aaf30 2024-08-17T02:23:42.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.111+0000 7f1727400640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f172814fe00 0x7f17280cc4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:56496/0 (socket says 172.21.15.2:56496) 2024-08-17T02:23:42.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.111+0000 7f1727400640 1 -- 172.21.15.2:0/1172938476 learned_addr learned my addr 172.21.15.2:0/1172938476 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:42.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.111+0000 7fbc05000640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc00158450 con 0x7fbc000b2100 2024-08-17T02:23:42.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.111+0000 7fbc05000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc001586f0 con 0x7fbc000aa620 2024-08-17T02:23:42.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.111+0000 7f1727e00640 1 --2- 172.21.15.2:0/1172938476 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17280d0070 0x7f17280cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.111+0000 7fbbfea00640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fbc000aaf30 0x7fbc000b19f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:56498/0 (socket says 172.21.15.2:56498) 2024-08-17T02:23:42.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.111+0000 7fbbfea00640 1 -- 172.21.15.2:0/1267120837 learned_addr learned my addr 172.21.15.2:0/1267120837 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:42.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.111+0000 7fbbffe00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbc000b2100 0x7fbc001605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.110+0000 7f22a2e00640 1 Processor -- start 2024-08-17T02:23:42.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.110+0000 7f22a2e00640 1 -- start start 2024-08-17T02:23:42.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.112+0000 7f22a2e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f229c06ead0 0x7f229c178e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.112+0000 7f22a2e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f229c158a00 0x7f229c1793b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.112+0000 7f22a2e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f229c158dd0 0x7f229c16bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.112+0000 7f22a2e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229c176a40 con 0x7f229c06ead0 2024-08-17T02:23:42.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.112+0000 7f22a2e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229c15aa40 con 0x7f229c158dd0 2024-08-17T02:23:42.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.112+0000 7f22a2e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f229c15ad20 con 0x7f229c158a00 2024-08-17T02:23:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.112+0000 7fbbffe00640 1 -- 172.21.15.2:0/1267120837 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc000aa620 msgr2=0x7fbc000aa9f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:23:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.112+0000 7fbbffe00640 1 --2- 172.21.15.2:0/1267120837 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc000aa620 0x7fbc000aa9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.112+0000 7fbbffe00640 1 -- 172.21.15.2:0/1267120837 >> v1:172.21.15.145:6789/0 conn(0x7fbc000aaf30 legacy=0x7fbc000b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.112+0000 7fbbffe00640 1 -- 172.21.15.2:0/1267120837 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc000b2a20 con 0x7fbc000b2100 2024-08-17T02:23:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.112+0000 7f1727e00640 1 -- 172.21.15.2:0/1172938476 >> v1:172.21.15.145:6789/0 conn(0x7f172814fe00 legacy=0x7f17280cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.112+0000 7f1727e00640 1 -- 172.21.15.2:0/1172938476 >> v1:172.21.15.2:6789/0 conn(0x7f17280cfc10 legacy=0x7f17280ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.112+0000 7f22a1000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f229c158a00 0x7f229c1793b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.113+0000 7f91cb000640 1 -- 172.21.15.2:0/3010462920 shutdown_connections 2024-08-17T02:23:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.113+0000 7f91cb000640 1 --2- 172.21.15.2:0/3010462920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91c40684c0 0x7f91c40cc610 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.113+0000 7f91cb000640 1 --2- 172.21.15.2:0/3010462920 >> v2:172.21.15.2:3300/0 conn(0x7f91c4155100 0x7f91c40cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.113+0000 7f91cb000640 1 -- 172.21.15.2:0/3010462920 >> 172.21.15.2:0/3010462920 conn(0x7f91c406e5b0 msgr2=0x7f91c40b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.113+0000 7f6bc8e00640 1 --2- 172.21.15.2:0/1551395240 >> v2:172.21.15.2:3300/0 conn(0x7f6bc40aee60 0x7f6bc40caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.113+0000 7f6bc3400640 1 -- 172.21.15.2:0/1551395240 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511554098 0 0) 0x7f6bc40afd20 con 0x7f6bc40aea20 2024-08-17T02:23:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.113+0000 7f6bc3400640 1 -- 172.21.15.2:0/1551395240 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ba80034e0 con 0x7f6bc40aea20 2024-08-17T02:23:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.113+0000 7f91cb000640 1 -- 172.21.15.2:0/3010462920 shutdown_connections 2024-08-17T02:23:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.112+0000 7f22a1000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f229c158a00 0x7f229c1793b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47444/0 (socket says 172.21.15.2:47444) 2024-08-17T02:23:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.112+0000 7f22a1000640 1 -- 172.21.15.2:0/3399109632 learned_addr learned my addr 172.21.15.2:0/3399109632 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.112+0000 7f22a1a00640 1 --2- 172.21.15.2:0/3399109632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f229c06ead0 0x7f229c178e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.112+0000 7f22a2400640 1 --2- 172.21.15.2:0/3399109632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f229c158dd0 0x7f229c16bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.113+0000 7f22a1000640 1 -- 172.21.15.2:0/3399109632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f229c158dd0 msgr2=0x7f229c16bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.113+0000 7f22a1000640 1 --2- 172.21.15.2:0/3399109632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f229c158dd0 0x7f229c16bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.113+0000 7f22a1000640 1 -- 172.21.15.2:0/3399109632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f229c06ead0 msgr2=0x7f229c178e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.113+0000 7f22a1000640 1 --2- 172.21.15.2:0/3399109632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f229c06ead0 0x7f229c178e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.113+0000 7f22a1000640 1 -- 172.21.15.2:0/3399109632 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2294009ae0 con 0x7f229c158a00 2024-08-17T02:23:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.113+0000 7f22a2400640 1 --2- 172.21.15.2:0/3399109632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f229c158dd0 0x7f229c16bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:42.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.113+0000 7f22a1000640 1 --2- 172.21.15.2:0/3399109632 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f229c158a00 0x7f229c1793b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2294009ab0 tx=0x7f2294036000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.113+0000 7f1727e00640 1 -- 172.21.15.2:0/1172938476 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17280cdba0 con 0x7f17280d0070 2024-08-17T02:23:42.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.113+0000 7f6bc8e00640 1 -- 172.21.15.2:0/1551395240 >> v1:172.21.15.145:6789/0 conn(0x7f6bc4158b90 legacy=0x7f6bc40b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.113+0000 7f6bc8e00640 1 -- 172.21.15.2:0/1551395240 >> v1:172.21.15.2:6789/0 conn(0x7f6bc40aea20 legacy=0x7f6bc40ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.113+0000 7f6bc8e00640 1 -- 172.21.15.2:0/1551395240 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc40ca3c0 con 0x7f6bc40aee60 2024-08-17T02:23:42.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.113+0000 7f91cb000640 1 -- 172.21.15.2:0/3010462920 wait complete. 2024-08-17T02:23:42.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.114+0000 7fbbffe00640 1 --2- 172.21.15.2:0/1267120837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc000b2100 0x7fbc001605a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009e60 tx=0x7fbbf8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=216aa98ebd999444 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.115+0000 7f2298c00640 1 -- 172.21.15.2:0/3399109632 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294007760 con 0x7f229c158a00 2024-08-17T02:23:42.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.115+0000 7f2298c00640 1 -- 172.21.15.2:0/3399109632 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22940078c0 con 0x7f229c158a00 2024-08-17T02:23:42.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.115+0000 7f2298c00640 1 -- 172.21.15.2:0/3399109632 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294007c60 con 0x7f229c158a00 2024-08-17T02:23:42.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.115+0000 7f22a2e00640 1 -- 172.21.15.2:0/3399109632 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f229c176c90 con 0x7f229c158a00 2024-08-17T02:23:42.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.115+0000 7f22a2e00640 1 -- 172.21.15.2:0/3399109632 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f229c0c6650 con 0x7f229c158a00 2024-08-17T02:23:42.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.115+0000 7fbbfe000640 1 -- 172.21.15.2:0/1267120837 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf8007550 con 0x7fbc000b2100 2024-08-17T02:23:42.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.115+0000 7fbbfe000640 1 -- 172.21.15.2:0/1267120837 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf802d050 con 0x7fbc000b2100 2024-08-17T02:23:42.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.115+0000 7fbbfe000640 1 -- 172.21.15.2:0/1267120837 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf8007920 con 0x7fbc000b2100 2024-08-17T02:23:42.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.116+0000 7f91cb000640 1 Processor -- start 2024-08-17T02:23:42.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.116+0000 7f91cb000640 1 -- start start 2024-08-17T02:23:42.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.116+0000 7f6bc8e00640 1 --2- 172.21.15.2:0/1551395240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bc40aee60 0x7f6bc40caff0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc009850 tx=0x7f6bbc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179e487cd2da8d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.116+0000 7f6bc3400640 1 -- 172.21.15.2:0/1551395240 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc02ae40 con 0x7f6bc40aee60 2024-08-17T02:23:42.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.116+0000 7f6bc3400640 1 -- 172.21.15.2:0/1551395240 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc032440 con 0x7f6bc40aee60 2024-08-17T02:23:42.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.116+0000 7f6bc3400640 1 -- 172.21.15.2:0/1551395240 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc032820 con 0x7f6bc40aee60 2024-08-17T02:23:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.116+0000 7f1727e00640 1 --2- 172.21.15.2:0/1172938476 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17280d0070 0x7f17280cea90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1718009880 tx=0x7f17180090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51a5720bc33075d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.116+0000 7f1726000640 1 -- 172.21.15.2:0/1172938476 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171802ad70 con 0x7f17280d0070 2024-08-17T02:23:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.117+0000 7f1726000640 1 -- 172.21.15.2:0/1172938476 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1718032440 con 0x7f17280d0070 2024-08-17T02:23:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.117+0000 7f1726000640 1 -- 172.21.15.2:0/1172938476 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718032820 con 0x7f17280d0070 2024-08-17T02:23:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.116+0000 7fbc05000640 1 -- 172.21.15.2:0/1267120837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc000b2100 msgr2=0x7fbc001605a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.116+0000 7fbc05000640 1 --2- 172.21.15.2:0/1267120837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc000b2100 0x7fbc001605a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009e60 tx=0x7fbbf8009780 comp rx=0 tx=0).stop 2024-08-17T02:23:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.117+0000 7fbc05000640 1 -- 172.21.15.2:0/1267120837 shutdown_connections 2024-08-17T02:23:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.117+0000 7fbc05000640 1 --2- 172.21.15.2:0/1267120837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc000b2100 0x7fbc001605a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.117+0000 7f6bcae00640 1 -- 172.21.15.2:0/1551395240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bc40aee60 msgr2=0x7f6bc40caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.117+0000 7f6bcae00640 1 --2- 172.21.15.2:0/1551395240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bc40aee60 0x7f6bc40caff0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc009850 tx=0x7f6bbc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.118+0000 7fbc05000640 1 --2- 172.21.15.2:0/1267120837 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc000aa620 0x7fbc000aa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.118+0000 7f91cb000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91c40684c0 0x7f91c41689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.118+0000 7f91cb000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91c4155100 0x7f91c4152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.118+0000 7f91cb000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91c41554d0 0x7f91c4098720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.118+0000 7f91cb000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c4168f30 con 0x7f91c40684c0 2024-08-17T02:23:42.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.118+0000 7f91cb000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c4097170 con 0x7f91c4155100 2024-08-17T02:23:42.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.118+0000 7f91cb000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c4097450 con 0x7f91c41554d0 2024-08-17T02:23:42.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.117+0000 7f22a2e00640 1 -- 172.21.15.2:0/3399109632 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f229c177190 con 0x7f229c158a00 2024-08-17T02:23:42.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.118+0000 7f172e400640 1 -- 172.21.15.2:0/1172938476 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17280d0070 msgr2=0x7f17280cea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.118+0000 7f172e400640 1 --2- 172.21.15.2:0/1172938476 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17280d0070 0x7f17280cea90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1718009880 tx=0x7f17180090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.118+0000 7f6bcae00640 1 -- 172.21.15.2:0/1551395240 shutdown_connections 2024-08-17T02:23:42.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.118+0000 7f6bcae00640 1 --2- 172.21.15.2:0/1551395240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bc40aee60 0x7f6bc40caff0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.118+0000 7f6bcae00640 1 -- 172.21.15.2:0/1551395240 >> 172.21.15.2:0/1551395240 conn(0x7f6bc406e590 msgr2=0x7f6bc406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.118+0000 7f172e400640 1 -- 172.21.15.2:0/1172938476 shutdown_connections 2024-08-17T02:23:42.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.118+0000 7f172e400640 1 --2- 172.21.15.2:0/1172938476 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17280d0070 0x7f17280cea90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.118+0000 7f172e400640 1 -- 172.21.15.2:0/1172938476 >> 172.21.15.2:0/1172938476 conn(0x7f1728068680 msgr2=0x7f1728068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.118+0000 7f91c3400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91c4155100 0x7f91c4152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.119+0000 7f91c3400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91c4155100 0x7f91c4152910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:47680/0 (socket says 172.21.15.2:47680) 2024-08-17T02:23:42.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.119+0000 7f91c3400640 1 -- 172.21.15.2:0/668172359 learned_addr learned my addr 172.21.15.2:0/668172359 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:42.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.119+0000 7f91c9000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91c41554d0 0x7f91c4098720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.119+0000 7f2298c00640 1 -- 172.21.15.2:0/3399109632 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f229403c630 con 0x7f229c158a00 2024-08-17T02:23:42.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.119+0000 7f6bcae00640 1 -- 172.21.15.2:0/1551395240 shutdown_connections 2024-08-17T02:23:42.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.119+0000 7f6bcae00640 1 -- 172.21.15.2:0/1551395240 wait complete. 2024-08-17T02:23:42.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.119+0000 7f172e400640 1 -- 172.21.15.2:0/1172938476 shutdown_connections 2024-08-17T02:23:42.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.119+0000 7f172e400640 1 -- 172.21.15.2:0/1172938476 wait complete. 2024-08-17T02:23:42.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.118+0000 7fbc05000640 1 -- 172.21.15.2:0/1267120837 >> 172.21.15.2:0/1267120837 conn(0x7fbc000ce400 msgr2=0x7fbc00095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.119+0000 7f91c3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91c40684c0 0x7f91c41689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.119+0000 7fbc05000640 1 -- 172.21.15.2:0/1267120837 shutdown_connections 2024-08-17T02:23:42.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.120+0000 7fbc05000640 1 -- 172.21.15.2:0/1267120837 wait complete. 2024-08-17T02:23:42.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.120+0000 7f646c800640 1 Processor -- start 2024-08-17T02:23:42.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.120+0000 7f91c3400640 1 -- 172.21.15.2:0/668172359 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91c41554d0 msgr2=0x7f91c4098720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.120+0000 7f91c3400640 1 --2- 172.21.15.2:0/668172359 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91c41554d0 0x7f91c4098720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.120+0000 7f6bcae00640 1 Processor -- start 2024-08-17T02:23:42.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.120+0000 7f646c800640 1 -- start start 2024-08-17T02:23:42.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.120+0000 7f6bcae00640 1 -- start start 2024-08-17T02:23:42.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.121+0000 7f91c3400640 1 -- 172.21.15.2:0/668172359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91c40684c0 msgr2=0x7f91c41689f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.121+0000 7f91c3400640 1 --2- 172.21.15.2:0/668172359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91c40684c0 0x7f91c41689f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.121+0000 7f91c3400640 1 -- 172.21.15.2:0/668172359 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc00d040 con 0x7f91c4155100 2024-08-17T02:23:42.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.121+0000 7f91c9000640 1 --2- 172.21.15.2:0/668172359 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91c41554d0 0x7f91c4098720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:42.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.122+0000 7f6bcae00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6bc40aea20 0x7f6bc415b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.122+0000 7f172e400640 1 Processor -- start 2024-08-17T02:23:42.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.122+0000 7f91c3400640 1 --2- 172.21.15.2:0/668172359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91c4155100 0x7f91c4152910 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f91b000b610 tx=0x7f91b0009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.122+0000 7f2298c00640 1 --2- 172.21.15.2:0/3399109632 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f227c0652a0 0x7f227c067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.122+0000 7f2298c00640 1 -- 172.21.15.2:0/3399109632 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f22940a3140 con 0x7f229c158a00 2024-08-17T02:23:42.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.122+0000 7f6bcae00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6bc40aee60 0x7f6bc416cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.122+0000 7f172e400640 1 -- start start 2024-08-17T02:23:42.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.122+0000 7fbc05000640 1 Processor -- start 2024-08-17T02:23:42.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.123+0000 7f646c800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f646406dee0 0x7f64640b0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.123+0000 7f91bb400640 1 -- 172.21.15.2:0/668172359 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b000f590 con 0x7f91c4155100 2024-08-17T02:23:42.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.123+0000 7f91bb400640 1 -- 172.21.15.2:0/668172359 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b000f710 con 0x7f91c4155100 2024-08-17T02:23:42.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.123+0000 7f91bb400640 1 -- 172.21.15.2:0/668172359 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b000fad0 con 0x7f91c4155100 2024-08-17T02:23:42.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.123+0000 7f646c800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64640aff30 con 0x7f646415cdc0 2024-08-17T02:23:42.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.123+0000 7f646c800640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64640af320 con 0x7f64640b03c0 2024-08-17T02:23:42.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.123+0000 7f646c800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64640af600 con 0x7f646406dee0 2024-08-17T02:23:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.123+0000 7f6bcae00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bc4158b90 0x7f6bc406ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.123+0000 7f22a1a00640 1 --2- 172.21.15.2:0/3399109632 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f227c0652a0 0x7f227c067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.123+0000 7f6bcae00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc415c540 con 0x7f6bc4158b90 2024-08-17T02:23:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7f6bc3e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6bc40aea20 0x7f6bc415b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7f6bcae00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc406a340 con 0x7f6bc40aea20 2024-08-17T02:23:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7f6bcae00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc416d470 con 0x7f6bc40aee60 2024-08-17T02:23:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7f6bc3e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6bc40aea20 0x7f6bc415b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:47692/0 (socket says 172.21.15.2:47692) 2024-08-17T02:23:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7f6bc3e00640 1 -- 172.21.15.2:0/3041772248 learned_addr learned my addr 172.21.15.2:0/3041772248 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7f172e400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17280cfc10 0x7f17280c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7f172e400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17280d0070 0x7f17280c9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7f172e400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f172814fe00 0x7f1728158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.123+0000 7fbc05000640 1 -- start start 2024-08-17T02:23:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.123+0000 7f646a800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f646406dee0 0x7f64640b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7f646a800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f646406dee0 0x7f64640b0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54262/0 (socket says 172.21.15.2:54262) 2024-08-17T02:23:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7f646a800640 1 -- 172.21.15.2:0/3950374063 learned_addr learned my addr 172.21.15.2:0/3950374063 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7f172e400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1728158c80 con 0x7f17280cfc10 2024-08-17T02:23:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7f172e400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17280c8780 con 0x7f17280d0070 2024-08-17T02:23:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7f172e400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17280c8a60 con 0x7f172814fe00 2024-08-17T02:23:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7f2298c00640 1 -- 172.21.15.2:0/3399109632 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f22940711e0 con 0x7f229c158a00 2024-08-17T02:23:42.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7f91cb000640 1 -- 172.21.15.2:0/668172359 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c4097730 con 0x7f91c4155100 2024-08-17T02:23:42.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.125+0000 7f91cb000640 1 -- 172.21.15.2:0/668172359 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c4097cf0 con 0x7f91c4155100 2024-08-17T02:23:42.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.125+0000 7f1727e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f172814fe00 0x7f1728158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.125+0000 7f1727e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f172814fe00 0x7f1728158740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47478/0 (socket says 172.21.15.2:47478) 2024-08-17T02:23:42.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.125+0000 7f1727e00640 1 -- 172.21.15.2:0/2780786536 learned_addr learned my addr 172.21.15.2:0/2780786536 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:42.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7fbc05000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc000aa620 0x7fbc0015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7fbc05000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc000aaf30 0x7fbc00156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7fbc05000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc000b2100 0x7fbc000ab380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7fbc05000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc000ae4c0 con 0x7fbc000aa620 2024-08-17T02:23:42.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7fbc05000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc000ad8b0 con 0x7fbc000aaf30 2024-08-17T02:23:42.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7fbc05000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc000adb90 con 0x7fbc000b2100 2024-08-17T02:23:42.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7fbbffe00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc000b2100 0x7fbc000ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7fbbffe00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc000b2100 0x7fbc000ab380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:47488/0 (socket says 172.21.15.2:47488) 2024-08-17T02:23:42.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7fbbffe00640 1 -- 172.21.15.2:0/3319622881 learned_addr learned my addr 172.21.15.2:0/3319622881 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:42.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.125+0000 7fbbfea00640 1 --2- 172.21.15.2:0/3319622881 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc000aaf30 0x7fbc00156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.125+0000 7fbbff400640 1 --2- 172.21.15.2:0/3319622881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc000aa620 0x7fbc0015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.125+0000 7f1727400640 1 --2- 172.21.15.2:0/2780786536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17280cfc10 0x7f17280c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.125+0000 7f1726a00640 1 --2- 172.21.15.2:0/2780786536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17280d0070 0x7f17280c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.123+0000 7f6bbb400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6bc40aee60 0x7f6bc416cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.124+0000 7f6bc8e00640 1 --2- 172.21.15.2:0/3041772248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bc4158b90 0x7f6bc406ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.125+0000 7fbbffe00640 1 -- 172.21.15.2:0/3319622881 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc000aaf30 msgr2=0x7fbc00156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.125+0000 7fbbffe00640 1 --2- 172.21.15.2:0/3319622881 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc000aaf30 0x7fbc00156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.125+0000 7fbbffe00640 1 -- 172.21.15.2:0/3319622881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc000aa620 msgr2=0x7fbc0015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.125+0000 7fbbffe00640 1 --2- 172.21.15.2:0/3319622881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc000aa620 0x7fbc0015bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.125+0000 7fbbffe00640 1 -- 172.21.15.2:0/3319622881 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf8009a20 con 0x7fbc000b2100 2024-08-17T02:23:42.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.125+0000 7f6bc8e00640 1 -- 172.21.15.2:0/3041772248 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6bc40aee60 msgr2=0x7f6bc416cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.125+0000 7f6bc8e00640 1 --2- 172.21.15.2:0/3041772248 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6bc40aee60 0x7f6bc416cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.125+0000 7f6bc8e00640 1 -- 172.21.15.2:0/3041772248 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6bc40aea20 msgr2=0x7f6bc415b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.125+0000 7f6bc8e00640 1 --2- 172.21.15.2:0/3041772248 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6bc40aea20 0x7f6bc415b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.125+0000 7f6bc8e00640 1 -- 172.21.15.2:0/3041772248 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc009390 con 0x7f6bc4158b90 2024-08-17T02:23:42.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.126+0000 7f91cb000640 1 -- 172.21.15.2:0/668172359 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c4097f10 con 0x7f91c4155100 2024-08-17T02:23:42.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.126+0000 7f1727e00640 1 -- 172.21.15.2:0/2780786536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17280d0070 msgr2=0x7f17280c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.126+0000 7f1727e00640 1 --2- 172.21.15.2:0/2780786536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17280d0070 0x7f17280c9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.126+0000 7f1727e00640 1 -- 172.21.15.2:0/2780786536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17280cfc10 msgr2=0x7f17280c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.126+0000 7f1727e00640 1 --2- 172.21.15.2:0/2780786536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17280cfc10 0x7f17280c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.126+0000 7f1727e00640 1 -- 172.21.15.2:0/2780786536 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1718009390 con 0x7f172814fe00 2024-08-17T02:23:42.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.126+0000 7f6bc8e00640 1 --2- 172.21.15.2:0/3041772248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bc4158b90 0x7f6bc406ddf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc031000 tx=0x7f6bbc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.127+0000 7f22a1a00640 1 --2- 172.21.15.2:0/3399109632 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f227c0652a0 0x7f227c067750 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f22900037d0 tx=0x7f2290009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.127+0000 7f6468a00640 1 -- 172.21.15.2:0/3950374063 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785787302 0 0) 0x7f64640af320 con 0x7f64640b03c0 2024-08-17T02:23:42.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.127+0000 7f6468a00640 1 -- 172.21.15.2:0/3950374063 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f644c0034e0 con 0x7f64640b03c0 2024-08-17T02:23:42.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.127+0000 7f6468a00640 1 -- 172.21.15.2:0/3950374063 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465437223 0 0) 0x7f64640aff30 con 0x7f646415cdc0 2024-08-17T02:23:42.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.127+0000 7f6468a00640 1 -- 172.21.15.2:0/3950374063 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64640af320 con 0x7f646415cdc0 2024-08-17T02:23:42.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.127+0000 7f1727e00640 1 --2- 172.21.15.2:0/2780786536 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f172814fe00 0x7f1728158740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f17180097d0 tx=0x7f1718032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.127+0000 7f646a800640 1 -- 172.21.15.2:0/3950374063 >> v1:172.21.15.145:6789/0 conn(0x7f64640b03c0 legacy=0x7f646406d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.127+0000 7f6468a00640 1 -- 172.21.15.2:0/3950374063 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2787412005 0 0) 0x7f644c0034e0 con 0x7f64640b03c0 2024-08-17T02:23:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.127+0000 7fbbffe00640 1 --2- 172.21.15.2:0/3319622881 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc000b2100 0x7fbc000ab380 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbbf80099f0 tx=0x7fbbf8037000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.127+0000 7fbbf6a00640 1 -- 172.21.15.2:0/3319622881 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf8007e00 con 0x7fbc000b2100 2024-08-17T02:23:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.127+0000 7fbc05000640 1 -- 172.21.15.2:0/3319622881 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc000ade70 con 0x7fbc000b2100 2024-08-17T02:23:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.127+0000 7fbc05000640 1 -- 172.21.15.2:0/3319622881 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc000ad530 con 0x7fbc000b2100 2024-08-17T02:23:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.127+0000 7fbbf6a00640 1 -- 172.21.15.2:0/3319622881 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf8040070 con 0x7fbc000b2100 2024-08-17T02:23:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.127+0000 7fbbf6a00640 1 -- 172.21.15.2:0/3319622881 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf8007e00 con 0x7fbc000b2100 2024-08-17T02:23:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.127+0000 7f171ea00640 1 -- 172.21.15.2:0/2780786536 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718031e40 con 0x7f172814fe00 2024-08-17T02:23:42.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.128+0000 7f171ea00640 1 -- 172.21.15.2:0/2780786536 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171803e660 con 0x7f172814fe00 2024-08-17T02:23:42.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.128+0000 7f171ea00640 1 -- 172.21.15.2:0/2780786536 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171803ea20 con 0x7f172814fe00 2024-08-17T02:23:42.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.127+0000 7f646a800640 1 -- 172.21.15.2:0/3950374063 >> v1:172.21.15.2:6789/0 conn(0x7f646415cdc0 legacy=0x7f64640ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.127+0000 7f646a800640 1 -- 172.21.15.2:0/3950374063 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64640af8e0 con 0x7f646406dee0 2024-08-17T02:23:42.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.129+0000 7f6bbbe00640 1 -- 172.21.15.2:0/3041772248 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc03c400 con 0x7f6bc4158b90 2024-08-17T02:23:42.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.129+0000 7f6bbbe00640 1 -- 172.21.15.2:0/3041772248 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc03c5c0 con 0x7f6bc4158b90 2024-08-17T02:23:42.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.129+0000 7f6bbbe00640 1 -- 172.21.15.2:0/3041772248 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc03c980 con 0x7f6bc4158b90 2024-08-17T02:23:42.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.129+0000 7f172e400640 1 -- 172.21.15.2:0/2780786536 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17280c8d40 con 0x7f172814fe00 2024-08-17T02:23:42.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.129+0000 7f172e400640 1 -- 172.21.15.2:0/2780786536 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17280c9300 con 0x7f172814fe00 2024-08-17T02:23:42.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.129+0000 7f6bcae00640 1 -- 172.21.15.2:0/3041772248 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc406e330 con 0x7f6bc4158b90 2024-08-17T02:23:42.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.129+0000 7f6bcae00640 1 -- 172.21.15.2:0/3041772248 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc415bf80 con 0x7f6bc4158b90 2024-08-17T02:23:42.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.130+0000 7f646a800640 1 --2- 172.21.15.2:0/3950374063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f646406dee0 0x7f64640b0840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6460009ea0 tx=0x7f6460009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8876dea4467e1d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.131+0000 7f6bcae00640 1 -- 172.21.15.2:0/3041772248 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc406a4d0 con 0x7f6bc4158b90 2024-08-17T02:23:42.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.131+0000 7fbc05000640 1 -- 172.21.15.2:0/3319622881 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd8005210 con 0x7fbc000b2100 2024-08-17T02:23:42.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.132+0000 7fbbf6a00640 1 -- 172.21.15.2:0/3319622881 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbbf8042030 con 0x7fbc000b2100 2024-08-17T02:23:42.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.131+0000 7f172e400640 1 -- 172.21.15.2:0/2780786536 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1728063fb0 con 0x7f172814fe00 2024-08-17T02:23:42.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.131+0000 7f91bb400640 1 -- 172.21.15.2:0/668172359 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f91b001a460 con 0x7f91c4155100 2024-08-17T02:23:42.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.132+0000 7f91bb400640 1 --2- 172.21.15.2:0/668172359 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f91a40652a0 0x7f91a4067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.132+0000 7f91bb400640 1 -- 172.21.15.2:0/668172359 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91b0082000 con 0x7f91c4155100 2024-08-17T02:23:42.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.133+0000 7f171ea00640 1 -- 172.21.15.2:0/2780786536 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f171803c400 con 0x7f172814fe00 2024-08-17T02:23:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.133+0000 7f6468a00640 1 -- 172.21.15.2:0/3950374063 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6458001470 con 0x7f646406dee0 2024-08-17T02:23:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.133+0000 7f6468a00640 1 -- 172.21.15.2:0/3950374063 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646002d050 con 0x7f646406dee0 2024-08-17T02:23:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.133+0000 7f6468a00640 1 -- 172.21.15.2:0/3950374063 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6460031400 con 0x7f646406dee0 2024-08-17T02:23:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.133+0000 7fbbf6a00640 1 --2- 172.21.15.2:0/3319622881 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbbe0065210 0x7fbbe00676c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.133+0000 7fbbf6a00640 1 -- 172.21.15.2:0/3319622881 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbbf80a39e0 con 0x7fbc000b2100 2024-08-17T02:23:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.134+0000 7f91c3e00640 1 --2- 172.21.15.2:0/668172359 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f91a40652a0 0x7f91a4067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.134+0000 7f646c800640 1 -- 172.21.15.2:0/3950374063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f646406dee0 msgr2=0x7f64640b0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.134+0000 7f646c800640 1 --2- 172.21.15.2:0/3950374063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f646406dee0 0x7f64640b0840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6460009ea0 tx=0x7f6460009840 comp rx=0 tx=0).stop 2024-08-17T02:23:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.134+0000 7f6bbbe00640 1 -- 172.21.15.2:0/3041772248 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6bbc03cd30 con 0x7f6bc4158b90 2024-08-17T02:23:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.134+0000 7f171ea00640 1 --2- 172.21.15.2:0/2780786536 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f17080652a0 0x7f1708067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.135+0000 7f91c3e00640 1 --2- 172.21.15.2:0/668172359 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f91a40652a0 0x7f91a4067750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f91b400ac20 tx=0x7f91b4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.135+0000 7f1727400640 1 --2- 172.21.15.2:0/2780786536 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f17080652a0 0x7f1708067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.134+0000 7fbbff400640 1 --2- 172.21.15.2:0/3319622881 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbbe0065210 0x7fbbe00676c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.134+0000 7f646c800640 1 -- 172.21.15.2:0/3950374063 shutdown_connections 2024-08-17T02:23:42.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.134+0000 7f646c800640 1 --2- 172.21.15.2:0/3950374063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f646406dee0 0x7f64640b0840 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.134+0000 7f646c800640 1 -- 172.21.15.2:0/3950374063 >> 172.21.15.2:0/3950374063 conn(0x7f6464066e60 msgr2=0x7f6464067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.135+0000 7f171ea00640 1 -- 172.21.15.2:0/2780786536 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f17180a31c0 con 0x7f172814fe00 2024-08-17T02:23:42.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.135+0000 7fbbff400640 1 --2- 172.21.15.2:0/3319622881 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbbe0065210 0x7fbbe00676c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00b8b0 tx=0x7fbbec008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.136+0000 7f646c800640 1 -- 172.21.15.2:0/3950374063 shutdown_connections 2024-08-17T02:23:42.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.136+0000 7f6bbbe00640 1 --2- 172.21.15.2:0/3041772248 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6ba00652d0 0x7f6ba0067780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.136+0000 7f6bbbe00640 1 -- 172.21.15.2:0/3041772248 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6bbc02ae40 con 0x7f6bc4158b90 2024-08-17T02:23:42.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.136+0000 7f1727400640 1 --2- 172.21.15.2:0/2780786536 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f17080652a0 0x7f1708067750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f172000f380 tx=0x7f1720009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.136+0000 7f646c800640 1 -- 172.21.15.2:0/3950374063 wait complete. 2024-08-17T02:23:42.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.136+0000 7f6bc3e00640 1 --2- 172.21.15.2:0/3041772248 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6ba00652d0 0x7f6ba0067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.137+0000 7f6bc3e00640 1 --2- 172.21.15.2:0/3041772248 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6ba00652d0 0x7f6ba0067780 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4002250 tx=0x7f6bb4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.137+0000 7f91bb400640 1 -- 172.21.15.2:0/668172359 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f91b0050120 con 0x7f91c4155100 2024-08-17T02:23:42.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.138+0000 7f646c800640 1 Processor -- start 2024-08-17T02:23:42.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.138+0000 7f646c800640 1 -- start start 2024-08-17T02:23:42.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.140+0000 7f646c800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f646406dee0 0x7f64640aba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.140+0000 7fbbf6a00640 1 -- 172.21.15.2:0/3319622881 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbbf8071a00 con 0x7fbc000b2100 2024-08-17T02:23:42.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.140+0000 7f646c800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64640b03c0 0x7f64641632b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.141+0000 7f6469e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f646406dee0 0x7f64640aba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.141+0000 7f6469e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f646406dee0 0x7f64640aba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54310/0 (socket says 172.21.15.2:54310) 2024-08-17T02:23:42.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.141+0000 7f6469e00640 1 -- 172.21.15.2:0/3525301003 learned_addr learned my addr 172.21.15.2:0/3525301003 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:42.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.141+0000 7f646c800640 1 --2- 172.21.15.2:0/3525301003 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f646415cdc0 0x7f64641708d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.141+0000 7f646c800640 1 -- 172.21.15.2:0/3525301003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64640ab670 con 0x7f646406dee0 2024-08-17T02:23:42.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.141+0000 7f646c800640 1 -- 172.21.15.2:0/3525301003 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6464158660 con 0x7f64640b03c0 2024-08-17T02:23:42.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.141+0000 7f646c800640 1 -- 172.21.15.2:0/3525301003 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64640aaff0 con 0x7f646415cdc0 2024-08-17T02:23:42.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.141+0000 7f6469400640 1 --2- 172.21.15.2:0/3525301003 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64640b03c0 0x7f64641632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.142+0000 7f6469e00640 1 -- 172.21.15.2:0/3525301003 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f646415cdc0 msgr2=0x7f64641708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.142+0000 7f6469e00640 1 --2- 172.21.15.2:0/3525301003 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f646415cdc0 0x7f64641708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.142+0000 7f6469e00640 1 -- 172.21.15.2:0/3525301003 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64640b03c0 msgr2=0x7f64641632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.142+0000 7f6469e00640 1 --2- 172.21.15.2:0/3525301003 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64640b03c0 0x7f64641632b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.142+0000 7f6469e00640 1 -- 172.21.15.2:0/3525301003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6460009ae0 con 0x7f646406dee0 2024-08-17T02:23:42.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.142+0000 7f6469e00640 1 --2- 172.21.15.2:0/3525301003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f646406dee0 0x7f64640aba90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f645400c810 tx=0x7f6454007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.144+0000 7f645d600640 1 -- 172.21.15.2:0/3525301003 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454002ea0 con 0x7f646406dee0 2024-08-17T02:23:42.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.144+0000 7f645d600640 1 -- 172.21.15.2:0/3525301003 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645400ce70 con 0x7f646406dee0 2024-08-17T02:23:42.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.144+0000 7f645d600640 1 -- 172.21.15.2:0/3525301003 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645400a850 con 0x7f646406dee0 2024-08-17T02:23:42.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.144+0000 7f6bbbe00640 1 -- 172.21.15.2:0/3041772248 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6bbc0a9080 con 0x7f6bc4158b90 2024-08-17T02:23:42.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.144+0000 7f171ea00640 1 -- 172.21.15.2:0/2780786536 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1718071310 con 0x7f172814fe00 2024-08-17T02:23:42.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.145+0000 7f646c800640 1 -- 172.21.15.2:0/3525301003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64641714b0 con 0x7f646406dee0 2024-08-17T02:23:42.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.145+0000 7f646c800640 1 -- 172.21.15.2:0/3525301003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64640abfd0 con 0x7f646406dee0 2024-08-17T02:23:42.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.147+0000 7f646c800640 1 -- 172.21.15.2:0/3525301003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64640ab7b0 con 0x7f646406dee0 2024-08-17T02:23:42.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.150+0000 7f645d600640 1 -- 172.21.15.2:0/3525301003 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f645400ac80 con 0x7f646406dee0 2024-08-17T02:23:42.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.159+0000 7f645d600640 1 --2- 172.21.15.2:0/3525301003 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f64480652a0 0x7f6448067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.159+0000 7f645d600640 1 -- 172.21.15.2:0/3525301003 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6454082080 con 0x7f646406dee0 2024-08-17T02:23:42.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.161+0000 7f6469400640 1 --2- 172.21.15.2:0/3525301003 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f64480652a0 0x7f6448067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.161+0000 7f645d600640 1 -- 172.21.15.2:0/3525301003 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6454050120 con 0x7f646406dee0 2024-08-17T02:23:42.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.162+0000 7f6469400640 1 --2- 172.21.15.2:0/3525301003 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f64480652a0 0x7f6448067750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f64640a8c20 tx=0x7f645800a390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.376+0000 7fa4f7c00640 1 -- 172.21.15.2:0/4211280546 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa4f015ae70 con 0x7fa4f0159320 2024-08-17T02:23:42.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.377+0000 7fa4e7e00640 1 -- 172.21.15.2:0/4211280546 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa4f015ae70 con 0x7fa4f0159320 2024-08-17T02:23:42.377 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2024-08-17T02:23:42.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.380+0000 7fa4f7c00640 1 -- 172.21.15.2:0/4211280546 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa4d00652a0 msgr2=0x7fa4d0067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.380+0000 7fa4f7c00640 1 --2- 172.21.15.2:0/4211280546 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa4d00652a0 0x7fa4d0067750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8009880 tx=0x7fa4e8036000 comp rx=0 tx=0).stop 2024-08-17T02:23:42.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.381+0000 7fa4f7c00640 1 -- 172.21.15.2:0/4211280546 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4f0159320 msgr2=0x7fa4f015d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.381+0000 7fa4f7c00640 1 --2- 172.21.15.2:0/4211280546 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4f0159320 0x7fa4f015d3d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00e930 tx=0x7fa4dc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.381+0000 7fa4f7c00640 1 -- 172.21.15.2:0/4211280546 shutdown_connections 2024-08-17T02:23:42.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.381+0000 7fa4f7c00640 1 --2- 172.21.15.2:0/4211280546 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4f0159320 0x7fa4f015d3d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.381+0000 7fa4f7c00640 1 --2- 172.21.15.2:0/4211280546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4f0154a80 0x7fa4f0156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.381+0000 7fa4f7c00640 1 --2- 172.21.15.2:0/4211280546 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa4d00652a0 0x7fa4d0067750 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.381+0000 7fa4f7c00640 1 --2- 172.21.15.2:0/4211280546 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4f006dee0 0x7fa4f0150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.381+0000 7fa4f7c00640 1 -- 172.21.15.2:0/4211280546 >> 172.21.15.2:0/4211280546 conn(0x7fa4f0066e60 msgr2=0x7fa4f00b07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.382+0000 7fa4f7c00640 1 -- 172.21.15.2:0/4211280546 shutdown_connections 2024-08-17T02:23:42.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.382+0000 7fa4f7c00640 1 -- 172.21.15.2:0/4211280546 wait complete. 2024-08-17T02:23:42.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.7 2024-08-17T02:23:42.409 DEBUG:teuthology.parallel:result is None 2024-08-17T02:23:42.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.468+0000 7f8318a00640 1 -- 172.21.15.2:0/1468686504 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f830c054b00 con 0x7f830c051da0 2024-08-17T02:23:42.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.469+0000 7f8309600640 1 -- 172.21.15.2:0/1468686504 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8304053770 con 0x7f830c051da0 2024-08-17T02:23:42.469 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2024-08-17T02:23:42.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.472+0000 7f8318a00640 1 -- 172.21.15.2:0/1468686504 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f82f40652a0 msgr2=0x7f82f4067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.472+0000 7f8318a00640 1 --2- 172.21.15.2:0/1468686504 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f82f40652a0 0x7f82f4067750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f830c00f490 tx=0x7f83140ab000 comp rx=0 tx=0).stop 2024-08-17T02:23:42.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.473+0000 7f8318a00640 1 -- 172.21.15.2:0/1468686504 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f830c051da0 msgr2=0x7f830c038ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.473+0000 7f8318a00640 1 --2- 172.21.15.2:0/1468686504 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f830c051da0 0x7f830c038ea0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8304000c00 tx=0x7f8304007c80 comp rx=0 tx=0).stop 2024-08-17T02:23:42.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.473+0000 7f8318a00640 1 -- 172.21.15.2:0/1468686504 shutdown_connections 2024-08-17T02:23:42.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.473+0000 7f8318a00640 1 --2- 172.21.15.2:0/1468686504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f830c0e0070 0x7f830c0db780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.473+0000 7f8318a00640 1 --2- 172.21.15.2:0/1468686504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f830c052170 0x7f830c03a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.473+0000 7f8318a00640 1 --2- 172.21.15.2:0/1468686504 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f82f40652a0 0x7f82f4067750 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.473+0000 7f8318a00640 1 --2- 172.21.15.2:0/1468686504 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f830c051da0 0x7f830c038ea0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.473+0000 7f8318a00640 1 -- 172.21.15.2:0/1468686504 >> 172.21.15.2:0/1468686504 conn(0x7f830c00a800 msgr2=0x7f830c007c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.473+0000 7f8318a00640 1 -- 172.21.15.2:0/1468686504 shutdown_connections 2024-08-17T02:23:42.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.474+0000 7f8318a00640 1 -- 172.21.15.2:0/1468686504 wait complete. 2024-08-17T02:23:42.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.482+0000 7f646c800640 1 -- 172.21.15.2:0/3525301003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f64640aae50 con 0x7f646406dee0 2024-08-17T02:23:42.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.482+0000 7f645d600640 1 -- 172.21.15.2:0/3525301003 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f64640aae50 con 0x7f646406dee0 2024-08-17T02:23:42.484 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2024-08-17T02:23:42.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.484+0000 7f646c800640 1 -- 172.21.15.2:0/3525301003 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f64480652a0 msgr2=0x7f6448067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.485+0000 7f646c800640 1 --2- 172.21.15.2:0/3525301003 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f64480652a0 0x7f6448067750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f64640a8c20 tx=0x7f645800a390 comp rx=0 tx=0).stop 2024-08-17T02:23:42.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.485+0000 7f646c800640 1 -- 172.21.15.2:0/3525301003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f646406dee0 msgr2=0x7f64640aba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.485+0000 7f646c800640 1 --2- 172.21.15.2:0/3525301003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f646406dee0 0x7f64640aba90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f645400c810 tx=0x7f6454007d80 comp rx=0 tx=0).stop 2024-08-17T02:23:42.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.485+0000 7f646c800640 1 -- 172.21.15.2:0/3525301003 shutdown_connections 2024-08-17T02:23:42.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.485+0000 7f646c800640 1 --2- 172.21.15.2:0/3525301003 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f64480652a0 0x7f6448067750 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.485+0000 7f646c800640 1 --2- 172.21.15.2:0/3525301003 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f646415cdc0 0x7f64641708d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.485+0000 7f646c800640 1 --2- 172.21.15.2:0/3525301003 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64640b03c0 0x7f64641632b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.485+0000 7f646c800640 1 --2- 172.21.15.2:0/3525301003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f646406dee0 0x7f64640aba90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.485+0000 7f646c800640 1 -- 172.21.15.2:0/3525301003 >> 172.21.15.2:0/3525301003 conn(0x7f6464066e60 msgr2=0x7f646415d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.485+0000 7f646c800640 1 -- 172.21.15.2:0/3525301003 shutdown_connections 2024-08-17T02:23:42.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.485+0000 7f646c800640 1 -- 172.21.15.2:0/3525301003 wait complete. 2024-08-17T02:23:42.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.3 2024-08-17T02:23:42.500 DEBUG:teuthology.parallel:result is None 2024-08-17T02:23:42.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.4 2024-08-17T02:23:42.502 DEBUG:teuthology.parallel:result is None 2024-08-17T02:23:42.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.526+0000 7f172e400640 1 -- 172.21.15.2:0/2780786536 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f17280c6b80 con 0x7f172814fe00 2024-08-17T02:23:42.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.526+0000 7f171ea00640 1 -- 172.21.15.2:0/2780786536 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1718074930 con 0x7f172814fe00 2024-08-17T02:23:42.527 INFO:teuthology.orchestra.run.smithi002.stdout:55834574855 2024-08-17T02:23:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.528+0000 7f172e400640 1 -- 172.21.15.2:0/2780786536 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f17080652a0 msgr2=0x7f1708067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.528+0000 7f172e400640 1 --2- 172.21.15.2:0/2780786536 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f17080652a0 0x7f1708067750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f172000f380 tx=0x7f1720009040 comp rx=0 tx=0).stop 2024-08-17T02:23:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.528+0000 7f172e400640 1 -- 172.21.15.2:0/2780786536 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f172814fe00 msgr2=0x7f1728158740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.528+0000 7f172e400640 1 --2- 172.21.15.2:0/2780786536 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f172814fe00 0x7f1728158740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f17180097d0 tx=0x7f1718032000 comp rx=0 tx=0).stop 2024-08-17T02:23:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.528+0000 7f172e400640 1 -- 172.21.15.2:0/2780786536 shutdown_connections 2024-08-17T02:23:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.528+0000 7f172e400640 1 --2- 172.21.15.2:0/2780786536 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f17080652a0 0x7f1708067750 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.528+0000 7f172e400640 1 --2- 172.21.15.2:0/2780786536 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f172814fe00 0x7f1728158740 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.528+0000 7f172e400640 1 --2- 172.21.15.2:0/2780786536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17280d0070 0x7f17280c9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.528+0000 7f172e400640 1 --2- 172.21.15.2:0/2780786536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17280cfc10 0x7f17280c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.528+0000 7f172e400640 1 -- 172.21.15.2:0/2780786536 >> 172.21.15.2:0/2780786536 conn(0x7f1728068680 msgr2=0x7f17280c6170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.529+0000 7f172e400640 1 -- 172.21.15.2:0/2780786536 shutdown_connections 2024-08-17T02:23:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.529+0000 7f172e400640 1 -- 172.21.15.2:0/2780786536 wait complete. 2024-08-17T02:23:42.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.2 2024-08-17T02:23:42.544 DEBUG:teuthology.parallel:result is None 2024-08-17T02:23:42.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.552+0000 7f22a2e00640 1 -- 172.21.15.2:0/3399109632 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f229c070720 con 0x7f229c158a00 2024-08-17T02:23:42.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.552+0000 7f2298c00640 1 -- 172.21.15.2:0/3399109632 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2294074800 con 0x7f229c158a00 2024-08-17T02:23:42.555 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2024-08-17T02:23:42.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.555+0000 7f91cb000640 1 -- 172.21.15.2:0/668172359 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f91c4063fb0 con 0x7f91c4155100 2024-08-17T02:23:42.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.555+0000 7f22a2e00640 1 -- 172.21.15.2:0/3399109632 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f227c0652a0 msgr2=0x7f227c067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.555+0000 7f22a2e00640 1 --2- 172.21.15.2:0/3399109632 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f227c0652a0 0x7f227c067750 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f22900037d0 tx=0x7f2290009040 comp rx=0 tx=0).stop 2024-08-17T02:23:42.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.555+0000 7f22a2e00640 1 -- 172.21.15.2:0/3399109632 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f229c158a00 msgr2=0x7f229c1793b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.555+0000 7f22a2e00640 1 --2- 172.21.15.2:0/3399109632 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f229c158a00 0x7f229c1793b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2294009ab0 tx=0x7f2294036000 comp rx=0 tx=0).stop 2024-08-17T02:23:42.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.556+0000 7f22a2e00640 1 -- 172.21.15.2:0/3399109632 shutdown_connections 2024-08-17T02:23:42.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.556+0000 7f22a2e00640 1 --2- 172.21.15.2:0/3399109632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f229c158dd0 0x7f229c16bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.556+0000 7f22a2e00640 1 --2- 172.21.15.2:0/3399109632 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f227c0652a0 0x7f227c067750 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.556+0000 7f22a2e00640 1 --2- 172.21.15.2:0/3399109632 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f229c158a00 0x7f229c1793b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.556+0000 7f22a2e00640 1 --2- 172.21.15.2:0/3399109632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f229c06ead0 0x7f229c178e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.556+0000 7f22a2e00640 1 -- 172.21.15.2:0/3399109632 >> 172.21.15.2:0/3399109632 conn(0x7f229c0cfb80 msgr2=0x7f229c15b780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.556+0000 7f22a2e00640 1 -- 172.21.15.2:0/3399109632 shutdown_connections 2024-08-17T02:23:42.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.556+0000 7f22a2e00640 1 -- 172.21.15.2:0/3399109632 wait complete. 2024-08-17T02:23:42.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.556+0000 7f91bb400640 1 -- 172.21.15.2:0/668172359 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f91b0053740 con 0x7f91c4155100 2024-08-17T02:23:42.558 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2024-08-17T02:23:42.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.558+0000 7f91cb000640 1 -- 172.21.15.2:0/668172359 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f91a40652a0 msgr2=0x7f91a4067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.558+0000 7f91cb000640 1 --2- 172.21.15.2:0/668172359 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f91a40652a0 0x7f91a4067750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f91b400ac20 tx=0x7f91b4008040 comp rx=0 tx=0).stop 2024-08-17T02:23:42.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.558+0000 7f91cb000640 1 -- 172.21.15.2:0/668172359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91c4155100 msgr2=0x7f91c4152910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.558+0000 7f91cb000640 1 --2- 172.21.15.2:0/668172359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91c4155100 0x7f91c4152910 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f91b000b610 tx=0x7f91b0009060 comp rx=0 tx=0).stop 2024-08-17T02:23:42.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.558+0000 7f91cb000640 1 -- 172.21.15.2:0/668172359 shutdown_connections 2024-08-17T02:23:42.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.558+0000 7f91cb000640 1 --2- 172.21.15.2:0/668172359 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f91a40652a0 0x7f91a4067750 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.558+0000 7f91cb000640 1 --2- 172.21.15.2:0/668172359 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91c41554d0 0x7f91c4098720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.558+0000 7f91cb000640 1 --2- 172.21.15.2:0/668172359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91c4155100 0x7f91c4152910 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.558+0000 7f91cb000640 1 --2- 172.21.15.2:0/668172359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91c40684c0 0x7f91c41689f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.558+0000 7f91cb000640 1 -- 172.21.15.2:0/668172359 >> 172.21.15.2:0/668172359 conn(0x7f91c406e5b0 msgr2=0x7f91c40af160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.558+0000 7f91cb000640 1 -- 172.21.15.2:0/668172359 shutdown_connections 2024-08-17T02:23:42.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.558+0000 7f91cb000640 1 -- 172.21.15.2:0/668172359 wait complete. 2024-08-17T02:23:42.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.561+0000 7f6bcae00640 1 -- 172.21.15.2:0/3041772248 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6bc4063fb0 con 0x7f6bc4158b90 2024-08-17T02:23:42.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.561+0000 7f6bbbe00640 1 -- 172.21.15.2:0/3041772248 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6bbc070ee0 con 0x7f6bc4158b90 2024-08-17T02:23:42.561 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2024-08-17T02:23:42.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.563+0000 7fbc05000640 1 -- 172.21.15.2:0/3319622881 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fbbd80054c0 con 0x7fbc000b2100 2024-08-17T02:23:42.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.564+0000 7f6bcae00640 1 -- 172.21.15.2:0/3041772248 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6ba00652d0 msgr2=0x7f6ba0067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.564+0000 7f6bcae00640 1 --2- 172.21.15.2:0/3041772248 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6ba00652d0 0x7f6ba0067780 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4002250 tx=0x7f6bb4009040 comp rx=0 tx=0).stop 2024-08-17T02:23:42.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.564+0000 7f6bcae00640 1 -- 172.21.15.2:0/3041772248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bc4158b90 msgr2=0x7f6bc406ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.564+0000 7f6bcae00640 1 --2- 172.21.15.2:0/3041772248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bc4158b90 0x7f6bc406ddf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc031000 tx=0x7f6bbc032000 comp rx=0 tx=0).stop 2024-08-17T02:23:42.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.564+0000 7f6bcae00640 1 -- 172.21.15.2:0/3041772248 shutdown_connections 2024-08-17T02:23:42.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.564+0000 7f6bcae00640 1 --2- 172.21.15.2:0/3041772248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bc4158b90 0x7f6bc406ddf0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.564+0000 7f6bcae00640 1 --2- 172.21.15.2:0/3041772248 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6ba00652d0 0x7f6ba0067780 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.564+0000 7f6bcae00640 1 --2- 172.21.15.2:0/3041772248 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6bc40aee60 0x7f6bc416cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.564+0000 7f6bcae00640 1 --2- 172.21.15.2:0/3041772248 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6bc40aea20 0x7f6bc415b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.564+0000 7f6bcae00640 1 -- 172.21.15.2:0/3041772248 >> 172.21.15.2:0/3041772248 conn(0x7f6bc406e590 msgr2=0x7f6bc40b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.564+0000 7f6bcae00640 1 -- 172.21.15.2:0/3041772248 shutdown_connections 2024-08-17T02:23:42.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.564+0000 7f6bcae00640 1 -- 172.21.15.2:0/3041772248 wait complete. 2024-08-17T02:23:42.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.564+0000 7fbbf6a00640 1 -- 172.21.15.2:0/3319622881 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbbf8075020 con 0x7fbc000b2100 2024-08-17T02:23:42.565 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2024-08-17T02:23:42.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.569+0000 7fbc05000640 1 -- 172.21.15.2:0/3319622881 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbbe0065210 msgr2=0x7fbbe00676c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.569+0000 7fbc05000640 1 --2- 172.21.15.2:0/3319622881 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbbe0065210 0x7fbbe00676c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00b8b0 tx=0x7fbbec008040 comp rx=0 tx=0).stop 2024-08-17T02:23:42.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.569+0000 7fbc05000640 1 -- 172.21.15.2:0/3319622881 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc000b2100 msgr2=0x7fbc000ab380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.569+0000 7fbc05000640 1 --2- 172.21.15.2:0/3319622881 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc000b2100 0x7fbc000ab380 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbbf80099f0 tx=0x7fbbf8037000 comp rx=0 tx=0).stop 2024-08-17T02:23:42.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.569+0000 7fbc05000640 1 -- 172.21.15.2:0/3319622881 shutdown_connections 2024-08-17T02:23:42.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.569+0000 7fbc05000640 1 --2- 172.21.15.2:0/3319622881 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbbe0065210 0x7fbbe00676c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.569+0000 7fbc05000640 1 --2- 172.21.15.2:0/3319622881 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc000b2100 0x7fbc000ab380 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.569+0000 7fbc05000640 1 --2- 172.21.15.2:0/3319622881 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc000aaf30 0x7fbc00156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.569+0000 7fbc05000640 1 --2- 172.21.15.2:0/3319622881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc000aa620 0x7fbc0015bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.569+0000 7fbc05000640 1 -- 172.21.15.2:0/3319622881 >> 172.21.15.2:0/3319622881 conn(0x7fbc000ce400 msgr2=0x7fbc0006b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.569+0000 7fbc05000640 1 -- 172.21.15.2:0/3319622881 shutdown_connections 2024-08-17T02:23:42.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.569+0000 7fbc05000640 1 -- 172.21.15.2:0/3319622881 wait complete. 2024-08-17T02:23:42.579 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.1 2024-08-17T02:23:42.580 DEBUG:teuthology.parallel:result is None 2024-08-17T02:23:42.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.6 2024-08-17T02:23:42.580 DEBUG:teuthology.parallel:result is None 2024-08-17T02:23:42.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.0 2024-08-17T02:23:42.581 DEBUG:teuthology.parallel:result is None 2024-08-17T02:23:42.586 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.5 2024-08-17T02:23:42.586 DEBUG:teuthology.parallel:result is None 2024-08-17T02:23:42.586 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:23:42.586 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:23:42.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.777+0000 7f5165600640 1 Processor -- start 2024-08-17T02:23:42.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.778+0000 7f5165600640 1 -- start start 2024-08-17T02:23:42.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.779+0000 7f5165600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5160158bf0 0x7f51600af330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.779+0000 7f5165600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51600ae4a0 0x7f51600abda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.779+0000 7f5165600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51600ac740 con 0x7f51600ac2e0 2024-08-17T02:23:42.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.779+0000 7f5165600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51600682e0 con 0x7f5160158bf0 2024-08-17T02:23:42.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.779+0000 7f5165600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51600afca0 con 0x7f51600ae4a0 2024-08-17T02:23:42.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.779+0000 7f515fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5160158bf0 0x7f51600af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.779+0000 7f515fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5160158bf0 0x7f51600af330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54314/0 (socket says 172.21.15.2:54314) 2024-08-17T02:23:42.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.779+0000 7f515fe00640 1 -- 172.21.15.2:0/521963360 learned_addr learned my addr 172.21.15.2:0/521963360 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:42.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.779+0000 7f5157e00640 1 --2- 172.21.15.2:0/521963360 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51600ae4a0 0x7f51600abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.779+0000 7f515fe00640 1 -- 172.21.15.2:0/521963360 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51600ae4a0 msgr2=0x7f51600abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:42.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.779+0000 7f515fe00640 1 --2- 172.21.15.2:0/521963360 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51600ae4a0 0x7f51600abda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.779+0000 7f515fe00640 1 -- 172.21.15.2:0/521963360 >> v1:172.21.15.2:6789/0 conn(0x7f51600ac2e0 legacy=0x7f51600aa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.779+0000 7f515fe00640 1 -- 172.21.15.2:0/521963360 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51600aff80 con 0x7f5160158bf0 2024-08-17T02:23:42.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.780+0000 7f515fe00640 1 --2- 172.21.15.2:0/521963360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5160158bf0 0x7f51600af330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5150009910 tx=0x7f51500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab4eb8cecd5ecdd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.781+0000 7f515f400640 1 -- 172.21.15.2:0/521963360 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515002ae40 con 0x7f5160158bf0 2024-08-17T02:23:42.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.781+0000 7f515f400640 1 -- 172.21.15.2:0/521963360 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5150032440 con 0x7f5160158bf0 2024-08-17T02:23:42.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.781+0000 7f515f400640 1 -- 172.21.15.2:0/521963360 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5150032820 con 0x7f5160158bf0 2024-08-17T02:23:42.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.781+0000 7f5165600640 1 -- 172.21.15.2:0/521963360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5160158bf0 msgr2=0x7f51600af330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.781+0000 7f5165600640 1 --2- 172.21.15.2:0/521963360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5160158bf0 0x7f51600af330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5150009910 tx=0x7f51500091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.781+0000 7f5165600640 1 -- 172.21.15.2:0/521963360 shutdown_connections 2024-08-17T02:23:42.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.781+0000 7f5165600640 1 --2- 172.21.15.2:0/521963360 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51600ae4a0 0x7f51600abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.781+0000 7f5165600640 1 --2- 172.21.15.2:0/521963360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5160158bf0 0x7f51600af330 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.781+0000 7f5165600640 1 -- 172.21.15.2:0/521963360 >> 172.21.15.2:0/521963360 conn(0x7f51600ce420 msgr2=0x7f5160095d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.781+0000 7f5165600640 1 -- 172.21.15.2:0/521963360 shutdown_connections 2024-08-17T02:23:42.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.782+0000 7f5165600640 1 -- 172.21.15.2:0/521963360 wait complete. 2024-08-17T02:23:42.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.783+0000 7f5165600640 1 Processor -- start 2024-08-17T02:23:42.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.783+0000 7f5165600640 1 -- start start 2024-08-17T02:23:42.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.784+0000 7f5165600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51600ac2e0 0x7f51600c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.784+0000 7f5165600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51600ae4a0 0x7f516006ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.784+0000 7f5165600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5160158bf0 0x7f5160153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.784+0000 7f5165600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5160159ed0 con 0x7f5160158bf0 2024-08-17T02:23:42.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.784+0000 7f5165600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516015a1b0 con 0x7f51600ac2e0 2024-08-17T02:23:42.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.784+0000 7f5165600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f516015a490 con 0x7f51600ae4a0 2024-08-17T02:23:42.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.784+0000 7f5164c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5160158bf0 0x7f5160153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.784+0000 7f5164c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5160158bf0 0x7f5160153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54316/0 (socket says 172.21.15.2:54316) 2024-08-17T02:23:42.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.784+0000 7f5164c00640 1 -- 172.21.15.2:0/634777870 learned_addr learned my addr 172.21.15.2:0/634777870 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:42.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.784+0000 7f515fe00640 1 --2- 172.21.15.2:0/634777870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51600ac2e0 0x7f51600c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.784+0000 7f5157e00640 1 --2- 172.21.15.2:0/634777870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51600ae4a0 0x7f516006ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.784+0000 7f5164c00640 1 -- 172.21.15.2:0/634777870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51600ae4a0 msgr2=0x7f516006ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.784+0000 7f5164c00640 1 --2- 172.21.15.2:0/634777870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51600ae4a0 0x7f516006ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.785+0000 7f5164c00640 1 -- 172.21.15.2:0/634777870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51600ac2e0 msgr2=0x7f51600c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.785+0000 7f5164c00640 1 --2- 172.21.15.2:0/634777870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51600ac2e0 0x7f51600c93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.785+0000 7f5164c00640 1 -- 172.21.15.2:0/634777870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5150009450 con 0x7f5160158bf0 2024-08-17T02:23:42.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.785+0000 7f5164c00640 1 --2- 172.21.15.2:0/634777870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5160158bf0 0x7f5160153520 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f515800c860 tx=0x7f5158001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.785+0000 7f5157400640 1 -- 172.21.15.2:0/634777870 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515800ce50 con 0x7f5160158bf0 2024-08-17T02:23:42.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.785+0000 7f5157400640 1 -- 172.21.15.2:0/634777870 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515800a850 con 0x7f5160158bf0 2024-08-17T02:23:42.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.785+0000 7f5157400640 1 -- 172.21.15.2:0/634777870 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515800ac10 con 0x7f5160158bf0 2024-08-17T02:23:42.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.785+0000 7f5165600640 1 -- 172.21.15.2:0/634777870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f516015a770 con 0x7f5160158bf0 2024-08-17T02:23:42.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.785+0000 7f5165600640 1 -- 172.21.15.2:0/634777870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51600c98f0 con 0x7f5160158bf0 2024-08-17T02:23:42.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.786+0000 7f5165600640 1 -- 172.21.15.2:0/634777870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f516015ac70 con 0x7f5160158bf0 2024-08-17T02:23:42.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.787+0000 7f5157400640 1 -- 172.21.15.2:0/634777870 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5158012630 con 0x7f5160158bf0 2024-08-17T02:23:42.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.788+0000 7f5157400640 1 --2- 172.21.15.2:0/634777870 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f513c065150 0x7f513c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.788+0000 7f5157400640 1 -- 172.21.15.2:0/634777870 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5158082480 con 0x7f5160158bf0 2024-08-17T02:23:42.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.788+0000 7f515fe00640 1 --2- 172.21.15.2:0/634777870 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f513c065150 0x7f513c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.789+0000 7f515fe00640 1 --2- 172.21.15.2:0/634777870 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f513c065150 0x7f513c067600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5150034000 tx=0x7f5150032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.792+0000 7f5157400640 1 -- 172.21.15.2:0/634777870 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5158050550 con 0x7f5160158bf0 2024-08-17T02:23:42.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.969+0000 7f5165600640 1 -- 172.21.15.2:0/634777870 --> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f51600ac740 con 0x7f513c065150 2024-08-17T02:23:42.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.977+0000 7f5157400640 1 -- 172.21.15.2:0/634777870 <== mgr.4108 v2:172.21.15.145:6832/36841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264477 (secure 0 0 0) 0x7f51600ac740 con 0x7f513c065150 2024-08-17T02:23:42.982 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:42.983 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-17T02:23:42.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.981+0000 7f5165600640 1 -- 172.21.15.2:0/634777870 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f513c065150 msgr2=0x7f513c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.981+0000 7f5165600640 1 --2- 172.21.15.2:0/634777870 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f513c065150 0x7f513c067600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5150034000 tx=0x7f5150032000 comp rx=0 tx=0).stop 2024-08-17T02:23:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.981+0000 7f5165600640 1 -- 172.21.15.2:0/634777870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5160158bf0 msgr2=0x7f5160153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.981+0000 7f5165600640 1 --2- 172.21.15.2:0/634777870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5160158bf0 0x7f5160153520 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f515800c860 tx=0x7f5158001690 comp rx=0 tx=0).stop 2024-08-17T02:23:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.981+0000 7f5165600640 1 -- 172.21.15.2:0/634777870 shutdown_connections 2024-08-17T02:23:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.981+0000 7f5165600640 1 --2- 172.21.15.2:0/634777870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5160158bf0 0x7f5160153520 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.981+0000 7f5165600640 1 --2- 172.21.15.2:0/634777870 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f513c065150 0x7f513c067600 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.981+0000 7f5165600640 1 --2- 172.21.15.2:0/634777870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51600ae4a0 0x7f516006ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.981+0000 7f5165600640 1 --2- 172.21.15.2:0/634777870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51600ac2e0 0x7f51600c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.981+0000 7f5165600640 1 -- 172.21.15.2:0/634777870 >> 172.21.15.2:0/634777870 conn(0x7f51600ce420 msgr2=0x7f51600aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.981+0000 7f5165600640 1 -- 172.21.15.2:0/634777870 shutdown_connections 2024-08-17T02:23:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:42.981+0000 7f5165600640 1 -- 172.21.15.2:0/634777870 wait complete. 2024-08-17T02:23:42.997 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-08-17T02:23:42.052518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398628,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576092,"statfs":{"total":773094113280,"available":770637918208,"internally_reserved":0,"allocated":2990080,"data_stored":1787916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002286"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.976573+0000","last_change":"2024-08-17T02:23:31.975398+0000","last_active":"2024-08-17T02:23:31.976573+0000","last_peered":"2024-08-17T02:23:31.976573+0000","last_clean":"2024-08-17T02:23:31.976573+0000","last_became_active":"2024-08-17T02:23:31.974455+0000","last_became_peered":"2024-08-17T02:23:31.974455+0000","last_unstale":"2024-08-17T02:23:31.976573+0000","last_undegraded":"2024-08-17T02:23:31.976573+0000","last_fullsized":"2024-08-17T02:23:31.976573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:42:58.072658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.975890+0000","last_change":"2024-08-17T02:23:31.971947+0000","last_active":"2024-08-17T02:23:31.975890+0000","last_peered":"2024-08-17T02:23:31.975890+0000","last_clean":"2024-08-17T02:23:31.975890+0000","last_became_active":"2024-08-17T02:23:31.971544+0000","last_became_peered":"2024-08-17T02:23:31.971544+0000","last_unstale":"2024-08-17T02:23:31.975890+0000","last_undegraded":"2024-08-17T02:23:31.975890+0000","last_fullsized":"2024-08-17T02:23:31.975890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:43.020526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.976567+0000","last_change":"2024-08-17T02:23:31.967149+0000","last_active":"2024-08-17T02:23:31.976567+0000","last_peered":"2024-08-17T02:23:31.976567+0000","last_clean":"2024-08-17T02:23:31.976567+0000","last_became_active":"2024-08-17T02:23:31.966332+0000","last_became_peered":"2024-08-17T02:23:31.966332+0000","last_unstale":"2024-08-17T02:23:31.976567+0000","last_undegraded":"2024-08-17T02:23:31.976567+0000","last_fullsized":"2024-08-17T02:23:31.976567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:11:26.255794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.986850+0000","last_change":"2024-08-17T02:23:31.972259+0000","last_active":"2024-08-17T02:23:31.986850+0000","last_peered":"2024-08-17T02:23:31.986850+0000","last_clean":"2024-08-17T02:23:31.986850+0000","last_became_active":"2024-08-17T02:23:31.972071+0000","last_became_peered":"2024-08-17T02:23:31.972071+0000","last_unstale":"2024-08-17T02:23:31.986850+0000","last_undegraded":"2024-08-17T02:23:31.986850+0000","last_fullsized":"2024-08-17T02:23:31.986850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:50:55.354947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.970412+0000","last_change":"2024-08-17T02:23:31.966422+0000","last_active":"2024-08-17T02:23:31.970412+0000","last_peered":"2024-08-17T02:23:31.970412+0000","last_clean":"2024-08-17T02:23:31.970412+0000","last_became_active":"2024-08-17T02:23:31.966173+0000","last_became_peered":"2024-08-17T02:23:31.966173+0000","last_unstale":"2024-08-17T02:23:31.970412+0000","last_undegraded":"2024-08-17T02:23:31.970412+0000","last_fullsized":"2024-08-17T02:23:31.970412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:07:31.568338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983924+0000","last_change":"2024-08-17T02:23:31.966700+0000","last_active":"2024-08-17T02:23:31.983924+0000","last_peered":"2024-08-17T02:23:31.983924+0000","last_clean":"2024-08-17T02:23:31.983924+0000","last_became_active":"2024-08-17T02:23:31.965880+0000","last_became_peered":"2024-08-17T02:23:31.965880+0000","last_unstale":"2024-08-17T02:23:31.983924+0000","last_undegraded":"2024-08-17T02:23:31.983924+0000","last_fullsized":"2024-08-17T02:23:31.983924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:42:58.072658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.970145+0000","last_change":"2024-08-17T02:23:31.963777+0000","last_active":"2024-08-17T02:23:31.970145+0000","last_peered":"2024-08-17T02:23:31.970145+0000","last_clean":"2024-08-17T02:23:31.970145+0000","last_became_active":"2024-08-17T02:23:31.963602+0000","last_became_peered":"2024-08-17T02:23:31.963602+0000","last_unstale":"2024-08-17T02:23:31.970145+0000","last_undegraded":"2024-08-17T02:23:31.970145+0000","last_fullsized":"2024-08-17T02:23:31.970145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:05:46.608052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.987327+0000","last_change":"2024-08-17T02:23:31.986488+0000","last_active":"2024-08-17T02:23:31.987327+0000","last_peered":"2024-08-17T02:23:31.987327+0000","last_clean":"2024-08-17T02:23:31.987327+0000","last_became_active":"2024-08-17T02:23:31.986199+0000","last_became_peered":"2024-08-17T02:23:31.986199+0000","last_unstale":"2024-08-17T02:23:31.987327+0000","last_undegraded":"2024-08-17T02:23:31.987327+0000","last_fullsized":"2024-08-17T02:23:31.987327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:27:58.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985276+0000","last_change":"2024-08-17T02:23:31.982345+0000","last_active":"2024-08-17T02:23:31.985276+0000","last_peered":"2024-08-17T02:23:31.985276+0000","last_clean":"2024-08-17T02:23:31.985276+0000","last_became_active":"2024-08-17T02:23:31.982054+0000","last_became_peered":"2024-08-17T02:23:31.982054+0000","last_unstale":"2024-08-17T02:23:31.985276+0000","last_undegraded":"2024-08-17T02:23:31.985276+0000","last_fullsized":"2024-08-17T02:23:31.985276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:38.802352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985840+0000","last_change":"2024-08-17T02:23:31.984335+0000","last_active":"2024-08-17T02:23:31.985840+0000","last_peered":"2024-08-17T02:23:31.985840+0000","last_clean":"2024-08-17T02:23:31.985840+0000","last_became_active":"2024-08-17T02:23:31.984069+0000","last_became_peered":"2024-08-17T02:23:31.984069+0000","last_unstale":"2024-08-17T02:23:31.985840+0000","last_undegraded":"2024-08-17T02:23:31.985840+0000","last_fullsized":"2024-08-17T02:23:31.985840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:42:34.434625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.988620+0000","last_change":"2024-08-17T02:23:31.987422+0000","last_active":"2024-08-17T02:23:31.988620+0000","last_peered":"2024-08-17T02:23:31.988620+0000","last_clean":"2024-08-17T02:23:31.988620+0000","last_became_active":"2024-08-17T02:23:31.987106+0000","last_became_peered":"2024-08-17T02:23:31.987106+0000","last_unstale":"2024-08-17T02:23:31.988620+0000","last_undegraded":"2024-08-17T02:23:31.988620+0000","last_fullsized":"2024-08-17T02:23:31.988620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:11:26.255794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983816+0000","last_change":"2024-08-17T02:23:31.976682+0000","last_active":"2024-08-17T02:23:31.983816+0000","last_peered":"2024-08-17T02:23:31.983816+0000","last_clean":"2024-08-17T02:23:31.983816+0000","last_became_active":"2024-08-17T02:23:31.976445+0000","last_became_peered":"2024-08-17T02:23:31.976445+0000","last_unstale":"2024-08-17T02:23:31.983816+0000","last_undegraded":"2024-08-17T02:23:31.983816+0000","last_fullsized":"2024-08-17T02:23:31.983816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:55:04.972521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983681+0000","last_change":"2024-08-17T02:23:31.963968+0000","last_active":"2024-08-17T02:23:31.983681+0000","last_peered":"2024-08-17T02:23:31.983681+0000","last_clean":"2024-08-17T02:23:31.983681+0000","last_became_active":"2024-08-17T02:23:31.963710+0000","last_became_peered":"2024-08-17T02:23:31.963710+0000","last_unstale":"2024-08-17T02:23:31.983681+0000","last_undegraded":"2024-08-17T02:23:31.983681+0000","last_fullsized":"2024-08-17T02:23:31.983681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:06.432367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.977187+0000","last_change":"2024-08-17T02:23:31.970021+0000","last_active":"2024-08-17T02:23:31.977187+0000","last_peered":"2024-08-17T02:23:31.977187+0000","last_clean":"2024-08-17T02:23:31.977187+0000","last_became_active":"2024-08-17T02:23:31.969518+0000","last_became_peered":"2024-08-17T02:23:31.969518+0000","last_unstale":"2024-08-17T02:23:31.977187+0000","last_undegraded":"2024-08-17T02:23:31.977187+0000","last_fullsized":"2024-08-17T02:23:31.977187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:25:23.210871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983062+0000","last_change":"2024-08-17T02:23:31.980168+0000","last_active":"2024-08-17T02:23:31.983062+0000","last_peered":"2024-08-17T02:23:31.983062+0000","last_clean":"2024-08-17T02:23:31.983062+0000","last_became_active":"2024-08-17T02:23:31.979853+0000","last_became_peered":"2024-08-17T02:23:31.979853+0000","last_unstale":"2024-08-17T02:23:31.983062+0000","last_undegraded":"2024-08-17T02:23:31.983062+0000","last_fullsized":"2024-08-17T02:23:31.983062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:10.516503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985764+0000","last_change":"2024-08-17T02:23:31.968007+0000","last_active":"2024-08-17T02:23:31.985764+0000","last_peered":"2024-08-17T02:23:31.985764+0000","last_clean":"2024-08-17T02:23:31.985764+0000","last_became_active":"2024-08-17T02:23:31.967725+0000","last_became_peered":"2024-08-17T02:23:31.967725+0000","last_unstale":"2024-08-17T02:23:31.985764+0000","last_undegraded":"2024-08-17T02:23:31.985764+0000","last_fullsized":"2024-08-17T02:23:31.985764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:07:31.568338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.986784+0000","last_change":"2024-08-17T02:23:31.967123+0000","last_active":"2024-08-17T02:23:31.986784+0000","last_peered":"2024-08-17T02:23:31.986784+0000","last_clean":"2024-08-17T02:23:31.986784+0000","last_became_active":"2024-08-17T02:23:31.966871+0000","last_became_peered":"2024-08-17T02:23:31.966871+0000","last_unstale":"2024-08-17T02:23:31.986784+0000","last_undegraded":"2024-08-17T02:23:31.986784+0000","last_fullsized":"2024-08-17T02:23:31.986784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:58.965182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.966662+0000","last_change":"2024-08-17T02:23:31.964474+0000","last_active":"2024-08-17T02:23:31.966662+0000","last_peered":"2024-08-17T02:23:31.966662+0000","last_clean":"2024-08-17T02:23:31.966662+0000","last_became_active":"2024-08-17T02:23:31.964075+0000","last_became_peered":"2024-08-17T02:23:31.964075+0000","last_unstale":"2024-08-17T02:23:31.966662+0000","last_undegraded":"2024-08-17T02:23:31.966662+0000","last_fullsized":"2024-08-17T02:23:31.966662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:57.546866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.970203+0000","last_change":"2024-08-17T02:23:31.965304+0000","last_active":"2024-08-17T02:23:31.970203+0000","last_peered":"2024-08-17T02:23:31.970203+0000","last_clean":"2024-08-17T02:23:31.970203+0000","last_became_active":"2024-08-17T02:23:31.964834+0000","last_became_peered":"2024-08-17T02:23:31.964834+0000","last_unstale":"2024-08-17T02:23:31.970203+0000","last_undegraded":"2024-08-17T02:23:31.970203+0000","last_fullsized":"2024-08-17T02:23:31.970203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:51.027128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.982736+0000","last_change":"2024-08-17T02:23:31.981469+0000","last_active":"2024-08-17T02:23:31.982736+0000","last_peered":"2024-08-17T02:23:31.982736+0000","last_clean":"2024-08-17T02:23:31.982736+0000","last_became_active":"2024-08-17T02:23:31.981200+0000","last_became_peered":"2024-08-17T02:23:31.981200+0000","last_unstale":"2024-08-17T02:23:31.982736+0000","last_undegraded":"2024-08-17T02:23:31.982736+0000","last_fullsized":"2024-08-17T02:23:31.982736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:43.020526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.977261+0000","last_change":"2024-08-17T02:23:31.965936+0000","last_active":"2024-08-17T02:23:31.977261+0000","last_peered":"2024-08-17T02:23:31.977261+0000","last_clean":"2024-08-17T02:23:31.977261+0000","last_became_active":"2024-08-17T02:23:31.965076+0000","last_became_peered":"2024-08-17T02:23:31.965076+0000","last_unstale":"2024-08-17T02:23:31.977261+0000","last_undegraded":"2024-08-17T02:23:31.977261+0000","last_fullsized":"2024-08-17T02:23:31.977261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:39.645299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983907+0000","last_change":"2024-08-17T02:23:31.964668+0000","last_active":"2024-08-17T02:23:31.983907+0000","last_peered":"2024-08-17T02:23:31.983907+0000","last_clean":"2024-08-17T02:23:31.983907+0000","last_became_active":"2024-08-17T02:23:31.964419+0000","last_became_peered":"2024-08-17T02:23:31.964419+0000","last_unstale":"2024-08-17T02:23:31.983907+0000","last_undegraded":"2024-08-17T02:23:31.983907+0000","last_fullsized":"2024-08-17T02:23:31.983907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:37.211325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985700+0000","last_change":"2024-08-17T02:23:31.984594+0000","last_active":"2024-08-17T02:23:31.985700+0000","last_peered":"2024-08-17T02:23:31.985700+0000","last_clean":"2024-08-17T02:23:31.985700+0000","last_became_active":"2024-08-17T02:23:31.984322+0000","last_became_peered":"2024-08-17T02:23:31.984322+0000","last_unstale":"2024-08-17T02:23:31.985700+0000","last_undegraded":"2024-08-17T02:23:31.985700+0000","last_fullsized":"2024-08-17T02:23:31.985700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:37.211325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985777+0000","last_change":"2024-08-17T02:23:31.974171+0000","last_active":"2024-08-17T02:23:31.985777+0000","last_peered":"2024-08-17T02:23:31.985777+0000","last_clean":"2024-08-17T02:23:31.985777+0000","last_became_active":"2024-08-17T02:23:31.973932+0000","last_became_peered":"2024-08-17T02:23:31.973932+0000","last_unstale":"2024-08-17T02:23:31.985777+0000","last_undegraded":"2024-08-17T02:23:31.985777+0000","last_fullsized":"2024-08-17T02:23:31.985777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:06.432367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985116+0000","last_change":"2024-08-17T02:23:31.977090+0000","last_active":"2024-08-17T02:23:31.985116+0000","last_peered":"2024-08-17T02:23:31.985116+0000","last_clean":"2024-08-17T02:23:31.985116+0000","last_became_active":"2024-08-17T02:23:31.976653+0000","last_became_peered":"2024-08-17T02:23:31.976653+0000","last_unstale":"2024-08-17T02:23:31.985116+0000","last_undegraded":"2024-08-17T02:23:31.985116+0000","last_fullsized":"2024-08-17T02:23:31.985116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:38.802352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.966162+0000","last_change":"2024-08-17T02:23:31.962013+0000","last_active":"2024-08-17T02:23:31.966162+0000","last_peered":"2024-08-17T02:23:31.966162+0000","last_clean":"2024-08-17T02:23:31.966162+0000","last_became_active":"2024-08-17T02:23:31.961662+0000","last_became_peered":"2024-08-17T02:23:31.961662+0000","last_unstale":"2024-08-17T02:23:31.966162+0000","last_undegraded":"2024-08-17T02:23:31.966162+0000","last_fullsized":"2024-08-17T02:23:31.966162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:07:14.545767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.967130+0000","last_change":"2024-08-17T02:23:31.963911+0000","last_active":"2024-08-17T02:23:31.967130+0000","last_peered":"2024-08-17T02:23:31.967130+0000","last_clean":"2024-08-17T02:23:31.967130+0000","last_became_active":"2024-08-17T02:23:31.963534+0000","last_became_peered":"2024-08-17T02:23:31.963534+0000","last_unstale":"2024-08-17T02:23:31.967130+0000","last_undegraded":"2024-08-17T02:23:31.967130+0000","last_fullsized":"2024-08-17T02:23:31.967130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:11:26.255794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985361+0000","last_change":"2024-08-17T02:23:31.977370+0000","last_active":"2024-08-17T02:23:31.985361+0000","last_peered":"2024-08-17T02:23:31.985361+0000","last_clean":"2024-08-17T02:23:31.985361+0000","last_became_active":"2024-08-17T02:23:31.976692+0000","last_became_peered":"2024-08-17T02:23:31.976692+0000","last_unstale":"2024-08-17T02:23:31.985361+0000","last_undegraded":"2024-08-17T02:23:31.985361+0000","last_fullsized":"2024-08-17T02:23:31.985361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:39.645299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.977272+0000","last_change":"2024-08-17T02:23:31.966212+0000","last_active":"2024-08-17T02:23:31.977272+0000","last_peered":"2024-08-17T02:23:31.977272+0000","last_clean":"2024-08-17T02:23:31.977272+0000","last_became_active":"2024-08-17T02:23:31.965470+0000","last_became_peered":"2024-08-17T02:23:31.965470+0000","last_unstale":"2024-08-17T02:23:31.977272+0000","last_undegraded":"2024-08-17T02:23:31.977272+0000","last_fullsized":"2024-08-17T02:23:31.977272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:06.432367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983877+0000","last_change":"2024-08-17T02:23:31.964525+0000","last_active":"2024-08-17T02:23:31.983877+0000","last_peered":"2024-08-17T02:23:31.983877+0000","last_clean":"2024-08-17T02:23:31.983877+0000","last_became_active":"2024-08-17T02:23:31.963132+0000","last_became_peered":"2024-08-17T02:23:31.963132+0000","last_unstale":"2024-08-17T02:23:31.983877+0000","last_undegraded":"2024-08-17T02:23:31.983877+0000","last_fullsized":"2024-08-17T02:23:31.983877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:30.415547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983642+0000","last_change":"2024-08-17T02:23:31.982370+0000","last_active":"2024-08-17T02:23:31.983642+0000","last_peered":"2024-08-17T02:23:31.983642+0000","last_clean":"2024-08-17T02:23:31.983642+0000","last_became_active":"2024-08-17T02:23:31.982169+0000","last_became_peered":"2024-08-17T02:23:31.982169+0000","last_unstale":"2024-08-17T02:23:31.983642+0000","last_undegraded":"2024-08-17T02:23:31.983642+0000","last_fullsized":"2024-08-17T02:23:31.983642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:02.185169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.980609+0000","last_change":"2024-08-17T02:23:31.978196+0000","last_active":"2024-08-17T02:23:31.980609+0000","last_peered":"2024-08-17T02:23:31.980609+0000","last_clean":"2024-08-17T02:23:31.980609+0000","last_became_active":"2024-08-17T02:23:31.977913+0000","last_became_peered":"2024-08-17T02:23:31.977913+0000","last_unstale":"2024-08-17T02:23:31.980609+0000","last_undegraded":"2024-08-17T02:23:31.980609+0000","last_fullsized":"2024-08-17T02:23:31.980609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:37.211325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.980234+0000","last_change":"2024-08-17T02:23:31.975460+0000","last_active":"2024-08-17T02:23:31.980234+0000","last_peered":"2024-08-17T02:23:31.980234+0000","last_clean":"2024-08-17T02:23:31.980234+0000","last_became_active":"2024-08-17T02:23:31.972459+0000","last_became_peered":"2024-08-17T02:23:31.972459+0000","last_unstale":"2024-08-17T02:23:31.980234+0000","last_undegraded":"2024-08-17T02:23:31.980234+0000","last_fullsized":"2024-08-17T02:23:31.980234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:02.185169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983707+0000","last_change":"2024-08-17T02:23:30.979772+0000","last_active":"2024-08-17T02:23:31.983707+0000","last_peered":"2024-08-17T02:23:31.983707+0000","last_clean":"2024-08-17T02:23:31.983707+0000","last_became_active":"2024-08-17T02:23:30.979520+0000","last_became_peered":"2024-08-17T02:23:30.979520+0000","last_unstale":"2024-08-17T02:23:31.983707+0000","last_undegraded":"2024-08-17T02:23:31.983707+0000","last_fullsized":"2024-08-17T02:23:31.983707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:28.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.981114+0000","last_change":"2024-08-17T02:23:31.973462+0000","last_active":"2024-08-17T02:23:31.981114+0000","last_peered":"2024-08-17T02:23:31.981114+0000","last_clean":"2024-08-17T02:23:31.981114+0000","last_became_active":"2024-08-17T02:23:31.973180+0000","last_became_peered":"2024-08-17T02:23:31.973180+0000","last_unstale":"2024-08-17T02:23:31.981114+0000","last_undegraded":"2024-08-17T02:23:31.981114+0000","last_fullsized":"2024-08-17T02:23:31.981114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:43.020526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985474+0000","last_change":"2024-08-17T02:23:30.974773+0000","last_active":"2024-08-17T02:23:31.985474+0000","last_peered":"2024-08-17T02:23:31.985474+0000","last_clean":"2024-08-17T02:23:31.985474+0000","last_became_active":"2024-08-17T02:23:30.974578+0000","last_became_peered":"2024-08-17T02:23:30.974578+0000","last_unstale":"2024-08-17T02:23:31.985474+0000","last_undegraded":"2024-08-17T02:23:31.985474+0000","last_fullsized":"2024-08-17T02:23:31.985474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:55:03.969746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.956993+0000","last_change":"2024-08-17T02:23:30.968559+0000","last_active":"2024-08-17T02:23:31.956993+0000","last_peered":"2024-08-17T02:23:31.956993+0000","last_clean":"2024-08-17T02:23:31.956993+0000","last_became_active":"2024-08-17T02:23:30.968312+0000","last_became_peered":"2024-08-17T02:23:30.968312+0000","last_unstale":"2024-08-17T02:23:31.956993+0000","last_undegraded":"2024-08-17T02:23:31.956993+0000","last_fullsized":"2024-08-17T02:23:31.956993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:01.947289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.982474+0000","last_change":"2024-08-17T02:23:31.962531+0000","last_active":"2024-08-17T02:23:31.982474+0000","last_peered":"2024-08-17T02:23:31.982474+0000","last_clean":"2024-08-17T02:23:31.982474+0000","last_became_active":"2024-08-17T02:23:31.962242+0000","last_became_peered":"2024-08-17T02:23:31.962242+0000","last_unstale":"2024-08-17T02:23:31.982474+0000","last_undegraded":"2024-08-17T02:23:31.982474+0000","last_fullsized":"2024-08-17T02:23:31.982474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:11:26.255794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.952106+0000","last_change":"2024-08-17T02:23:30.972145+0000","last_active":"2024-08-17T02:23:31.952106+0000","last_peered":"2024-08-17T02:23:31.952106+0000","last_clean":"2024-08-17T02:23:31.952106+0000","last_became_active":"2024-08-17T02:23:30.969098+0000","last_became_peered":"2024-08-17T02:23:30.969098+0000","last_unstale":"2024-08-17T02:23:31.952106+0000","last_undegraded":"2024-08-17T02:23:31.952106+0000","last_fullsized":"2024-08-17T02:23:31.952106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:20.670802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.967039+0000","last_change":"2024-08-17T02:23:31.963819+0000","last_active":"2024-08-17T02:23:31.967039+0000","last_peered":"2024-08-17T02:23:31.967039+0000","last_clean":"2024-08-17T02:23:31.967039+0000","last_became_active":"2024-08-17T02:23:31.963535+0000","last_became_peered":"2024-08-17T02:23:31.963535+0000","last_unstale":"2024-08-17T02:23:31.967039+0000","last_undegraded":"2024-08-17T02:23:31.967039+0000","last_fullsized":"2024-08-17T02:23:31.967039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:42:34.434625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.965666+0000","last_change":"2024-08-17T02:23:30.970927+0000","last_active":"2024-08-17T02:23:31.965666+0000","last_peered":"2024-08-17T02:23:31.965666+0000","last_clean":"2024-08-17T02:23:31.965666+0000","last_became_active":"2024-08-17T02:23:30.970635+0000","last_became_peered":"2024-08-17T02:23:30.970635+0000","last_unstale":"2024-08-17T02:23:31.965666+0000","last_undegraded":"2024-08-17T02:23:31.965666+0000","last_fullsized":"2024-08-17T02:23:31.965666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:20.670802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983562+0000","last_change":"2024-08-17T02:23:31.962830+0000","last_active":"2024-08-17T02:23:31.983562+0000","last_peered":"2024-08-17T02:23:31.983562+0000","last_clean":"2024-08-17T02:23:31.983562+0000","last_became_active":"2024-08-17T02:23:31.962559+0000","last_became_peered":"2024-08-17T02:23:31.962559+0000","last_unstale":"2024-08-17T02:23:31.983562+0000","last_undegraded":"2024-08-17T02:23:31.983562+0000","last_fullsized":"2024-08-17T02:23:31.983562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:10.516503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.949546+0000","last_change":"2024-08-17T02:23:30.970596+0000","last_active":"2024-08-17T02:23:31.949546+0000","last_peered":"2024-08-17T02:23:31.949546+0000","last_clean":"2024-08-17T02:23:31.949546+0000","last_became_active":"2024-08-17T02:23:30.970344+0000","last_became_peered":"2024-08-17T02:23:30.970344+0000","last_unstale":"2024-08-17T02:23:31.949546+0000","last_undegraded":"2024-08-17T02:23:31.949546+0000","last_fullsized":"2024-08-17T02:23:31.949546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:55:03.969746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.984046+0000","last_change":"2024-08-17T02:23:31.982745+0000","last_active":"2024-08-17T02:23:31.984046+0000","last_peered":"2024-08-17T02:23:31.984046+0000","last_clean":"2024-08-17T02:23:31.984046+0000","last_became_active":"2024-08-17T02:23:31.980074+0000","last_became_peered":"2024-08-17T02:23:31.980074+0000","last_unstale":"2024-08-17T02:23:31.984046+0000","last_undegraded":"2024-08-17T02:23:31.984046+0000","last_fullsized":"2024-08-17T02:23:31.984046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:10.516503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.987068+0000","last_change":"2024-08-17T02:23:30.976633+0000","last_active":"2024-08-17T02:23:31.987068+0000","last_peered":"2024-08-17T02:23:31.987068+0000","last_clean":"2024-08-17T02:23:31.987068+0000","last_became_active":"2024-08-17T02:23:30.976281+0000","last_became_peered":"2024-08-17T02:23:30.976281+0000","last_unstale":"2024-08-17T02:23:31.987068+0000","last_undegraded":"2024-08-17T02:23:31.987068+0000","last_fullsized":"2024-08-17T02:23:31.987068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:40.754285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983904+0000","last_change":"2024-08-17T02:23:31.977353+0000","last_active":"2024-08-17T02:23:31.983904+0000","last_peered":"2024-08-17T02:23:31.983904+0000","last_clean":"2024-08-17T02:23:31.983904+0000","last_became_active":"2024-08-17T02:23:31.976904+0000","last_became_peered":"2024-08-17T02:23:31.976904+0000","last_unstale":"2024-08-17T02:23:31.983904+0000","last_undegraded":"2024-08-17T02:23:31.983904+0000","last_fullsized":"2024-08-17T02:23:31.983904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:02.950063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.989041+0000","last_change":"2024-08-17T02:23:30.975577+0000","last_active":"2024-08-17T02:23:31.989041+0000","last_peered":"2024-08-17T02:23:31.989041+0000","last_clean":"2024-08-17T02:23:31.989041+0000","last_became_active":"2024-08-17T02:23:30.975345+0000","last_became_peered":"2024-08-17T02:23:30.975345+0000","last_unstale":"2024-08-17T02:23:31.989041+0000","last_undegraded":"2024-08-17T02:23:31.989041+0000","last_fullsized":"2024-08-17T02:23:31.989041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:40.754285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.970187+0000","last_change":"2024-08-17T02:23:31.965120+0000","last_active":"2024-08-17T02:23:31.970187+0000","last_peered":"2024-08-17T02:23:31.970187+0000","last_clean":"2024-08-17T02:23:31.970187+0000","last_became_active":"2024-08-17T02:23:31.964587+0000","last_became_peered":"2024-08-17T02:23:31.964587+0000","last_unstale":"2024-08-17T02:23:31.970187+0000","last_undegraded":"2024-08-17T02:23:31.970187+0000","last_fullsized":"2024-08-17T02:23:31.970187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:39:53.991015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985350+0000","last_change":"2024-08-17T02:23:30.972844+0000","last_active":"2024-08-17T02:23:31.985350+0000","last_peered":"2024-08-17T02:23:31.985350+0000","last_clean":"2024-08-17T02:23:31.985350+0000","last_became_active":"2024-08-17T02:23:30.972369+0000","last_became_peered":"2024-08-17T02:23:30.972369+0000","last_unstale":"2024-08-17T02:23:31.985350+0000","last_undegraded":"2024-08-17T02:23:31.985350+0000","last_fullsized":"2024-08-17T02:23:31.985350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:36:25.509573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.977171+0000","last_change":"2024-08-17T02:23:31.963289+0000","last_active":"2024-08-17T02:23:31.977171+0000","last_peered":"2024-08-17T02:23:31.977171+0000","last_clean":"2024-08-17T02:23:31.977171+0000","last_became_active":"2024-08-17T02:23:31.962870+0000","last_became_peered":"2024-08-17T02:23:31.962870+0000","last_unstale":"2024-08-17T02:23:31.977171+0000","last_undegraded":"2024-08-17T02:23:31.977171+0000","last_fullsized":"2024-08-17T02:23:31.977171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:03:52.570659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.948335+0000","last_change":"2024-08-17T02:23:30.973479+0000","last_active":"2024-08-17T02:23:31.948335+0000","last_peered":"2024-08-17T02:23:31.948335+0000","last_clean":"2024-08-17T02:23:31.948335+0000","last_became_active":"2024-08-17T02:23:30.973209+0000","last_became_peered":"2024-08-17T02:23:30.973209+0000","last_unstale":"2024-08-17T02:23:31.948335+0000","last_undegraded":"2024-08-17T02:23:31.948335+0000","last_fullsized":"2024-08-17T02:23:31.948335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:28.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.974767+0000","last_change":"2024-08-17T02:23:31.973100+0000","last_active":"2024-08-17T02:23:31.974767+0000","last_peered":"2024-08-17T02:23:31.974767+0000","last_clean":"2024-08-17T02:23:31.974767+0000","last_became_active":"2024-08-17T02:23:31.972794+0000","last_became_peered":"2024-08-17T02:23:31.972794+0000","last_unstale":"2024-08-17T02:23:31.974767+0000","last_undegraded":"2024-08-17T02:23:31.974767+0000","last_fullsized":"2024-08-17T02:23:31.974767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:58.965182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.954123+0000","last_change":"2024-08-17T02:23:30.970722+0000","last_active":"2024-08-17T02:23:31.954123+0000","last_peered":"2024-08-17T02:23:31.954123+0000","last_clean":"2024-08-17T02:23:31.954123+0000","last_became_active":"2024-08-17T02:23:30.970468+0000","last_became_peered":"2024-08-17T02:23:30.970468+0000","last_unstale":"2024-08-17T02:23:31.954123+0000","last_undegraded":"2024-08-17T02:23:31.954123+0000","last_fullsized":"2024-08-17T02:23:31.954123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:28.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.980626+0000","last_change":"2024-08-17T02:23:31.978226+0000","last_active":"2024-08-17T02:23:31.980626+0000","last_peered":"2024-08-17T02:23:31.980626+0000","last_clean":"2024-08-17T02:23:31.980626+0000","last_became_active":"2024-08-17T02:23:31.977930+0000","last_became_peered":"2024-08-17T02:23:31.977930+0000","last_unstale":"2024-08-17T02:23:31.980626+0000","last_undegraded":"2024-08-17T02:23:31.980626+0000","last_fullsized":"2024-08-17T02:23:31.980626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:10.516503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.979877+0000","last_change":"2024-08-17T02:23:30.965657+0000","last_active":"2024-08-17T02:23:31.979877+0000","last_peered":"2024-08-17T02:23:31.979877+0000","last_clean":"2024-08-17T02:23:31.979877+0000","last_became_active":"2024-08-17T02:23:30.965304+0000","last_became_peered":"2024-08-17T02:23:30.965304+0000","last_unstale":"2024-08-17T02:23:31.979877+0000","last_undegraded":"2024-08-17T02:23:31.979877+0000","last_fullsized":"2024-08-17T02:23:31.979877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:01.947289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.982558+0000","last_change":"2024-08-17T02:23:31.981260+0000","last_active":"2024-08-17T02:23:31.982558+0000","last_peered":"2024-08-17T02:23:31.982558+0000","last_clean":"2024-08-17T02:23:31.982558+0000","last_became_active":"2024-08-17T02:23:31.980747+0000","last_became_peered":"2024-08-17T02:23:31.980747+0000","last_unstale":"2024-08-17T02:23:31.982558+0000","last_undegraded":"2024-08-17T02:23:31.982558+0000","last_fullsized":"2024-08-17T02:23:31.982558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:30.415547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.984093+0000","last_change":"2024-08-17T02:23:30.968562+0000","last_active":"2024-08-17T02:23:31.984093+0000","last_peered":"2024-08-17T02:23:31.984093+0000","last_clean":"2024-08-17T02:23:31.984093+0000","last_became_active":"2024-08-17T02:23:30.968264+0000","last_became_peered":"2024-08-17T02:23:30.968264+0000","last_unstale":"2024-08-17T02:23:31.984093+0000","last_undegraded":"2024-08-17T02:23:31.984093+0000","last_fullsized":"2024-08-17T02:23:31.984093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:48:44.495463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.974695+0000","last_change":"2024-08-17T02:23:31.972997+0000","last_active":"2024-08-17T02:23:31.974695+0000","last_peered":"2024-08-17T02:23:31.974695+0000","last_clean":"2024-08-17T02:23:31.974695+0000","last_became_active":"2024-08-17T02:23:31.972782+0000","last_became_peered":"2024-08-17T02:23:31.972782+0000","last_unstale":"2024-08-17T02:23:31.974695+0000","last_undegraded":"2024-08-17T02:23:31.974695+0000","last_fullsized":"2024-08-17T02:23:31.974695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:50:55.354947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985261+0000","last_change":"2024-08-17T02:23:30.973992+0000","last_active":"2024-08-17T02:23:31.985261+0000","last_peered":"2024-08-17T02:23:31.985261+0000","last_clean":"2024-08-17T02:23:31.985261+0000","last_became_active":"2024-08-17T02:23:30.973677+0000","last_became_peered":"2024-08-17T02:23:30.973677+0000","last_unstale":"2024-08-17T02:23:31.985261+0000","last_undegraded":"2024-08-17T02:23:31.985261+0000","last_fullsized":"2024-08-17T02:23:31.985261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:28.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.976099+0000","last_change":"2024-08-17T02:23:31.973617+0000","last_active":"2024-08-17T02:23:31.976099+0000","last_peered":"2024-08-17T02:23:31.976099+0000","last_clean":"2024-08-17T02:23:31.976099+0000","last_became_active":"2024-08-17T02:23:31.973290+0000","last_became_peered":"2024-08-17T02:23:31.973290+0000","last_unstale":"2024-08-17T02:23:31.976099+0000","last_undegraded":"2024-08-17T02:23:31.976099+0000","last_fullsized":"2024-08-17T02:23:31.976099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:06.432367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.977182+0000","last_change":"2024-08-17T02:23:30.968994+0000","last_active":"2024-08-17T02:23:31.977182+0000","last_peered":"2024-08-17T02:23:31.977182+0000","last_clean":"2024-08-17T02:23:31.977182+0000","last_became_active":"2024-08-17T02:23:30.968655+0000","last_became_peered":"2024-08-17T02:23:30.968655+0000","last_unstale":"2024-08-17T02:23:31.977182+0000","last_undegraded":"2024-08-17T02:23:31.977182+0000","last_fullsized":"2024-08-17T02:23:31.977182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:20.670802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.986832+0000","last_change":"2024-08-17T02:23:31.968122+0000","last_active":"2024-08-17T02:23:31.986832+0000","last_peered":"2024-08-17T02:23:31.986832+0000","last_clean":"2024-08-17T02:23:31.986832+0000","last_became_active":"2024-08-17T02:23:31.967900+0000","last_became_peered":"2024-08-17T02:23:31.967900+0000","last_unstale":"2024-08-17T02:23:31.986832+0000","last_undegraded":"2024-08-17T02:23:31.986832+0000","last_fullsized":"2024-08-17T02:23:31.986832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:51.027128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.950822+0000","last_change":"2024-08-17T02:23:30.958979+0000","last_active":"2024-08-17T02:23:31.950822+0000","last_peered":"2024-08-17T02:23:31.950822+0000","last_clean":"2024-08-17T02:23:31.950822+0000","last_became_active":"2024-08-17T02:23:30.958685+0000","last_became_peered":"2024-08-17T02:23:30.958685+0000","last_unstale":"2024-08-17T02:23:31.950822+0000","last_undegraded":"2024-08-17T02:23:31.950822+0000","last_fullsized":"2024-08-17T02:23:31.950822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:20.670802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985565+0000","last_change":"2024-08-17T02:23:31.983473+0000","last_active":"2024-08-17T02:23:31.985565+0000","last_peered":"2024-08-17T02:23:31.985565+0000","last_clean":"2024-08-17T02:23:31.985565+0000","last_became_active":"2024-08-17T02:23:31.983267+0000","last_became_peered":"2024-08-17T02:23:31.983267+0000","last_unstale":"2024-08-17T02:23:31.985565+0000","last_undegraded":"2024-08-17T02:23:31.985565+0000","last_fullsized":"2024-08-17T02:23:31.985565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:43.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.949384+0000","last_change":"2024-08-17T02:23:27.953699+0000","last_active":"2024-08-17T02:23:31.949384+0000","last_peered":"2024-08-17T02:23:31.949384+0000","last_clean":"2024-08-17T02:23:31.949384+0000","last_became_active":"2024-08-17T02:23:27.952879+0000","last_became_peered":"2024-08-17T02:23:27.952879+0000","last_unstale":"2024-08-17T02:23:31.949384+0000","last_undegraded":"2024-08-17T02:23:31.949384+0000","last_fullsized":"2024-08-17T02:23:31.949384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:26.811202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:26.811202+0000","last_clean_scrub_stamp":"2024-08-17T02:23:26.811202+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:48.565059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.946954+0000","last_change":"2024-08-17T02:23:30.951704+0000","last_active":"2024-08-17T02:23:31.946954+0000","last_peered":"2024-08-17T02:23:31.946954+0000","last_clean":"2024-08-17T02:23:31.946954+0000","last_became_active":"2024-08-17T02:23:30.951462+0000","last_became_peered":"2024-08-17T02:23:30.951462+0000","last_unstale":"2024-08-17T02:23:31.946954+0000","last_undegraded":"2024-08-17T02:23:31.946954+0000","last_fullsized":"2024-08-17T02:23:31.946954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:01.947289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985590+0000","last_change":"2024-08-17T02:23:31.982162+0000","last_active":"2024-08-17T02:23:31.985590+0000","last_peered":"2024-08-17T02:23:31.985590+0000","last_clean":"2024-08-17T02:23:31.985590+0000","last_became_active":"2024-08-17T02:23:31.981826+0000","last_became_peered":"2024-08-17T02:23:31.981826+0000","last_unstale":"2024-08-17T02:23:31.985590+0000","last_undegraded":"2024-08-17T02:23:31.985590+0000","last_fullsized":"2024-08-17T02:23:31.985590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:07:31.568338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.949295+0000","last_change":"2024-08-17T02:23:30.960984+0000","last_active":"2024-08-17T02:23:31.949295+0000","last_peered":"2024-08-17T02:23:31.949295+0000","last_clean":"2024-08-17T02:23:31.949295+0000","last_became_active":"2024-08-17T02:23:30.960649+0000","last_became_peered":"2024-08-17T02:23:30.960649+0000","last_unstale":"2024-08-17T02:23:31.949295+0000","last_undegraded":"2024-08-17T02:23:31.949295+0000","last_fullsized":"2024-08-17T02:23:31.949295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:55:03.969746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983295+0000","last_change":"2024-08-17T02:23:31.980993+0000","last_active":"2024-08-17T02:23:31.983295+0000","last_peered":"2024-08-17T02:23:31.983295+0000","last_clean":"2024-08-17T02:23:31.983295+0000","last_became_active":"2024-08-17T02:23:31.980759+0000","last_became_peered":"2024-08-17T02:23:31.980759+0000","last_unstale":"2024-08-17T02:23:31.983295+0000","last_undegraded":"2024-08-17T02:23:31.983295+0000","last_fullsized":"2024-08-17T02:23:31.983295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:55.653301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.950251+0000","last_change":"2024-08-17T02:23:30.962851+0000","last_active":"2024-08-17T02:23:31.950251+0000","last_peered":"2024-08-17T02:23:31.950251+0000","last_clean":"2024-08-17T02:23:31.950251+0000","last_became_active":"2024-08-17T02:23:30.962554+0000","last_became_peered":"2024-08-17T02:23:30.962554+0000","last_unstale":"2024-08-17T02:23:31.950251+0000","last_undegraded":"2024-08-17T02:23:31.950251+0000","last_fullsized":"2024-08-17T02:23:31.950251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:36:25.509573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.960964+0000","last_change":"2024-08-17T02:23:31.957810+0000","last_active":"2024-08-17T02:23:31.960964+0000","last_peered":"2024-08-17T02:23:31.960964+0000","last_clean":"2024-08-17T02:23:31.960964+0000","last_became_active":"2024-08-17T02:23:31.957542+0000","last_became_peered":"2024-08-17T02:23:31.957542+0000","last_unstale":"2024-08-17T02:23:31.960964+0000","last_undegraded":"2024-08-17T02:23:31.960964+0000","last_fullsized":"2024-08-17T02:23:31.960964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:55.653301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.948429+0000","last_change":"2024-08-17T02:23:30.964915+0000","last_active":"2024-08-17T02:23:31.948429+0000","last_peered":"2024-08-17T02:23:31.948429+0000","last_clean":"2024-08-17T02:23:31.948429+0000","last_became_active":"2024-08-17T02:23:30.964673+0000","last_became_peered":"2024-08-17T02:23:30.964673+0000","last_unstale":"2024-08-17T02:23:31.948429+0000","last_undegraded":"2024-08-17T02:23:31.948429+0000","last_fullsized":"2024-08-17T02:23:31.948429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:40.754285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.976470+0000","last_change":"2024-08-17T02:23:31.971758+0000","last_active":"2024-08-17T02:23:31.976470+0000","last_peered":"2024-08-17T02:23:31.976470+0000","last_clean":"2024-08-17T02:23:31.976470+0000","last_became_active":"2024-08-17T02:23:31.971467+0000","last_became_peered":"2024-08-17T02:23:31.971467+0000","last_unstale":"2024-08-17T02:23:31.976470+0000","last_undegraded":"2024-08-17T02:23:31.976470+0000","last_fullsized":"2024-08-17T02:23:31.976470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:36.029248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.945915+0000","last_change":"2024-08-17T02:23:30.959168+0000","last_active":"2024-08-17T02:23:31.945915+0000","last_peered":"2024-08-17T02:23:31.945915+0000","last_clean":"2024-08-17T02:23:31.945915+0000","last_became_active":"2024-08-17T02:23:30.958720+0000","last_became_peered":"2024-08-17T02:23:30.958720+0000","last_unstale":"2024-08-17T02:23:31.945915+0000","last_undegraded":"2024-08-17T02:23:31.945915+0000","last_fullsized":"2024-08-17T02:23:31.945915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:35.026473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983315+0000","last_change":"2024-08-17T02:23:31.964694+0000","last_active":"2024-08-17T02:23:31.983315+0000","last_peered":"2024-08-17T02:23:31.983315+0000","last_clean":"2024-08-17T02:23:31.983315+0000","last_became_active":"2024-08-17T02:23:31.963180+0000","last_became_peered":"2024-08-17T02:23:31.963180+0000","last_unstale":"2024-08-17T02:23:31.983315+0000","last_undegraded":"2024-08-17T02:23:31.983315+0000","last_fullsized":"2024-08-17T02:23:31.983315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:39.645299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.949003+0000","last_change":"2024-08-17T02:23:30.961092+0000","last_active":"2024-08-17T02:23:31.949003+0000","last_peered":"2024-08-17T02:23:31.949003+0000","last_clean":"2024-08-17T02:23:31.949003+0000","last_became_active":"2024-08-17T02:23:30.960812+0000","last_became_peered":"2024-08-17T02:23:30.960812+0000","last_unstale":"2024-08-17T02:23:31.949003+0000","last_undegraded":"2024-08-17T02:23:31.949003+0000","last_fullsized":"2024-08-17T02:23:31.949003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:40.754285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.966415+0000","last_change":"2024-08-17T02:23:31.961035+0000","last_active":"2024-08-17T02:23:31.966415+0000","last_peered":"2024-08-17T02:23:31.966415+0000","last_clean":"2024-08-17T02:23:31.966415+0000","last_became_active":"2024-08-17T02:23:31.960738+0000","last_became_peered":"2024-08-17T02:23:31.960738+0000","last_unstale":"2024-08-17T02:23:31.966415+0000","last_undegraded":"2024-08-17T02:23:31.966415+0000","last_fullsized":"2024-08-17T02:23:31.966415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:27:58.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:33.089612+0000","last_change":"2024-08-17T02:23:30.962881+0000","last_active":"2024-08-17T02:23:33.089612+0000","last_peered":"2024-08-17T02:23:33.089612+0000","last_clean":"2024-08-17T02:23:33.089612+0000","last_became_active":"2024-08-17T02:23:30.962620+0000","last_became_peered":"2024-08-17T02:23:30.962620+0000","last_unstale":"2024-08-17T02:23:33.089612+0000","last_undegraded":"2024-08-17T02:23:33.089612+0000","last_fullsized":"2024-08-17T02:23:33.089612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:55:03.969746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.982546+0000","last_change":"2024-08-17T02:23:31.962220+0000","last_active":"2024-08-17T02:23:31.982546+0000","last_peered":"2024-08-17T02:23:31.982546+0000","last_clean":"2024-08-17T02:23:31.982546+0000","last_became_active":"2024-08-17T02:23:31.961166+0000","last_became_peered":"2024-08-17T02:23:31.961166+0000","last_unstale":"2024-08-17T02:23:31.982546+0000","last_undegraded":"2024-08-17T02:23:31.982546+0000","last_fullsized":"2024-08-17T02:23:31.982546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:43.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.976607+0000","last_change":"2024-08-17T02:23:30.966054+0000","last_active":"2024-08-17T02:23:31.976607+0000","last_peered":"2024-08-17T02:23:31.976607+0000","last_clean":"2024-08-17T02:23:31.976607+0000","last_became_active":"2024-08-17T02:23:30.965784+0000","last_became_peered":"2024-08-17T02:23:30.965784+0000","last_unstale":"2024-08-17T02:23:31.976607+0000","last_undegraded":"2024-08-17T02:23:31.976607+0000","last_fullsized":"2024-08-17T02:23:31.976607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:01.947289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.976523+0000","last_change":"2024-08-17T02:23:31.965797+0000","last_active":"2024-08-17T02:23:31.976523+0000","last_peered":"2024-08-17T02:23:31.976523+0000","last_clean":"2024-08-17T02:23:31.976523+0000","last_became_active":"2024-08-17T02:23:31.965545+0000","last_became_peered":"2024-08-17T02:23:31.965545+0000","last_unstale":"2024-08-17T02:23:31.976523+0000","last_undegraded":"2024-08-17T02:23:31.976523+0000","last_fullsized":"2024-08-17T02:23:31.976523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:45:56.326425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.949197+0000","last_change":"2024-08-17T02:23:30.965869+0000","last_active":"2024-08-17T02:23:31.949197+0000","last_peered":"2024-08-17T02:23:31.949197+0000","last_clean":"2024-08-17T02:23:31.949197+0000","last_became_active":"2024-08-17T02:23:30.965608+0000","last_became_peered":"2024-08-17T02:23:30.965608+0000","last_unstale":"2024-08-17T02:23:31.949197+0000","last_undegraded":"2024-08-17T02:23:31.949197+0000","last_fullsized":"2024-08-17T02:23:31.949197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:35.026473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983948+0000","last_change":"2024-08-17T02:23:31.978413+0000","last_active":"2024-08-17T02:23:31.983948+0000","last_peered":"2024-08-17T02:23:31.983948+0000","last_clean":"2024-08-17T02:23:31.983948+0000","last_became_active":"2024-08-17T02:23:31.978007+0000","last_became_peered":"2024-08-17T02:23:31.978007+0000","last_unstale":"2024-08-17T02:23:31.983948+0000","last_undegraded":"2024-08-17T02:23:31.983948+0000","last_fullsized":"2024-08-17T02:23:31.983948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:41.757059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.945306+0000","last_change":"2024-08-17T02:23:30.964876+0000","last_active":"2024-08-17T02:23:31.945306+0000","last_peered":"2024-08-17T02:23:31.945306+0000","last_clean":"2024-08-17T02:23:31.945306+0000","last_became_active":"2024-08-17T02:23:30.964624+0000","last_became_peered":"2024-08-17T02:23:30.964624+0000","last_unstale":"2024-08-17T02:23:31.945306+0000","last_undegraded":"2024-08-17T02:23:31.945306+0000","last_fullsized":"2024-08-17T02:23:31.945306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:28.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.982454+0000","last_change":"2024-08-17T02:23:31.962150+0000","last_active":"2024-08-17T02:23:31.982454+0000","last_peered":"2024-08-17T02:23:31.982454+0000","last_clean":"2024-08-17T02:23:31.982454+0000","last_became_active":"2024-08-17T02:23:31.961854+0000","last_became_peered":"2024-08-17T02:23:31.961854+0000","last_unstale":"2024-08-17T02:23:31.982454+0000","last_undegraded":"2024-08-17T02:23:31.982454+0000","last_fullsized":"2024-08-17T02:23:31.982454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:03:52.570659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.945619+0000","last_change":"2024-08-17T02:23:30.973512+0000","last_active":"2024-08-17T02:23:31.945619+0000","last_peered":"2024-08-17T02:23:31.945619+0000","last_clean":"2024-08-17T02:23:31.945619+0000","last_became_active":"2024-08-17T02:23:30.973240+0000","last_became_peered":"2024-08-17T02:23:30.973240+0000","last_unstale":"2024-08-17T02:23:31.945619+0000","last_undegraded":"2024-08-17T02:23:31.945619+0000","last_fullsized":"2024-08-17T02:23:31.945619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:01.947289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985519+0000","last_change":"2024-08-17T02:23:31.978338+0000","last_active":"2024-08-17T02:23:31.985519+0000","last_peered":"2024-08-17T02:23:31.985519+0000","last_clean":"2024-08-17T02:23:31.985519+0000","last_became_active":"2024-08-17T02:23:31.978044+0000","last_became_peered":"2024-08-17T02:23:31.978044+0000","last_unstale":"2024-08-17T02:23:31.985519+0000","last_undegraded":"2024-08-17T02:23:31.985519+0000","last_fullsized":"2024-08-17T02:23:31.985519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:10.516503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.973244+0000","last_change":"2024-08-17T02:23:30.965867+0000","last_active":"2024-08-17T02:23:31.973244+0000","last_peered":"2024-08-17T02:23:31.973244+0000","last_clean":"2024-08-17T02:23:31.973244+0000","last_became_active":"2024-08-17T02:23:30.965564+0000","last_became_peered":"2024-08-17T02:23:30.965564+0000","last_unstale":"2024-08-17T02:23:31.973244+0000","last_undegraded":"2024-08-17T02:23:31.973244+0000","last_fullsized":"2024-08-17T02:23:31.973244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:01.182394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983652+0000","last_change":"2024-08-17T02:23:31.982027+0000","last_active":"2024-08-17T02:23:31.983652+0000","last_peered":"2024-08-17T02:23:31.983652+0000","last_clean":"2024-08-17T02:23:31.983652+0000","last_became_active":"2024-08-17T02:23:31.981722+0000","last_became_peered":"2024-08-17T02:23:31.981722+0000","last_unstale":"2024-08-17T02:23:31.983652+0000","last_undegraded":"2024-08-17T02:23:31.983652+0000","last_fullsized":"2024-08-17T02:23:31.983652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:55.653301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.986694+0000","last_change":"2024-08-17T02:23:31.978093+0000","last_active":"2024-08-17T02:23:31.986694+0000","last_peered":"2024-08-17T02:23:31.986694+0000","last_clean":"2024-08-17T02:23:31.986694+0000","last_became_active":"2024-08-17T02:23:31.977706+0000","last_became_peered":"2024-08-17T02:23:31.977706+0000","last_unstale":"2024-08-17T02:23:31.986694+0000","last_undegraded":"2024-08-17T02:23:31.986694+0000","last_fullsized":"2024-08-17T02:23:31.986694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:43.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.987152+0000","last_change":"2024-08-17T02:23:30.957349+0000","last_active":"2024-08-17T02:23:31.987152+0000","last_peered":"2024-08-17T02:23:31.987152+0000","last_clean":"2024-08-17T02:23:31.987152+0000","last_became_active":"2024-08-17T02:23:30.957063+0000","last_became_peered":"2024-08-17T02:23:30.957063+0000","last_unstale":"2024-08-17T02:23:31.987152+0000","last_undegraded":"2024-08-17T02:23:31.987152+0000","last_fullsized":"2024-08-17T02:23:31.987152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:01.947289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.986866+0000","last_change":"2024-08-17T02:23:31.974984+0000","last_active":"2024-08-17T02:23:31.986866+0000","last_peered":"2024-08-17T02:23:31.986866+0000","last_clean":"2024-08-17T02:23:31.986866+0000","last_became_active":"2024-08-17T02:23:31.974774+0000","last_became_peered":"2024-08-17T02:23:31.974774+0000","last_unstale":"2024-08-17T02:23:31.986866+0000","last_undegraded":"2024-08-17T02:23:31.986866+0000","last_fullsized":"2024-08-17T02:23:31.986866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:38.802352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.974239+0000","last_change":"2024-08-17T02:23:30.965411+0000","last_active":"2024-08-17T02:23:31.974239+0000","last_peered":"2024-08-17T02:23:31.974239+0000","last_clean":"2024-08-17T02:23:31.974239+0000","last_became_active":"2024-08-17T02:23:30.962792+0000","last_became_peered":"2024-08-17T02:23:30.962792+0000","last_unstale":"2024-08-17T02:23:31.974239+0000","last_undegraded":"2024-08-17T02:23:31.974239+0000","last_fullsized":"2024-08-17T02:23:31.974239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:56.544091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983073+0000","last_change":"2024-08-17T02:23:31.980658+0000","last_active":"2024-08-17T02:23:31.983073+0000","last_peered":"2024-08-17T02:23:31.983073+0000","last_clean":"2024-08-17T02:23:31.983073+0000","last_became_active":"2024-08-17T02:23:31.980238+0000","last_became_peered":"2024-08-17T02:23:31.980238+0000","last_unstale":"2024-08-17T02:23:31.983073+0000","last_undegraded":"2024-08-17T02:23:31.983073+0000","last_fullsized":"2024-08-17T02:23:31.983073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:37.211325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983596+0000","last_change":"2024-08-17T02:23:30.972133+0000","last_active":"2024-08-17T02:23:31.983596+0000","last_peered":"2024-08-17T02:23:31.983596+0000","last_clean":"2024-08-17T02:23:31.983596+0000","last_became_active":"2024-08-17T02:23:30.971784+0000","last_became_peered":"2024-08-17T02:23:30.971784+0000","last_unstale":"2024-08-17T02:23:31.983596+0000","last_undegraded":"2024-08-17T02:23:31.983596+0000","last_fullsized":"2024-08-17T02:23:31.983596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:20.670802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983566+0000","last_change":"2024-08-17T02:23:31.965808+0000","last_active":"2024-08-17T02:23:31.983566+0000","last_peered":"2024-08-17T02:23:31.983566+0000","last_clean":"2024-08-17T02:23:31.983566+0000","last_became_active":"2024-08-17T02:23:31.965581+0000","last_became_peered":"2024-08-17T02:23:31.965581+0000","last_unstale":"2024-08-17T02:23:31.983566+0000","last_undegraded":"2024-08-17T02:23:31.983566+0000","last_fullsized":"2024-08-17T02:23:31.983566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:58.965182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.982943+0000","last_change":"2024-08-17T02:23:30.962575+0000","last_active":"2024-08-17T02:23:31.982943+0000","last_peered":"2024-08-17T02:23:31.982943+0000","last_clean":"2024-08-17T02:23:31.982943+0000","last_became_active":"2024-08-17T02:23:30.962277+0000","last_became_peered":"2024-08-17T02:23:30.962277+0000","last_unstale":"2024-08-17T02:23:31.982943+0000","last_undegraded":"2024-08-17T02:23:31.982943+0000","last_fullsized":"2024-08-17T02:23:31.982943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:24:02.271519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":815104,"data_stored":666251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.528}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301732,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070108,"statfs":{"total":96636764160,"available":96327790592,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.738}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1440000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3170000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.891}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6850000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.931}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0150000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301740,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070100,"statfs":{"total":96636764160,"available":96327782400,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302320,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069520,"statfs":{"total":96636764160,"available":96327188480,"internally_reserved":0,"allocated":823296,"data_stored":666307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:23:43.002 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:23:43.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.189+0000 7f21ed200640 1 Processor -- start 2024-08-17T02:23:43.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.189+0000 7f21ed200640 1 -- start start 2024-08-17T02:23:43.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.190+0000 7f21ed200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f21e80cadc0 0x7f21e80cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.190+0000 7f21ed200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21e80cca40 0x7f21e80af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.190+0000 7f21ed200640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e80cf600 con 0x7f21e8158c90 2024-08-17T02:23:43.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.190+0000 7f21ed200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e80ce890 con 0x7f21e80cadc0 2024-08-17T02:23:43.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.190+0000 7f21ed200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e80cea90 con 0x7f21e80cca40 2024-08-17T02:23:43.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.190+0000 7f21dfe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f21e80cadc0 0x7f21e80cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.190+0000 7f21dfe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f21e80cadc0 0x7f21e80cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54328/0 (socket says 172.21.15.2:54328) 2024-08-17T02:23:43.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.190+0000 7f21dfe00640 1 -- 172.21.15.2:0/575064776 learned_addr learned my addr 172.21.15.2:0/575064776 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:43.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.190+0000 7f21e7e00640 1 --2- 172.21.15.2:0/575064776 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21e80cca40 0x7f21e80af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.191+0000 7f21dfe00640 1 -- 172.21.15.2:0/575064776 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21e80cca40 msgr2=0x7f21e80af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:43.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.191+0000 7f21dfe00640 1 --2- 172.21.15.2:0/575064776 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21e80cca40 0x7f21e80af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.191+0000 7f21dfe00640 1 -- 172.21.15.2:0/575064776 >> v1:172.21.15.145:6789/0 conn(0x7f21e8158c90 legacy=0x7f21e80ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.191+0000 7f21dfe00640 1 -- 172.21.15.2:0/575064776 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e80ced30 con 0x7f21e80cadc0 2024-08-17T02:23:43.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.192+0000 7f21dfe00640 1 --2- 172.21.15.2:0/575064776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21e80cadc0 0x7f21e80cc500 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009910 tx=0x7f21d00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5af9de242920710 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:43.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.192+0000 7f21e6a00640 1 -- 172.21.15.2:0/575064776 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d002ae40 con 0x7f21e80cadc0 2024-08-17T02:23:43.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.192+0000 7f21e6a00640 1 -- 172.21.15.2:0/575064776 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d0032440 con 0x7f21e80cadc0 2024-08-17T02:23:43.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.192+0000 7f21e6a00640 1 -- 172.21.15.2:0/575064776 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d0032820 con 0x7f21e80cadc0 2024-08-17T02:23:43.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.192+0000 7f21ed200640 1 -- 172.21.15.2:0/575064776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21e80cadc0 msgr2=0x7f21e80cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.192+0000 7f21ed200640 1 --2- 172.21.15.2:0/575064776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21e80cadc0 0x7f21e80cc500 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009910 tx=0x7f21d00091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.192+0000 7f21ed200640 1 -- 172.21.15.2:0/575064776 shutdown_connections 2024-08-17T02:23:43.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.192+0000 7f21ed200640 1 --2- 172.21.15.2:0/575064776 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21e80cca40 0x7f21e80af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.192+0000 7f21ed200640 1 --2- 172.21.15.2:0/575064776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21e80cadc0 0x7f21e80cc500 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.192+0000 7f21ed200640 1 -- 172.21.15.2:0/575064776 >> 172.21.15.2:0/575064776 conn(0x7f21e8087a80 msgr2=0x7f21e806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:43.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.193+0000 7f21ed200640 1 -- 172.21.15.2:0/575064776 shutdown_connections 2024-08-17T02:23:43.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.193+0000 7f21ed200640 1 -- 172.21.15.2:0/575064776 wait complete. 2024-08-17T02:23:43.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.194+0000 7f21ed200640 1 Processor -- start 2024-08-17T02:23:43.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.194+0000 7f21ed200640 1 -- start start 2024-08-17T02:23:43.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.195+0000 7f21ed200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21e80cadc0 0x7f21e814fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.195+0000 7f21ed200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f21e80cca40 0x7f21e80af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.195+0000 7f21ed200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21e8158c90 0x7f21e80c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.195+0000 7f21ed200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e80b0dc0 con 0x7f21e8158c90 2024-08-17T02:23:43.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.195+0000 7f21ed200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e80b01b0 con 0x7f21e80cca40 2024-08-17T02:23:43.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.195+0000 7f21ed200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e80b0490 con 0x7f21e80cadc0 2024-08-17T02:23:43.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.195+0000 7f21e7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21e8158c90 0x7f21e80c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.195+0000 7f21e7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21e8158c90 0x7f21e80c5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54330/0 (socket says 172.21.15.2:54330) 2024-08-17T02:23:43.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.195+0000 7f21e7e00640 1 -- 172.21.15.2:0/1137361940 learned_addr learned my addr 172.21.15.2:0/1137361940 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:43.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.195+0000 7f21e7400640 1 --2- 172.21.15.2:0/1137361940 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21e80cadc0 0x7f21e814fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.195+0000 7f21dfe00640 1 --2- 172.21.15.2:0/1137361940 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f21e80cca40 0x7f21e80af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.196+0000 7f21e7e00640 1 -- 172.21.15.2:0/1137361940 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21e80cadc0 msgr2=0x7f21e814fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.196+0000 7f21e7e00640 1 --2- 172.21.15.2:0/1137361940 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21e80cadc0 0x7f21e814fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.196+0000 7f21e7e00640 1 -- 172.21.15.2:0/1137361940 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f21e80cca40 msgr2=0x7f21e80af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.196+0000 7f21e7e00640 1 --2- 172.21.15.2:0/1137361940 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f21e80cca40 0x7f21e80af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.196+0000 7f21e7e00640 1 -- 172.21.15.2:0/1137361940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d0009450 con 0x7f21e8158c90 2024-08-17T02:23:43.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.196+0000 7f21e7e00640 1 --2- 172.21.15.2:0/1137361940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21e8158c90 0x7f21e80c5460 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f21e0009fa0 tx=0x7f21e0009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:43.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.196+0000 7f21dea00640 1 -- 172.21.15.2:0/1137361940 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e000ee60 con 0x7f21e8158c90 2024-08-17T02:23:43.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.196+0000 7f21dea00640 1 -- 172.21.15.2:0/1137361940 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e0014420 con 0x7f21e8158c90 2024-08-17T02:23:43.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.196+0000 7f21ed200640 1 -- 172.21.15.2:0/1137361940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e80b0770 con 0x7f21e8158c90 2024-08-17T02:23:43.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.196+0000 7f21dea00640 1 -- 172.21.15.2:0/1137361940 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e00147e0 con 0x7f21e8158c90 2024-08-17T02:23:43.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.196+0000 7f21ed200640 1 -- 172.21.15.2:0/1137361940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e8154780 con 0x7f21e8158c90 2024-08-17T02:23:43.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.197+0000 7f21ed200640 1 -- 172.21.15.2:0/1137361940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e8154970 con 0x7f21e8158c90 2024-08-17T02:23:43.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.198+0000 7f21dea00640 1 -- 172.21.15.2:0/1137361940 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f21e0014b50 con 0x7f21e8158c90 2024-08-17T02:23:43.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.199+0000 7f21dea00640 1 --2- 172.21.15.2:0/1137361940 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f21c4065180 0x7f21c4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.199+0000 7f21dea00640 1 -- 172.21.15.2:0/1137361940 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f21e0082bc0 con 0x7f21e8158c90 2024-08-17T02:23:43.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.200+0000 7f21e7400640 1 --2- 172.21.15.2:0/1137361940 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f21c4065180 0x7f21c4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.200+0000 7f21e7400640 1 --2- 172.21.15.2:0/1137361940 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f21c4065180 0x7f21c4067630 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f21d8007fd0 tx=0x7f21d8007e30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:43.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.203+0000 7f21dea00640 1 -- 172.21.15.2:0/1137361940 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f21e8154970 con 0x7f21e8158c90 2024-08-17T02:23:43.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.380+0000 7f21ed200640 1 -- 172.21.15.2:0/1137361940 --> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f21e8154970 con 0x7f21c4065180 2024-08-17T02:23:43.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.387+0000 7f21dea00640 1 -- 172.21.15.2:0/1137361940 <== mgr.4108 v2:172.21.15.145:6832/36841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264477 (secure 0 0 0) 0x7f21e8154970 con 0x7f21c4065180 2024-08-17T02:23:43.392 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:43.394 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-17T02:23:43.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.391+0000 7f21ed200640 1 -- 172.21.15.2:0/1137361940 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f21c4065180 msgr2=0x7f21c4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.391+0000 7f21ed200640 1 --2- 172.21.15.2:0/1137361940 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f21c4065180 0x7f21c4067630 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f21d8007fd0 tx=0x7f21d8007e30 comp rx=0 tx=0).stop 2024-08-17T02:23:43.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.391+0000 7f21ed200640 1 -- 172.21.15.2:0/1137361940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21e8158c90 msgr2=0x7f21e80c5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.391+0000 7f21ed200640 1 --2- 172.21.15.2:0/1137361940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21e8158c90 0x7f21e80c5460 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f21e0009fa0 tx=0x7f21e0009900 comp rx=0 tx=0).stop 2024-08-17T02:23:43.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.391+0000 7f21ed200640 1 -- 172.21.15.2:0/1137361940 shutdown_connections 2024-08-17T02:23:43.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.391+0000 7f21ed200640 1 --2- 172.21.15.2:0/1137361940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21e8158c90 0x7f21e80c5460 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.391+0000 7f21ed200640 1 --2- 172.21.15.2:0/1137361940 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f21e80cca40 0x7f21e80af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.391+0000 7f21ed200640 1 --2- 172.21.15.2:0/1137361940 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f21c4065180 0x7f21c4067630 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.391+0000 7f21ed200640 1 --2- 172.21.15.2:0/1137361940 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21e80cadc0 0x7f21e814fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.391+0000 7f21ed200640 1 -- 172.21.15.2:0/1137361940 >> 172.21.15.2:0/1137361940 conn(0x7f21e8087a80 msgr2=0x7f21e8154fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:43.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.391+0000 7f21ed200640 1 -- 172.21.15.2:0/1137361940 shutdown_connections 2024-08-17T02:23:43.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.391+0000 7f21ed200640 1 -- 172.21.15.2:0/1137361940 wait complete. 2024-08-17T02:23:43.407 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-08-17T02:23:42.052518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398628,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576092,"statfs":{"total":773094113280,"available":770637918208,"internally_reserved":0,"allocated":2990080,"data_stored":1787916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002286"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.976573+0000","last_change":"2024-08-17T02:23:31.975398+0000","last_active":"2024-08-17T02:23:31.976573+0000","last_peered":"2024-08-17T02:23:31.976573+0000","last_clean":"2024-08-17T02:23:31.976573+0000","last_became_active":"2024-08-17T02:23:31.974455+0000","last_became_peered":"2024-08-17T02:23:31.974455+0000","last_unstale":"2024-08-17T02:23:31.976573+0000","last_undegraded":"2024-08-17T02:23:31.976573+0000","last_fullsized":"2024-08-17T02:23:31.976573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:42:58.072658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.975890+0000","last_change":"2024-08-17T02:23:31.971947+0000","last_active":"2024-08-17T02:23:31.975890+0000","last_peered":"2024-08-17T02:23:31.975890+0000","last_clean":"2024-08-17T02:23:31.975890+0000","last_became_active":"2024-08-17T02:23:31.971544+0000","last_became_peered":"2024-08-17T02:23:31.971544+0000","last_unstale":"2024-08-17T02:23:31.975890+0000","last_undegraded":"2024-08-17T02:23:31.975890+0000","last_fullsized":"2024-08-17T02:23:31.975890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:43.020526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.976567+0000","last_change":"2024-08-17T02:23:31.967149+0000","last_active":"2024-08-17T02:23:31.976567+0000","last_peered":"2024-08-17T02:23:31.976567+0000","last_clean":"2024-08-17T02:23:31.976567+0000","last_became_active":"2024-08-17T02:23:31.966332+0000","last_became_peered":"2024-08-17T02:23:31.966332+0000","last_unstale":"2024-08-17T02:23:31.976567+0000","last_undegraded":"2024-08-17T02:23:31.976567+0000","last_fullsized":"2024-08-17T02:23:31.976567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:11:26.255794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.986850+0000","last_change":"2024-08-17T02:23:31.972259+0000","last_active":"2024-08-17T02:23:31.986850+0000","last_peered":"2024-08-17T02:23:31.986850+0000","last_clean":"2024-08-17T02:23:31.986850+0000","last_became_active":"2024-08-17T02:23:31.972071+0000","last_became_peered":"2024-08-17T02:23:31.972071+0000","last_unstale":"2024-08-17T02:23:31.986850+0000","last_undegraded":"2024-08-17T02:23:31.986850+0000","last_fullsized":"2024-08-17T02:23:31.986850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:50:55.354947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.970412+0000","last_change":"2024-08-17T02:23:31.966422+0000","last_active":"2024-08-17T02:23:31.970412+0000","last_peered":"2024-08-17T02:23:31.970412+0000","last_clean":"2024-08-17T02:23:31.970412+0000","last_became_active":"2024-08-17T02:23:31.966173+0000","last_became_peered":"2024-08-17T02:23:31.966173+0000","last_unstale":"2024-08-17T02:23:31.970412+0000","last_undegraded":"2024-08-17T02:23:31.970412+0000","last_fullsized":"2024-08-17T02:23:31.970412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:07:31.568338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983924+0000","last_change":"2024-08-17T02:23:31.966700+0000","last_active":"2024-08-17T02:23:31.983924+0000","last_peered":"2024-08-17T02:23:31.983924+0000","last_clean":"2024-08-17T02:23:31.983924+0000","last_became_active":"2024-08-17T02:23:31.965880+0000","last_became_peered":"2024-08-17T02:23:31.965880+0000","last_unstale":"2024-08-17T02:23:31.983924+0000","last_undegraded":"2024-08-17T02:23:31.983924+0000","last_fullsized":"2024-08-17T02:23:31.983924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:42:58.072658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.970145+0000","last_change":"2024-08-17T02:23:31.963777+0000","last_active":"2024-08-17T02:23:31.970145+0000","last_peered":"2024-08-17T02:23:31.970145+0000","last_clean":"2024-08-17T02:23:31.970145+0000","last_became_active":"2024-08-17T02:23:31.963602+0000","last_became_peered":"2024-08-17T02:23:31.963602+0000","last_unstale":"2024-08-17T02:23:31.970145+0000","last_undegraded":"2024-08-17T02:23:31.970145+0000","last_fullsized":"2024-08-17T02:23:31.970145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:05:46.608052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.987327+0000","last_change":"2024-08-17T02:23:31.986488+0000","last_active":"2024-08-17T02:23:31.987327+0000","last_peered":"2024-08-17T02:23:31.987327+0000","last_clean":"2024-08-17T02:23:31.987327+0000","last_became_active":"2024-08-17T02:23:31.986199+0000","last_became_peered":"2024-08-17T02:23:31.986199+0000","last_unstale":"2024-08-17T02:23:31.987327+0000","last_undegraded":"2024-08-17T02:23:31.987327+0000","last_fullsized":"2024-08-17T02:23:31.987327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:27:58.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985276+0000","last_change":"2024-08-17T02:23:31.982345+0000","last_active":"2024-08-17T02:23:31.985276+0000","last_peered":"2024-08-17T02:23:31.985276+0000","last_clean":"2024-08-17T02:23:31.985276+0000","last_became_active":"2024-08-17T02:23:31.982054+0000","last_became_peered":"2024-08-17T02:23:31.982054+0000","last_unstale":"2024-08-17T02:23:31.985276+0000","last_undegraded":"2024-08-17T02:23:31.985276+0000","last_fullsized":"2024-08-17T02:23:31.985276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:38.802352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985840+0000","last_change":"2024-08-17T02:23:31.984335+0000","last_active":"2024-08-17T02:23:31.985840+0000","last_peered":"2024-08-17T02:23:31.985840+0000","last_clean":"2024-08-17T02:23:31.985840+0000","last_became_active":"2024-08-17T02:23:31.984069+0000","last_became_peered":"2024-08-17T02:23:31.984069+0000","last_unstale":"2024-08-17T02:23:31.985840+0000","last_undegraded":"2024-08-17T02:23:31.985840+0000","last_fullsized":"2024-08-17T02:23:31.985840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:42:34.434625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.988620+0000","last_change":"2024-08-17T02:23:31.987422+0000","last_active":"2024-08-17T02:23:31.988620+0000","last_peered":"2024-08-17T02:23:31.988620+0000","last_clean":"2024-08-17T02:23:31.988620+0000","last_became_active":"2024-08-17T02:23:31.987106+0000","last_became_peered":"2024-08-17T02:23:31.987106+0000","last_unstale":"2024-08-17T02:23:31.988620+0000","last_undegraded":"2024-08-17T02:23:31.988620+0000","last_fullsized":"2024-08-17T02:23:31.988620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:11:26.255794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983816+0000","last_change":"2024-08-17T02:23:31.976682+0000","last_active":"2024-08-17T02:23:31.983816+0000","last_peered":"2024-08-17T02:23:31.983816+0000","last_clean":"2024-08-17T02:23:31.983816+0000","last_became_active":"2024-08-17T02:23:31.976445+0000","last_became_peered":"2024-08-17T02:23:31.976445+0000","last_unstale":"2024-08-17T02:23:31.983816+0000","last_undegraded":"2024-08-17T02:23:31.983816+0000","last_fullsized":"2024-08-17T02:23:31.983816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:55:04.972521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983681+0000","last_change":"2024-08-17T02:23:31.963968+0000","last_active":"2024-08-17T02:23:31.983681+0000","last_peered":"2024-08-17T02:23:31.983681+0000","last_clean":"2024-08-17T02:23:31.983681+0000","last_became_active":"2024-08-17T02:23:31.963710+0000","last_became_peered":"2024-08-17T02:23:31.963710+0000","last_unstale":"2024-08-17T02:23:31.983681+0000","last_undegraded":"2024-08-17T02:23:31.983681+0000","last_fullsized":"2024-08-17T02:23:31.983681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:06.432367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.977187+0000","last_change":"2024-08-17T02:23:31.970021+0000","last_active":"2024-08-17T02:23:31.977187+0000","last_peered":"2024-08-17T02:23:31.977187+0000","last_clean":"2024-08-17T02:23:31.977187+0000","last_became_active":"2024-08-17T02:23:31.969518+0000","last_became_peered":"2024-08-17T02:23:31.969518+0000","last_unstale":"2024-08-17T02:23:31.977187+0000","last_undegraded":"2024-08-17T02:23:31.977187+0000","last_fullsized":"2024-08-17T02:23:31.977187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:25:23.210871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983062+0000","last_change":"2024-08-17T02:23:31.980168+0000","last_active":"2024-08-17T02:23:31.983062+0000","last_peered":"2024-08-17T02:23:31.983062+0000","last_clean":"2024-08-17T02:23:31.983062+0000","last_became_active":"2024-08-17T02:23:31.979853+0000","last_became_peered":"2024-08-17T02:23:31.979853+0000","last_unstale":"2024-08-17T02:23:31.983062+0000","last_undegraded":"2024-08-17T02:23:31.983062+0000","last_fullsized":"2024-08-17T02:23:31.983062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:10.516503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985764+0000","last_change":"2024-08-17T02:23:31.968007+0000","last_active":"2024-08-17T02:23:31.985764+0000","last_peered":"2024-08-17T02:23:31.985764+0000","last_clean":"2024-08-17T02:23:31.985764+0000","last_became_active":"2024-08-17T02:23:31.967725+0000","last_became_peered":"2024-08-17T02:23:31.967725+0000","last_unstale":"2024-08-17T02:23:31.985764+0000","last_undegraded":"2024-08-17T02:23:31.985764+0000","last_fullsized":"2024-08-17T02:23:31.985764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:07:31.568338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.986784+0000","last_change":"2024-08-17T02:23:31.967123+0000","last_active":"2024-08-17T02:23:31.986784+0000","last_peered":"2024-08-17T02:23:31.986784+0000","last_clean":"2024-08-17T02:23:31.986784+0000","last_became_active":"2024-08-17T02:23:31.966871+0000","last_became_peered":"2024-08-17T02:23:31.966871+0000","last_unstale":"2024-08-17T02:23:31.986784+0000","last_undegraded":"2024-08-17T02:23:31.986784+0000","last_fullsized":"2024-08-17T02:23:31.986784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:58.965182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.966662+0000","last_change":"2024-08-17T02:23:31.964474+0000","last_active":"2024-08-17T02:23:31.966662+0000","last_peered":"2024-08-17T02:23:31.966662+0000","last_clean":"2024-08-17T02:23:31.966662+0000","last_became_active":"2024-08-17T02:23:31.964075+0000","last_became_peered":"2024-08-17T02:23:31.964075+0000","last_unstale":"2024-08-17T02:23:31.966662+0000","last_undegraded":"2024-08-17T02:23:31.966662+0000","last_fullsized":"2024-08-17T02:23:31.966662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:57.546866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.970203+0000","last_change":"2024-08-17T02:23:31.965304+0000","last_active":"2024-08-17T02:23:31.970203+0000","last_peered":"2024-08-17T02:23:31.970203+0000","last_clean":"2024-08-17T02:23:31.970203+0000","last_became_active":"2024-08-17T02:23:31.964834+0000","last_became_peered":"2024-08-17T02:23:31.964834+0000","last_unstale":"2024-08-17T02:23:31.970203+0000","last_undegraded":"2024-08-17T02:23:31.970203+0000","last_fullsized":"2024-08-17T02:23:31.970203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:51.027128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.982736+0000","last_change":"2024-08-17T02:23:31.981469+0000","last_active":"2024-08-17T02:23:31.982736+0000","last_peered":"2024-08-17T02:23:31.982736+0000","last_clean":"2024-08-17T02:23:31.982736+0000","last_became_active":"2024-08-17T02:23:31.981200+0000","last_became_peered":"2024-08-17T02:23:31.981200+0000","last_unstale":"2024-08-17T02:23:31.982736+0000","last_undegraded":"2024-08-17T02:23:31.982736+0000","last_fullsized":"2024-08-17T02:23:31.982736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:43.020526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.977261+0000","last_change":"2024-08-17T02:23:31.965936+0000","last_active":"2024-08-17T02:23:31.977261+0000","last_peered":"2024-08-17T02:23:31.977261+0000","last_clean":"2024-08-17T02:23:31.977261+0000","last_became_active":"2024-08-17T02:23:31.965076+0000","last_became_peered":"2024-08-17T02:23:31.965076+0000","last_unstale":"2024-08-17T02:23:31.977261+0000","last_undegraded":"2024-08-17T02:23:31.977261+0000","last_fullsized":"2024-08-17T02:23:31.977261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:39.645299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983907+0000","last_change":"2024-08-17T02:23:31.964668+0000","last_active":"2024-08-17T02:23:31.983907+0000","last_peered":"2024-08-17T02:23:31.983907+0000","last_clean":"2024-08-17T02:23:31.983907+0000","last_became_active":"2024-08-17T02:23:31.964419+0000","last_became_peered":"2024-08-17T02:23:31.964419+0000","last_unstale":"2024-08-17T02:23:31.983907+0000","last_undegraded":"2024-08-17T02:23:31.983907+0000","last_fullsized":"2024-08-17T02:23:31.983907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:37.211325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985700+0000","last_change":"2024-08-17T02:23:31.984594+0000","last_active":"2024-08-17T02:23:31.985700+0000","last_peered":"2024-08-17T02:23:31.985700+0000","last_clean":"2024-08-17T02:23:31.985700+0000","last_became_active":"2024-08-17T02:23:31.984322+0000","last_became_peered":"2024-08-17T02:23:31.984322+0000","last_unstale":"2024-08-17T02:23:31.985700+0000","last_undegraded":"2024-08-17T02:23:31.985700+0000","last_fullsized":"2024-08-17T02:23:31.985700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:37.211325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985777+0000","last_change":"2024-08-17T02:23:31.974171+0000","last_active":"2024-08-17T02:23:31.985777+0000","last_peered":"2024-08-17T02:23:31.985777+0000","last_clean":"2024-08-17T02:23:31.985777+0000","last_became_active":"2024-08-17T02:23:31.973932+0000","last_became_peered":"2024-08-17T02:23:31.973932+0000","last_unstale":"2024-08-17T02:23:31.985777+0000","last_undegraded":"2024-08-17T02:23:31.985777+0000","last_fullsized":"2024-08-17T02:23:31.985777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:06.432367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985116+0000","last_change":"2024-08-17T02:23:31.977090+0000","last_active":"2024-08-17T02:23:31.985116+0000","last_peered":"2024-08-17T02:23:31.985116+0000","last_clean":"2024-08-17T02:23:31.985116+0000","last_became_active":"2024-08-17T02:23:31.976653+0000","last_became_peered":"2024-08-17T02:23:31.976653+0000","last_unstale":"2024-08-17T02:23:31.985116+0000","last_undegraded":"2024-08-17T02:23:31.985116+0000","last_fullsized":"2024-08-17T02:23:31.985116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:38.802352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.966162+0000","last_change":"2024-08-17T02:23:31.962013+0000","last_active":"2024-08-17T02:23:31.966162+0000","last_peered":"2024-08-17T02:23:31.966162+0000","last_clean":"2024-08-17T02:23:31.966162+0000","last_became_active":"2024-08-17T02:23:31.961662+0000","last_became_peered":"2024-08-17T02:23:31.961662+0000","last_unstale":"2024-08-17T02:23:31.966162+0000","last_undegraded":"2024-08-17T02:23:31.966162+0000","last_fullsized":"2024-08-17T02:23:31.966162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:07:14.545767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.967130+0000","last_change":"2024-08-17T02:23:31.963911+0000","last_active":"2024-08-17T02:23:31.967130+0000","last_peered":"2024-08-17T02:23:31.967130+0000","last_clean":"2024-08-17T02:23:31.967130+0000","last_became_active":"2024-08-17T02:23:31.963534+0000","last_became_peered":"2024-08-17T02:23:31.963534+0000","last_unstale":"2024-08-17T02:23:31.967130+0000","last_undegraded":"2024-08-17T02:23:31.967130+0000","last_fullsized":"2024-08-17T02:23:31.967130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:11:26.255794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985361+0000","last_change":"2024-08-17T02:23:31.977370+0000","last_active":"2024-08-17T02:23:31.985361+0000","last_peered":"2024-08-17T02:23:31.985361+0000","last_clean":"2024-08-17T02:23:31.985361+0000","last_became_active":"2024-08-17T02:23:31.976692+0000","last_became_peered":"2024-08-17T02:23:31.976692+0000","last_unstale":"2024-08-17T02:23:31.985361+0000","last_undegraded":"2024-08-17T02:23:31.985361+0000","last_fullsized":"2024-08-17T02:23:31.985361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:39.645299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.977272+0000","last_change":"2024-08-17T02:23:31.966212+0000","last_active":"2024-08-17T02:23:31.977272+0000","last_peered":"2024-08-17T02:23:31.977272+0000","last_clean":"2024-08-17T02:23:31.977272+0000","last_became_active":"2024-08-17T02:23:31.965470+0000","last_became_peered":"2024-08-17T02:23:31.965470+0000","last_unstale":"2024-08-17T02:23:31.977272+0000","last_undegraded":"2024-08-17T02:23:31.977272+0000","last_fullsized":"2024-08-17T02:23:31.977272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:06.432367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983877+0000","last_change":"2024-08-17T02:23:31.964525+0000","last_active":"2024-08-17T02:23:31.983877+0000","last_peered":"2024-08-17T02:23:31.983877+0000","last_clean":"2024-08-17T02:23:31.983877+0000","last_became_active":"2024-08-17T02:23:31.963132+0000","last_became_peered":"2024-08-17T02:23:31.963132+0000","last_unstale":"2024-08-17T02:23:31.983877+0000","last_undegraded":"2024-08-17T02:23:31.983877+0000","last_fullsized":"2024-08-17T02:23:31.983877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:30.415547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983642+0000","last_change":"2024-08-17T02:23:31.982370+0000","last_active":"2024-08-17T02:23:31.983642+0000","last_peered":"2024-08-17T02:23:31.983642+0000","last_clean":"2024-08-17T02:23:31.983642+0000","last_became_active":"2024-08-17T02:23:31.982169+0000","last_became_peered":"2024-08-17T02:23:31.982169+0000","last_unstale":"2024-08-17T02:23:31.983642+0000","last_undegraded":"2024-08-17T02:23:31.983642+0000","last_fullsized":"2024-08-17T02:23:31.983642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:02.185169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.980609+0000","last_change":"2024-08-17T02:23:31.978196+0000","last_active":"2024-08-17T02:23:31.980609+0000","last_peered":"2024-08-17T02:23:31.980609+0000","last_clean":"2024-08-17T02:23:31.980609+0000","last_became_active":"2024-08-17T02:23:31.977913+0000","last_became_peered":"2024-08-17T02:23:31.977913+0000","last_unstale":"2024-08-17T02:23:31.980609+0000","last_undegraded":"2024-08-17T02:23:31.980609+0000","last_fullsized":"2024-08-17T02:23:31.980609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:37.211325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.980234+0000","last_change":"2024-08-17T02:23:31.975460+0000","last_active":"2024-08-17T02:23:31.980234+0000","last_peered":"2024-08-17T02:23:31.980234+0000","last_clean":"2024-08-17T02:23:31.980234+0000","last_became_active":"2024-08-17T02:23:31.972459+0000","last_became_peered":"2024-08-17T02:23:31.972459+0000","last_unstale":"2024-08-17T02:23:31.980234+0000","last_undegraded":"2024-08-17T02:23:31.980234+0000","last_fullsized":"2024-08-17T02:23:31.980234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:02.185169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983707+0000","last_change":"2024-08-17T02:23:30.979772+0000","last_active":"2024-08-17T02:23:31.983707+0000","last_peered":"2024-08-17T02:23:31.983707+0000","last_clean":"2024-08-17T02:23:31.983707+0000","last_became_active":"2024-08-17T02:23:30.979520+0000","last_became_peered":"2024-08-17T02:23:30.979520+0000","last_unstale":"2024-08-17T02:23:31.983707+0000","last_undegraded":"2024-08-17T02:23:31.983707+0000","last_fullsized":"2024-08-17T02:23:31.983707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:28.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.981114+0000","last_change":"2024-08-17T02:23:31.973462+0000","last_active":"2024-08-17T02:23:31.981114+0000","last_peered":"2024-08-17T02:23:31.981114+0000","last_clean":"2024-08-17T02:23:31.981114+0000","last_became_active":"2024-08-17T02:23:31.973180+0000","last_became_peered":"2024-08-17T02:23:31.973180+0000","last_unstale":"2024-08-17T02:23:31.981114+0000","last_undegraded":"2024-08-17T02:23:31.981114+0000","last_fullsized":"2024-08-17T02:23:31.981114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:43.020526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985474+0000","last_change":"2024-08-17T02:23:30.974773+0000","last_active":"2024-08-17T02:23:31.985474+0000","last_peered":"2024-08-17T02:23:31.985474+0000","last_clean":"2024-08-17T02:23:31.985474+0000","last_became_active":"2024-08-17T02:23:30.974578+0000","last_became_peered":"2024-08-17T02:23:30.974578+0000","last_unstale":"2024-08-17T02:23:31.985474+0000","last_undegraded":"2024-08-17T02:23:31.985474+0000","last_fullsized":"2024-08-17T02:23:31.985474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:55:03.969746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.956993+0000","last_change":"2024-08-17T02:23:30.968559+0000","last_active":"2024-08-17T02:23:31.956993+0000","last_peered":"2024-08-17T02:23:31.956993+0000","last_clean":"2024-08-17T02:23:31.956993+0000","last_became_active":"2024-08-17T02:23:30.968312+0000","last_became_peered":"2024-08-17T02:23:30.968312+0000","last_unstale":"2024-08-17T02:23:31.956993+0000","last_undegraded":"2024-08-17T02:23:31.956993+0000","last_fullsized":"2024-08-17T02:23:31.956993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:01.947289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.982474+0000","last_change":"2024-08-17T02:23:31.962531+0000","last_active":"2024-08-17T02:23:31.982474+0000","last_peered":"2024-08-17T02:23:31.982474+0000","last_clean":"2024-08-17T02:23:31.982474+0000","last_became_active":"2024-08-17T02:23:31.962242+0000","last_became_peered":"2024-08-17T02:23:31.962242+0000","last_unstale":"2024-08-17T02:23:31.982474+0000","last_undegraded":"2024-08-17T02:23:31.982474+0000","last_fullsized":"2024-08-17T02:23:31.982474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:11:26.255794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.952106+0000","last_change":"2024-08-17T02:23:30.972145+0000","last_active":"2024-08-17T02:23:31.952106+0000","last_peered":"2024-08-17T02:23:31.952106+0000","last_clean":"2024-08-17T02:23:31.952106+0000","last_became_active":"2024-08-17T02:23:30.969098+0000","last_became_peered":"2024-08-17T02:23:30.969098+0000","last_unstale":"2024-08-17T02:23:31.952106+0000","last_undegraded":"2024-08-17T02:23:31.952106+0000","last_fullsized":"2024-08-17T02:23:31.952106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:20.670802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.967039+0000","last_change":"2024-08-17T02:23:31.963819+0000","last_active":"2024-08-17T02:23:31.967039+0000","last_peered":"2024-08-17T02:23:31.967039+0000","last_clean":"2024-08-17T02:23:31.967039+0000","last_became_active":"2024-08-17T02:23:31.963535+0000","last_became_peered":"2024-08-17T02:23:31.963535+0000","last_unstale":"2024-08-17T02:23:31.967039+0000","last_undegraded":"2024-08-17T02:23:31.967039+0000","last_fullsized":"2024-08-17T02:23:31.967039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:42:34.434625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.965666+0000","last_change":"2024-08-17T02:23:30.970927+0000","last_active":"2024-08-17T02:23:31.965666+0000","last_peered":"2024-08-17T02:23:31.965666+0000","last_clean":"2024-08-17T02:23:31.965666+0000","last_became_active":"2024-08-17T02:23:30.970635+0000","last_became_peered":"2024-08-17T02:23:30.970635+0000","last_unstale":"2024-08-17T02:23:31.965666+0000","last_undegraded":"2024-08-17T02:23:31.965666+0000","last_fullsized":"2024-08-17T02:23:31.965666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:20.670802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983562+0000","last_change":"2024-08-17T02:23:31.962830+0000","last_active":"2024-08-17T02:23:31.983562+0000","last_peered":"2024-08-17T02:23:31.983562+0000","last_clean":"2024-08-17T02:23:31.983562+0000","last_became_active":"2024-08-17T02:23:31.962559+0000","last_became_peered":"2024-08-17T02:23:31.962559+0000","last_unstale":"2024-08-17T02:23:31.983562+0000","last_undegraded":"2024-08-17T02:23:31.983562+0000","last_fullsized":"2024-08-17T02:23:31.983562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:10.516503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.949546+0000","last_change":"2024-08-17T02:23:30.970596+0000","last_active":"2024-08-17T02:23:31.949546+0000","last_peered":"2024-08-17T02:23:31.949546+0000","last_clean":"2024-08-17T02:23:31.949546+0000","last_became_active":"2024-08-17T02:23:30.970344+0000","last_became_peered":"2024-08-17T02:23:30.970344+0000","last_unstale":"2024-08-17T02:23:31.949546+0000","last_undegraded":"2024-08-17T02:23:31.949546+0000","last_fullsized":"2024-08-17T02:23:31.949546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:55:03.969746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.984046+0000","last_change":"2024-08-17T02:23:31.982745+0000","last_active":"2024-08-17T02:23:31.984046+0000","last_peered":"2024-08-17T02:23:31.984046+0000","last_clean":"2024-08-17T02:23:31.984046+0000","last_became_active":"2024-08-17T02:23:31.980074+0000","last_became_peered":"2024-08-17T02:23:31.980074+0000","last_unstale":"2024-08-17T02:23:31.984046+0000","last_undegraded":"2024-08-17T02:23:31.984046+0000","last_fullsized":"2024-08-17T02:23:31.984046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:10.516503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.987068+0000","last_change":"2024-08-17T02:23:30.976633+0000","last_active":"2024-08-17T02:23:31.987068+0000","last_peered":"2024-08-17T02:23:31.987068+0000","last_clean":"2024-08-17T02:23:31.987068+0000","last_became_active":"2024-08-17T02:23:30.976281+0000","last_became_peered":"2024-08-17T02:23:30.976281+0000","last_unstale":"2024-08-17T02:23:31.987068+0000","last_undegraded":"2024-08-17T02:23:31.987068+0000","last_fullsized":"2024-08-17T02:23:31.987068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:40.754285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983904+0000","last_change":"2024-08-17T02:23:31.977353+0000","last_active":"2024-08-17T02:23:31.983904+0000","last_peered":"2024-08-17T02:23:31.983904+0000","last_clean":"2024-08-17T02:23:31.983904+0000","last_became_active":"2024-08-17T02:23:31.976904+0000","last_became_peered":"2024-08-17T02:23:31.976904+0000","last_unstale":"2024-08-17T02:23:31.983904+0000","last_undegraded":"2024-08-17T02:23:31.983904+0000","last_fullsized":"2024-08-17T02:23:31.983904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:02.950063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.989041+0000","last_change":"2024-08-17T02:23:30.975577+0000","last_active":"2024-08-17T02:23:31.989041+0000","last_peered":"2024-08-17T02:23:31.989041+0000","last_clean":"2024-08-17T02:23:31.989041+0000","last_became_active":"2024-08-17T02:23:30.975345+0000","last_became_peered":"2024-08-17T02:23:30.975345+0000","last_unstale":"2024-08-17T02:23:31.989041+0000","last_undegraded":"2024-08-17T02:23:31.989041+0000","last_fullsized":"2024-08-17T02:23:31.989041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:40.754285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.970187+0000","last_change":"2024-08-17T02:23:31.965120+0000","last_active":"2024-08-17T02:23:31.970187+0000","last_peered":"2024-08-17T02:23:31.970187+0000","last_clean":"2024-08-17T02:23:31.970187+0000","last_became_active":"2024-08-17T02:23:31.964587+0000","last_became_peered":"2024-08-17T02:23:31.964587+0000","last_unstale":"2024-08-17T02:23:31.970187+0000","last_undegraded":"2024-08-17T02:23:31.970187+0000","last_fullsized":"2024-08-17T02:23:31.970187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:39:53.991015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985350+0000","last_change":"2024-08-17T02:23:30.972844+0000","last_active":"2024-08-17T02:23:31.985350+0000","last_peered":"2024-08-17T02:23:31.985350+0000","last_clean":"2024-08-17T02:23:31.985350+0000","last_became_active":"2024-08-17T02:23:30.972369+0000","last_became_peered":"2024-08-17T02:23:30.972369+0000","last_unstale":"2024-08-17T02:23:31.985350+0000","last_undegraded":"2024-08-17T02:23:31.985350+0000","last_fullsized":"2024-08-17T02:23:31.985350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:36:25.509573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.977171+0000","last_change":"2024-08-17T02:23:31.963289+0000","last_active":"2024-08-17T02:23:31.977171+0000","last_peered":"2024-08-17T02:23:31.977171+0000","last_clean":"2024-08-17T02:23:31.977171+0000","last_became_active":"2024-08-17T02:23:31.962870+0000","last_became_peered":"2024-08-17T02:23:31.962870+0000","last_unstale":"2024-08-17T02:23:31.977171+0000","last_undegraded":"2024-08-17T02:23:31.977171+0000","last_fullsized":"2024-08-17T02:23:31.977171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:03:52.570659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.948335+0000","last_change":"2024-08-17T02:23:30.973479+0000","last_active":"2024-08-17T02:23:31.948335+0000","last_peered":"2024-08-17T02:23:31.948335+0000","last_clean":"2024-08-17T02:23:31.948335+0000","last_became_active":"2024-08-17T02:23:30.973209+0000","last_became_peered":"2024-08-17T02:23:30.973209+0000","last_unstale":"2024-08-17T02:23:31.948335+0000","last_undegraded":"2024-08-17T02:23:31.948335+0000","last_fullsized":"2024-08-17T02:23:31.948335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:28.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.974767+0000","last_change":"2024-08-17T02:23:31.973100+0000","last_active":"2024-08-17T02:23:31.974767+0000","last_peered":"2024-08-17T02:23:31.974767+0000","last_clean":"2024-08-17T02:23:31.974767+0000","last_became_active":"2024-08-17T02:23:31.972794+0000","last_became_peered":"2024-08-17T02:23:31.972794+0000","last_unstale":"2024-08-17T02:23:31.974767+0000","last_undegraded":"2024-08-17T02:23:31.974767+0000","last_fullsized":"2024-08-17T02:23:31.974767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:58.965182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.954123+0000","last_change":"2024-08-17T02:23:30.970722+0000","last_active":"2024-08-17T02:23:31.954123+0000","last_peered":"2024-08-17T02:23:31.954123+0000","last_clean":"2024-08-17T02:23:31.954123+0000","last_became_active":"2024-08-17T02:23:30.970468+0000","last_became_peered":"2024-08-17T02:23:30.970468+0000","last_unstale":"2024-08-17T02:23:31.954123+0000","last_undegraded":"2024-08-17T02:23:31.954123+0000","last_fullsized":"2024-08-17T02:23:31.954123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:28.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.980626+0000","last_change":"2024-08-17T02:23:31.978226+0000","last_active":"2024-08-17T02:23:31.980626+0000","last_peered":"2024-08-17T02:23:31.980626+0000","last_clean":"2024-08-17T02:23:31.980626+0000","last_became_active":"2024-08-17T02:23:31.977930+0000","last_became_peered":"2024-08-17T02:23:31.977930+0000","last_unstale":"2024-08-17T02:23:31.980626+0000","last_undegraded":"2024-08-17T02:23:31.980626+0000","last_fullsized":"2024-08-17T02:23:31.980626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:10.516503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.979877+0000","last_change":"2024-08-17T02:23:30.965657+0000","last_active":"2024-08-17T02:23:31.979877+0000","last_peered":"2024-08-17T02:23:31.979877+0000","last_clean":"2024-08-17T02:23:31.979877+0000","last_became_active":"2024-08-17T02:23:30.965304+0000","last_became_peered":"2024-08-17T02:23:30.965304+0000","last_unstale":"2024-08-17T02:23:31.979877+0000","last_undegraded":"2024-08-17T02:23:31.979877+0000","last_fullsized":"2024-08-17T02:23:31.979877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:01.947289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.982558+0000","last_change":"2024-08-17T02:23:31.981260+0000","last_active":"2024-08-17T02:23:31.982558+0000","last_peered":"2024-08-17T02:23:31.982558+0000","last_clean":"2024-08-17T02:23:31.982558+0000","last_became_active":"2024-08-17T02:23:31.980747+0000","last_became_peered":"2024-08-17T02:23:31.980747+0000","last_unstale":"2024-08-17T02:23:31.982558+0000","last_undegraded":"2024-08-17T02:23:31.982558+0000","last_fullsized":"2024-08-17T02:23:31.982558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:30.415547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.984093+0000","last_change":"2024-08-17T02:23:30.968562+0000","last_active":"2024-08-17T02:23:31.984093+0000","last_peered":"2024-08-17T02:23:31.984093+0000","last_clean":"2024-08-17T02:23:31.984093+0000","last_became_active":"2024-08-17T02:23:30.968264+0000","last_became_peered":"2024-08-17T02:23:30.968264+0000","last_unstale":"2024-08-17T02:23:31.984093+0000","last_undegraded":"2024-08-17T02:23:31.984093+0000","last_fullsized":"2024-08-17T02:23:31.984093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:48:44.495463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.974695+0000","last_change":"2024-08-17T02:23:31.972997+0000","last_active":"2024-08-17T02:23:31.974695+0000","last_peered":"2024-08-17T02:23:31.974695+0000","last_clean":"2024-08-17T02:23:31.974695+0000","last_became_active":"2024-08-17T02:23:31.972782+0000","last_became_peered":"2024-08-17T02:23:31.972782+0000","last_unstale":"2024-08-17T02:23:31.974695+0000","last_undegraded":"2024-08-17T02:23:31.974695+0000","last_fullsized":"2024-08-17T02:23:31.974695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:50:55.354947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985261+0000","last_change":"2024-08-17T02:23:30.973992+0000","last_active":"2024-08-17T02:23:31.985261+0000","last_peered":"2024-08-17T02:23:31.985261+0000","last_clean":"2024-08-17T02:23:31.985261+0000","last_became_active":"2024-08-17T02:23:30.973677+0000","last_became_peered":"2024-08-17T02:23:30.973677+0000","last_unstale":"2024-08-17T02:23:31.985261+0000","last_undegraded":"2024-08-17T02:23:31.985261+0000","last_fullsized":"2024-08-17T02:23:31.985261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:28.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.976099+0000","last_change":"2024-08-17T02:23:31.973617+0000","last_active":"2024-08-17T02:23:31.976099+0000","last_peered":"2024-08-17T02:23:31.976099+0000","last_clean":"2024-08-17T02:23:31.976099+0000","last_became_active":"2024-08-17T02:23:31.973290+0000","last_became_peered":"2024-08-17T02:23:31.973290+0000","last_unstale":"2024-08-17T02:23:31.976099+0000","last_undegraded":"2024-08-17T02:23:31.976099+0000","last_fullsized":"2024-08-17T02:23:31.976099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:06.432367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.977182+0000","last_change":"2024-08-17T02:23:30.968994+0000","last_active":"2024-08-17T02:23:31.977182+0000","last_peered":"2024-08-17T02:23:31.977182+0000","last_clean":"2024-08-17T02:23:31.977182+0000","last_became_active":"2024-08-17T02:23:30.968655+0000","last_became_peered":"2024-08-17T02:23:30.968655+0000","last_unstale":"2024-08-17T02:23:31.977182+0000","last_undegraded":"2024-08-17T02:23:31.977182+0000","last_fullsized":"2024-08-17T02:23:31.977182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:20.670802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.986832+0000","last_change":"2024-08-17T02:23:31.968122+0000","last_active":"2024-08-17T02:23:31.986832+0000","last_peered":"2024-08-17T02:23:31.986832+0000","last_clean":"2024-08-17T02:23:31.986832+0000","last_became_active":"2024-08-17T02:23:31.967900+0000","last_became_peered":"2024-08-17T02:23:31.967900+0000","last_unstale":"2024-08-17T02:23:31.986832+0000","last_undegraded":"2024-08-17T02:23:31.986832+0000","last_fullsized":"2024-08-17T02:23:31.986832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:51.027128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.950822+0000","last_change":"2024-08-17T02:23:30.958979+0000","last_active":"2024-08-17T02:23:31.950822+0000","last_peered":"2024-08-17T02:23:31.950822+0000","last_clean":"2024-08-17T02:23:31.950822+0000","last_became_active":"2024-08-17T02:23:30.958685+0000","last_became_peered":"2024-08-17T02:23:30.958685+0000","last_unstale":"2024-08-17T02:23:31.950822+0000","last_undegraded":"2024-08-17T02:23:31.950822+0000","last_fullsized":"2024-08-17T02:23:31.950822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:20.670802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985565+0000","last_change":"2024-08-17T02:23:31.983473+0000","last_active":"2024-08-17T02:23:31.985565+0000","last_peered":"2024-08-17T02:23:31.985565+0000","last_clean":"2024-08-17T02:23:31.985565+0000","last_became_active":"2024-08-17T02:23:31.983267+0000","last_became_peered":"2024-08-17T02:23:31.983267+0000","last_unstale":"2024-08-17T02:23:31.985565+0000","last_undegraded":"2024-08-17T02:23:31.985565+0000","last_fullsized":"2024-08-17T02:23:31.985565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:43.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.949384+0000","last_change":"2024-08-17T02:23:27.953699+0000","last_active":"2024-08-17T02:23:31.949384+0000","last_peered":"2024-08-17T02:23:31.949384+0000","last_clean":"2024-08-17T02:23:31.949384+0000","last_became_active":"2024-08-17T02:23:27.952879+0000","last_became_peered":"2024-08-17T02:23:27.952879+0000","last_unstale":"2024-08-17T02:23:31.949384+0000","last_undegraded":"2024-08-17T02:23:31.949384+0000","last_fullsized":"2024-08-17T02:23:31.949384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:26.811202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:26.811202+0000","last_clean_scrub_stamp":"2024-08-17T02:23:26.811202+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:48.565059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.946954+0000","last_change":"2024-08-17T02:23:30.951704+0000","last_active":"2024-08-17T02:23:31.946954+0000","last_peered":"2024-08-17T02:23:31.946954+0000","last_clean":"2024-08-17T02:23:31.946954+0000","last_became_active":"2024-08-17T02:23:30.951462+0000","last_became_peered":"2024-08-17T02:23:30.951462+0000","last_unstale":"2024-08-17T02:23:31.946954+0000","last_undegraded":"2024-08-17T02:23:31.946954+0000","last_fullsized":"2024-08-17T02:23:31.946954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:01.947289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985590+0000","last_change":"2024-08-17T02:23:31.982162+0000","last_active":"2024-08-17T02:23:31.985590+0000","last_peered":"2024-08-17T02:23:31.985590+0000","last_clean":"2024-08-17T02:23:31.985590+0000","last_became_active":"2024-08-17T02:23:31.981826+0000","last_became_peered":"2024-08-17T02:23:31.981826+0000","last_unstale":"2024-08-17T02:23:31.985590+0000","last_undegraded":"2024-08-17T02:23:31.985590+0000","last_fullsized":"2024-08-17T02:23:31.985590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:07:31.568338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.949295+0000","last_change":"2024-08-17T02:23:30.960984+0000","last_active":"2024-08-17T02:23:31.949295+0000","last_peered":"2024-08-17T02:23:31.949295+0000","last_clean":"2024-08-17T02:23:31.949295+0000","last_became_active":"2024-08-17T02:23:30.960649+0000","last_became_peered":"2024-08-17T02:23:30.960649+0000","last_unstale":"2024-08-17T02:23:31.949295+0000","last_undegraded":"2024-08-17T02:23:31.949295+0000","last_fullsized":"2024-08-17T02:23:31.949295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:55:03.969746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983295+0000","last_change":"2024-08-17T02:23:31.980993+0000","last_active":"2024-08-17T02:23:31.983295+0000","last_peered":"2024-08-17T02:23:31.983295+0000","last_clean":"2024-08-17T02:23:31.983295+0000","last_became_active":"2024-08-17T02:23:31.980759+0000","last_became_peered":"2024-08-17T02:23:31.980759+0000","last_unstale":"2024-08-17T02:23:31.983295+0000","last_undegraded":"2024-08-17T02:23:31.983295+0000","last_fullsized":"2024-08-17T02:23:31.983295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:55.653301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.950251+0000","last_change":"2024-08-17T02:23:30.962851+0000","last_active":"2024-08-17T02:23:31.950251+0000","last_peered":"2024-08-17T02:23:31.950251+0000","last_clean":"2024-08-17T02:23:31.950251+0000","last_became_active":"2024-08-17T02:23:30.962554+0000","last_became_peered":"2024-08-17T02:23:30.962554+0000","last_unstale":"2024-08-17T02:23:31.950251+0000","last_undegraded":"2024-08-17T02:23:31.950251+0000","last_fullsized":"2024-08-17T02:23:31.950251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:36:25.509573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.960964+0000","last_change":"2024-08-17T02:23:31.957810+0000","last_active":"2024-08-17T02:23:31.960964+0000","last_peered":"2024-08-17T02:23:31.960964+0000","last_clean":"2024-08-17T02:23:31.960964+0000","last_became_active":"2024-08-17T02:23:31.957542+0000","last_became_peered":"2024-08-17T02:23:31.957542+0000","last_unstale":"2024-08-17T02:23:31.960964+0000","last_undegraded":"2024-08-17T02:23:31.960964+0000","last_fullsized":"2024-08-17T02:23:31.960964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:55.653301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.948429+0000","last_change":"2024-08-17T02:23:30.964915+0000","last_active":"2024-08-17T02:23:31.948429+0000","last_peered":"2024-08-17T02:23:31.948429+0000","last_clean":"2024-08-17T02:23:31.948429+0000","last_became_active":"2024-08-17T02:23:30.964673+0000","last_became_peered":"2024-08-17T02:23:30.964673+0000","last_unstale":"2024-08-17T02:23:31.948429+0000","last_undegraded":"2024-08-17T02:23:31.948429+0000","last_fullsized":"2024-08-17T02:23:31.948429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:40.754285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.976470+0000","last_change":"2024-08-17T02:23:31.971758+0000","last_active":"2024-08-17T02:23:31.976470+0000","last_peered":"2024-08-17T02:23:31.976470+0000","last_clean":"2024-08-17T02:23:31.976470+0000","last_became_active":"2024-08-17T02:23:31.971467+0000","last_became_peered":"2024-08-17T02:23:31.971467+0000","last_unstale":"2024-08-17T02:23:31.976470+0000","last_undegraded":"2024-08-17T02:23:31.976470+0000","last_fullsized":"2024-08-17T02:23:31.976470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:36.029248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.945915+0000","last_change":"2024-08-17T02:23:30.959168+0000","last_active":"2024-08-17T02:23:31.945915+0000","last_peered":"2024-08-17T02:23:31.945915+0000","last_clean":"2024-08-17T02:23:31.945915+0000","last_became_active":"2024-08-17T02:23:30.958720+0000","last_became_peered":"2024-08-17T02:23:30.958720+0000","last_unstale":"2024-08-17T02:23:31.945915+0000","last_undegraded":"2024-08-17T02:23:31.945915+0000","last_fullsized":"2024-08-17T02:23:31.945915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:35.026473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983315+0000","last_change":"2024-08-17T02:23:31.964694+0000","last_active":"2024-08-17T02:23:31.983315+0000","last_peered":"2024-08-17T02:23:31.983315+0000","last_clean":"2024-08-17T02:23:31.983315+0000","last_became_active":"2024-08-17T02:23:31.963180+0000","last_became_peered":"2024-08-17T02:23:31.963180+0000","last_unstale":"2024-08-17T02:23:31.983315+0000","last_undegraded":"2024-08-17T02:23:31.983315+0000","last_fullsized":"2024-08-17T02:23:31.983315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:39.645299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.949003+0000","last_change":"2024-08-17T02:23:30.961092+0000","last_active":"2024-08-17T02:23:31.949003+0000","last_peered":"2024-08-17T02:23:31.949003+0000","last_clean":"2024-08-17T02:23:31.949003+0000","last_became_active":"2024-08-17T02:23:30.960812+0000","last_became_peered":"2024-08-17T02:23:30.960812+0000","last_unstale":"2024-08-17T02:23:31.949003+0000","last_undegraded":"2024-08-17T02:23:31.949003+0000","last_fullsized":"2024-08-17T02:23:31.949003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:40.754285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.966415+0000","last_change":"2024-08-17T02:23:31.961035+0000","last_active":"2024-08-17T02:23:31.966415+0000","last_peered":"2024-08-17T02:23:31.966415+0000","last_clean":"2024-08-17T02:23:31.966415+0000","last_became_active":"2024-08-17T02:23:31.960738+0000","last_became_peered":"2024-08-17T02:23:31.960738+0000","last_unstale":"2024-08-17T02:23:31.966415+0000","last_undegraded":"2024-08-17T02:23:31.966415+0000","last_fullsized":"2024-08-17T02:23:31.966415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:27:58.201709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:33.089612+0000","last_change":"2024-08-17T02:23:30.962881+0000","last_active":"2024-08-17T02:23:33.089612+0000","last_peered":"2024-08-17T02:23:33.089612+0000","last_clean":"2024-08-17T02:23:33.089612+0000","last_became_active":"2024-08-17T02:23:30.962620+0000","last_became_peered":"2024-08-17T02:23:30.962620+0000","last_unstale":"2024-08-17T02:23:33.089612+0000","last_undegraded":"2024-08-17T02:23:33.089612+0000","last_fullsized":"2024-08-17T02:23:33.089612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:55:03.969746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.982546+0000","last_change":"2024-08-17T02:23:31.962220+0000","last_active":"2024-08-17T02:23:31.982546+0000","last_peered":"2024-08-17T02:23:31.982546+0000","last_clean":"2024-08-17T02:23:31.982546+0000","last_became_active":"2024-08-17T02:23:31.961166+0000","last_became_peered":"2024-08-17T02:23:31.961166+0000","last_unstale":"2024-08-17T02:23:31.982546+0000","last_undegraded":"2024-08-17T02:23:31.982546+0000","last_fullsized":"2024-08-17T02:23:31.982546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:43.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.976607+0000","last_change":"2024-08-17T02:23:30.966054+0000","last_active":"2024-08-17T02:23:31.976607+0000","last_peered":"2024-08-17T02:23:31.976607+0000","last_clean":"2024-08-17T02:23:31.976607+0000","last_became_active":"2024-08-17T02:23:30.965784+0000","last_became_peered":"2024-08-17T02:23:30.965784+0000","last_unstale":"2024-08-17T02:23:31.976607+0000","last_undegraded":"2024-08-17T02:23:31.976607+0000","last_fullsized":"2024-08-17T02:23:31.976607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:01.947289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.976523+0000","last_change":"2024-08-17T02:23:31.965797+0000","last_active":"2024-08-17T02:23:31.976523+0000","last_peered":"2024-08-17T02:23:31.976523+0000","last_clean":"2024-08-17T02:23:31.976523+0000","last_became_active":"2024-08-17T02:23:31.965545+0000","last_became_peered":"2024-08-17T02:23:31.965545+0000","last_unstale":"2024-08-17T02:23:31.976523+0000","last_undegraded":"2024-08-17T02:23:31.976523+0000","last_fullsized":"2024-08-17T02:23:31.976523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:45:56.326425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.949197+0000","last_change":"2024-08-17T02:23:30.965869+0000","last_active":"2024-08-17T02:23:31.949197+0000","last_peered":"2024-08-17T02:23:31.949197+0000","last_clean":"2024-08-17T02:23:31.949197+0000","last_became_active":"2024-08-17T02:23:30.965608+0000","last_became_peered":"2024-08-17T02:23:30.965608+0000","last_unstale":"2024-08-17T02:23:31.949197+0000","last_undegraded":"2024-08-17T02:23:31.949197+0000","last_fullsized":"2024-08-17T02:23:31.949197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:35.026473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983948+0000","last_change":"2024-08-17T02:23:31.978413+0000","last_active":"2024-08-17T02:23:31.983948+0000","last_peered":"2024-08-17T02:23:31.983948+0000","last_clean":"2024-08-17T02:23:31.983948+0000","last_became_active":"2024-08-17T02:23:31.978007+0000","last_became_peered":"2024-08-17T02:23:31.978007+0000","last_unstale":"2024-08-17T02:23:31.983948+0000","last_undegraded":"2024-08-17T02:23:31.983948+0000","last_fullsized":"2024-08-17T02:23:31.983948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:41.757059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.945306+0000","last_change":"2024-08-17T02:23:30.964876+0000","last_active":"2024-08-17T02:23:31.945306+0000","last_peered":"2024-08-17T02:23:31.945306+0000","last_clean":"2024-08-17T02:23:31.945306+0000","last_became_active":"2024-08-17T02:23:30.964624+0000","last_became_peered":"2024-08-17T02:23:30.964624+0000","last_unstale":"2024-08-17T02:23:31.945306+0000","last_undegraded":"2024-08-17T02:23:31.945306+0000","last_fullsized":"2024-08-17T02:23:31.945306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:28.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.982454+0000","last_change":"2024-08-17T02:23:31.962150+0000","last_active":"2024-08-17T02:23:31.982454+0000","last_peered":"2024-08-17T02:23:31.982454+0000","last_clean":"2024-08-17T02:23:31.982454+0000","last_became_active":"2024-08-17T02:23:31.961854+0000","last_became_peered":"2024-08-17T02:23:31.961854+0000","last_unstale":"2024-08-17T02:23:31.982454+0000","last_undegraded":"2024-08-17T02:23:31.982454+0000","last_fullsized":"2024-08-17T02:23:31.982454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:03:52.570659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.945619+0000","last_change":"2024-08-17T02:23:30.973512+0000","last_active":"2024-08-17T02:23:31.945619+0000","last_peered":"2024-08-17T02:23:31.945619+0000","last_clean":"2024-08-17T02:23:31.945619+0000","last_became_active":"2024-08-17T02:23:30.973240+0000","last_became_peered":"2024-08-17T02:23:30.973240+0000","last_unstale":"2024-08-17T02:23:31.945619+0000","last_undegraded":"2024-08-17T02:23:31.945619+0000","last_fullsized":"2024-08-17T02:23:31.945619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:01.947289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.985519+0000","last_change":"2024-08-17T02:23:31.978338+0000","last_active":"2024-08-17T02:23:31.985519+0000","last_peered":"2024-08-17T02:23:31.985519+0000","last_clean":"2024-08-17T02:23:31.985519+0000","last_became_active":"2024-08-17T02:23:31.978044+0000","last_became_peered":"2024-08-17T02:23:31.978044+0000","last_unstale":"2024-08-17T02:23:31.985519+0000","last_undegraded":"2024-08-17T02:23:31.985519+0000","last_fullsized":"2024-08-17T02:23:31.985519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:10.516503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.973244+0000","last_change":"2024-08-17T02:23:30.965867+0000","last_active":"2024-08-17T02:23:31.973244+0000","last_peered":"2024-08-17T02:23:31.973244+0000","last_clean":"2024-08-17T02:23:31.973244+0000","last_became_active":"2024-08-17T02:23:30.965564+0000","last_became_peered":"2024-08-17T02:23:30.965564+0000","last_unstale":"2024-08-17T02:23:31.973244+0000","last_undegraded":"2024-08-17T02:23:31.973244+0000","last_fullsized":"2024-08-17T02:23:31.973244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:01.182394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983652+0000","last_change":"2024-08-17T02:23:31.982027+0000","last_active":"2024-08-17T02:23:31.983652+0000","last_peered":"2024-08-17T02:23:31.983652+0000","last_clean":"2024-08-17T02:23:31.983652+0000","last_became_active":"2024-08-17T02:23:31.981722+0000","last_became_peered":"2024-08-17T02:23:31.981722+0000","last_unstale":"2024-08-17T02:23:31.983652+0000","last_undegraded":"2024-08-17T02:23:31.983652+0000","last_fullsized":"2024-08-17T02:23:31.983652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:55.653301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.986694+0000","last_change":"2024-08-17T02:23:31.978093+0000","last_active":"2024-08-17T02:23:31.986694+0000","last_peered":"2024-08-17T02:23:31.986694+0000","last_clean":"2024-08-17T02:23:31.986694+0000","last_became_active":"2024-08-17T02:23:31.977706+0000","last_became_peered":"2024-08-17T02:23:31.977706+0000","last_unstale":"2024-08-17T02:23:31.986694+0000","last_undegraded":"2024-08-17T02:23:31.986694+0000","last_fullsized":"2024-08-17T02:23:31.986694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:43.505864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.987152+0000","last_change":"2024-08-17T02:23:30.957349+0000","last_active":"2024-08-17T02:23:31.987152+0000","last_peered":"2024-08-17T02:23:31.987152+0000","last_clean":"2024-08-17T02:23:31.987152+0000","last_became_active":"2024-08-17T02:23:30.957063+0000","last_became_peered":"2024-08-17T02:23:30.957063+0000","last_unstale":"2024-08-17T02:23:31.987152+0000","last_undegraded":"2024-08-17T02:23:31.987152+0000","last_fullsized":"2024-08-17T02:23:31.987152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:01.947289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.986866+0000","last_change":"2024-08-17T02:23:31.974984+0000","last_active":"2024-08-17T02:23:31.986866+0000","last_peered":"2024-08-17T02:23:31.986866+0000","last_clean":"2024-08-17T02:23:31.986866+0000","last_became_active":"2024-08-17T02:23:31.974774+0000","last_became_peered":"2024-08-17T02:23:31.974774+0000","last_unstale":"2024-08-17T02:23:31.986866+0000","last_undegraded":"2024-08-17T02:23:31.986866+0000","last_fullsized":"2024-08-17T02:23:31.986866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:38.802352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.974239+0000","last_change":"2024-08-17T02:23:30.965411+0000","last_active":"2024-08-17T02:23:31.974239+0000","last_peered":"2024-08-17T02:23:31.974239+0000","last_clean":"2024-08-17T02:23:31.974239+0000","last_became_active":"2024-08-17T02:23:30.962792+0000","last_became_peered":"2024-08-17T02:23:30.962792+0000","last_unstale":"2024-08-17T02:23:31.974239+0000","last_undegraded":"2024-08-17T02:23:31.974239+0000","last_fullsized":"2024-08-17T02:23:31.974239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:56.544091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983073+0000","last_change":"2024-08-17T02:23:31.980658+0000","last_active":"2024-08-17T02:23:31.983073+0000","last_peered":"2024-08-17T02:23:31.983073+0000","last_clean":"2024-08-17T02:23:31.983073+0000","last_became_active":"2024-08-17T02:23:31.980238+0000","last_became_peered":"2024-08-17T02:23:31.980238+0000","last_unstale":"2024-08-17T02:23:31.983073+0000","last_undegraded":"2024-08-17T02:23:31.983073+0000","last_fullsized":"2024-08-17T02:23:31.983073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:37.211325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983596+0000","last_change":"2024-08-17T02:23:30.972133+0000","last_active":"2024-08-17T02:23:31.983596+0000","last_peered":"2024-08-17T02:23:31.983596+0000","last_clean":"2024-08-17T02:23:31.983596+0000","last_became_active":"2024-08-17T02:23:30.971784+0000","last_became_peered":"2024-08-17T02:23:30.971784+0000","last_unstale":"2024-08-17T02:23:31.983596+0000","last_undegraded":"2024-08-17T02:23:31.983596+0000","last_fullsized":"2024-08-17T02:23:31.983596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:20.670802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.983566+0000","last_change":"2024-08-17T02:23:31.965808+0000","last_active":"2024-08-17T02:23:31.983566+0000","last_peered":"2024-08-17T02:23:31.983566+0000","last_clean":"2024-08-17T02:23:31.983566+0000","last_became_active":"2024-08-17T02:23:31.965581+0000","last_became_peered":"2024-08-17T02:23:31.965581+0000","last_unstale":"2024-08-17T02:23:31.983566+0000","last_undegraded":"2024-08-17T02:23:31.983566+0000","last_fullsized":"2024-08-17T02:23:31.983566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:30.931424+0000","last_clean_scrub_stamp":"2024-08-17T02:23:30.931424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:58.965182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:23:31.982943+0000","last_change":"2024-08-17T02:23:30.962575+0000","last_active":"2024-08-17T02:23:31.982943+0000","last_peered":"2024-08-17T02:23:31.982943+0000","last_clean":"2024-08-17T02:23:31.982943+0000","last_became_active":"2024-08-17T02:23:30.962277+0000","last_became_peered":"2024-08-17T02:23:30.962277+0000","last_unstale":"2024-08-17T02:23:31.982943+0000","last_undegraded":"2024-08-17T02:23:31.982943+0000","last_fullsized":"2024-08-17T02:23:31.982943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.928649+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.928649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:24:02.271519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":815104,"data_stored":666251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.528}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301732,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070108,"statfs":{"total":96636764160,"available":96327790592,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.738}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1440000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3170000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.891}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6850000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.931}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0150000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301740,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070100,"statfs":{"total":96636764160,"available":96327782400,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302320,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069520,"statfs":{"total":96636764160,"available":96327188480,"internally_reserved":0,"allocated":823296,"data_stored":666307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:23:43.411 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:23:43.411 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-17T02:23:43.411 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-17T02:23:43.412 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-17T02:23:43.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.597+0000 7ff8dc400640 1 Processor -- start 2024-08-17T02:23:43.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.597+0000 7ff8dc400640 1 -- start start 2024-08-17T02:23:43.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.598+0000 7ff8dc400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8d40acf10 0x7ff8d40b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.598+0000 7ff8dc400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d40c92b0 con 0x7ff8d40afca0 2024-08-17T02:23:43.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.598+0000 7ff8dc400640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d40ad480 con 0x7ff8d41590b0 2024-08-17T02:23:43.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.598+0000 7ff8dc400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d40b0980 con 0x7ff8d40acf10 2024-08-17T02:23:43.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.599+0000 7ff8d9a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff8d40afca0 0x7ff8d41589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36220/0 (socket says 172.21.15.2:36220) 2024-08-17T02:23:43.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.599+0000 7ff8d9a00640 1 -- 172.21.15.2:0/332977615 learned_addr learned my addr 172.21.15.2:0/332977615 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:43.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.599+0000 7ff8d3e00640 1 -- 172.21.15.2:0/332977615 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2184683046 0 0) 0x7ff8d40c92b0 con 0x7ff8d40afca0 2024-08-17T02:23:43.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.599+0000 7ff8da400640 1 --2- 172.21.15.2:0/332977615 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8d40acf10 0x7ff8d40b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.599+0000 7ff8d3e00640 1 -- 172.21.15.2:0/332977615 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8bc0034e0 con 0x7ff8d40afca0 2024-08-17T02:23:43.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.599+0000 7ff8d3e00640 1 -- 172.21.15.2:0/332977615 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1005262606 0 0) 0x7ff8bc0034e0 con 0x7ff8d40afca0 2024-08-17T02:23:43.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.599+0000 7ff8d3e00640 1 -- 172.21.15.2:0/332977615 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8d40acf10 msgr2=0x7ff8d40b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:43.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.599+0000 7ff8d3e00640 1 --2- 172.21.15.2:0/332977615 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8d40acf10 0x7ff8d40b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.599+0000 7ff8d3e00640 1 -- 172.21.15.2:0/332977615 >> v1:172.21.15.145:6789/0 conn(0x7ff8d41590b0 legacy=0x7ff8d40c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.599+0000 7ff8d3e00640 1 -- 172.21.15.2:0/332977615 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d40ad760 con 0x7ff8d40afca0 2024-08-17T02:23:43.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.600+0000 7ff8d3e00640 1 -- 172.21.15.2:0/332977615 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7ff8c8001470 con 0x7ff8d40afca0 2024-08-17T02:23:43.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.600+0000 7ff8d3e00640 1 -- 172.21.15.2:0/332977615 >> v1:172.21.15.2:6789/0 conn(0x7ff8d40afca0 legacy=0x7ff8d41589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.600+0000 7ff8d3e00640 1 --2- 172.21.15.2:0/332977615 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff8bc003a00 0x7ff8bc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.600+0000 7ff8d3e00640 1 --2- 172.21.15.2:0/332977615 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8d40acf10 0x7ff8bc004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.600+0000 7ff8d3e00640 1 --2- 172.21.15.2:0/332977615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc004cc0 0x7ff8bc005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.600+0000 7ff8d3e00640 1 -- 172.21.15.2:0/332977615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc00ba80 con 0x7ff8bc004cc0 2024-08-17T02:23:43.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.600+0000 7ff8d3e00640 1 -- 172.21.15.2:0/332977615 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc00bbc0 con 0x7ff8bc003a00 2024-08-17T02:23:43.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.600+0000 7ff8d3e00640 1 -- 172.21.15.2:0/332977615 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc00bd80 con 0x7ff8d40acf10 2024-08-17T02:23:43.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.600+0000 7ff8da400640 1 --2- 172.21.15.2:0/332977615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc004cc0 0x7ff8bc005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.600+0000 7ff8d9000640 1 --2- 172.21.15.2:0/332977615 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8d40acf10 0x7ff8bc004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.600+0000 7ff8d9a00640 1 --2- 172.21.15.2:0/332977615 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff8bc003a00 0x7ff8bc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.600+0000 7ff8da400640 1 -- 172.21.15.2:0/332977615 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8d40acf10 msgr2=0x7ff8bc004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:43.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.600+0000 7ff8da400640 1 --2- 172.21.15.2:0/332977615 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8d40acf10 0x7ff8bc004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.600+0000 7ff8da400640 1 -- 172.21.15.2:0/332977615 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff8bc003a00 msgr2=0x7ff8bc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:43.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.600+0000 7ff8da400640 1 --2- 172.21.15.2:0/332977615 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff8bc003a00 0x7ff8bc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.600+0000 7ff8da400640 1 -- 172.21.15.2:0/332977615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc0034e0 con 0x7ff8bc004cc0 2024-08-17T02:23:43.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.601+0000 7ff8da400640 1 --2- 172.21.15.2:0/332977615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc004cc0 0x7ff8bc005130 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40ad3b0 tx=0x7ff8cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c8e8d01d39146a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:43.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.602+0000 7ff8d3e00640 1 -- 172.21.15.2:0/332977615 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc02d070 con 0x7ff8bc004cc0 2024-08-17T02:23:43.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.602+0000 7ff8d3e00640 1 -- 172.21.15.2:0/332977615 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8cc00f040 con 0x7ff8bc004cc0 2024-08-17T02:23:43.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.602+0000 7ff8d3e00640 1 -- 172.21.15.2:0/332977615 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc031640 con 0x7ff8bc004cc0 2024-08-17T02:23:43.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.602+0000 7ff8dc400640 1 -- 172.21.15.2:0/332977615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc004cc0 msgr2=0x7ff8bc005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.602+0000 7ff8dc400640 1 --2- 172.21.15.2:0/332977615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc004cc0 0x7ff8bc005130 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40ad3b0 tx=0x7ff8cc00b040 comp rx=0 tx=0).stop 2024-08-17T02:23:43.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.602+0000 7ff8da400640 1 -- 172.21.15.2:0/332977615 reap_dead start 2024-08-17T02:23:43.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.602+0000 7ff8dc400640 1 -- 172.21.15.2:0/332977615 shutdown_connections 2024-08-17T02:23:43.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.602+0000 7ff8dc400640 1 -- 172.21.15.2:0/332977615 >> 172.21.15.2:0/332977615 conn(0x7ff8d4066e60 msgr2=0x7ff8d4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:43.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.602+0000 7ff8dc400640 1 -- 172.21.15.2:0/332977615 shutdown_connections 2024-08-17T02:23:43.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.602+0000 7ff8dc400640 1 -- 172.21.15.2:0/332977615 wait complete. 2024-08-17T02:23:43.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.604+0000 7ff8dc400640 1 Processor -- start 2024-08-17T02:23:43.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.604+0000 7ff8dc400640 1 -- start start 2024-08-17T02:23:43.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.605+0000 7ff8dc400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc004cc0 0x7ff8d40c6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.605+0000 7ff8dc400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff8d4169080 0x7ff8d40c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.605+0000 7ff8dc400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8d4155040 0x7ff8d41554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.605+0000 7ff8dc400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d4155a20 con 0x7ff8bc004cc0 2024-08-17T02:23:43.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.605+0000 7ff8dc400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d40c77f0 con 0x7ff8d4169080 2024-08-17T02:23:43.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.605+0000 7ff8dc400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d4156780 con 0x7ff8d4155040 2024-08-17T02:23:43.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.605+0000 7ff8d9a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc004cc0 0x7ff8d40c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.605+0000 7ff8d9a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc004cc0 0x7ff8d40c6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54350/0 (socket says 172.21.15.2:54350) 2024-08-17T02:23:43.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.605+0000 7ff8d9a00640 1 -- 172.21.15.2:0/3194025926 learned_addr learned my addr 172.21.15.2:0/3194025926 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:43.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.605+0000 7ff8d9a00640 1 -- 172.21.15.2:0/3194025926 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8d4155040 msgr2=0x7ff8d41554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.605+0000 7ff8d9a00640 1 --2- 172.21.15.2:0/3194025926 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8d4155040 0x7ff8d41554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.605+0000 7ff8d9a00640 1 -- 172.21.15.2:0/3194025926 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff8d4169080 msgr2=0x7ff8d40c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.605+0000 7ff8d9a00640 1 --2- 172.21.15.2:0/3194025926 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff8d4169080 0x7ff8d40c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.605+0000 7ff8d9a00640 1 -- 172.21.15.2:0/3194025926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d41694f0 con 0x7ff8bc004cc0 2024-08-17T02:23:43.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.606+0000 7ff8d9a00640 1 --2- 172.21.15.2:0/3194025926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc004cc0 0x7ff8d40c6380 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8001c20 tx=0x7ff8d406b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:43.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.606+0000 7ff8d0c00640 1 -- 172.21.15.2:0/3194025926 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8018030 con 0x7ff8bc004cc0 2024-08-17T02:23:43.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.606+0000 7ff8d0c00640 1 -- 172.21.15.2:0/3194025926 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c800f960 con 0x7ff8bc004cc0 2024-08-17T02:23:43.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.606+0000 7ff8d0c00640 1 -- 172.21.15.2:0/3194025926 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8001470 con 0x7ff8bc004cc0 2024-08-17T02:23:43.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.606+0000 7ff8dc400640 1 -- 172.21.15.2:0/3194025926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d40c7a20 con 0x7ff8bc004cc0 2024-08-17T02:23:43.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.606+0000 7ff8dc400640 1 -- 172.21.15.2:0/3194025926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d4156cb0 con 0x7ff8bc004cc0 2024-08-17T02:23:43.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.607+0000 7ff8dc400640 1 -- 172.21.15.2:0/3194025926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d4063fb0 con 0x7ff8bc004cc0 2024-08-17T02:23:43.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.608+0000 7ff8d0c00640 1 -- 172.21.15.2:0/3194025926 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff8c801b070 con 0x7ff8bc004cc0 2024-08-17T02:23:43.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.608+0000 7ff8d0c00640 1 --2- 172.21.15.2:0/3194025926 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7ff8b4065180 0x7ff8b4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.609+0000 7ff8d0c00640 1 -- 172.21.15.2:0/3194025926 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff8c8019070 con 0x7ff8bc004cc0 2024-08-17T02:23:43.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.609+0000 7ff8d9000640 1 --2- 172.21.15.2:0/3194025926 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7ff8b4065180 0x7ff8b4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.610+0000 7ff8d9000640 1 --2- 172.21.15.2:0/3194025926 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7ff8b4065180 0x7ff8b4067630 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff8d406adb0 tx=0x7ff8c0007c80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:43.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.613+0000 7ff8d0c00640 1 -- 172.21.15.2:0/3194025926 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff8c80503d0 con 0x7ff8bc004cc0 2024-08-17T02:23:43.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.830+0000 7ff8dc400640 1 -- 172.21.15.2:0/3194025926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff8d4067b70 con 0x7ff8bc004cc0 2024-08-17T02:23:43.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.830+0000 7ff8d0c00640 1 -- 172.21.15.2:0/3194025926 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ff8c80539f0 con 0x7ff8bc004cc0 2024-08-17T02:23:43.831 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:43.832 INFO:teuthology.orchestra.run.smithi002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-17T02:23:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.832+0000 7ff8dc400640 1 -- 172.21.15.2:0/3194025926 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7ff8b4065180 msgr2=0x7ff8b4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.832+0000 7ff8dc400640 1 --2- 172.21.15.2:0/3194025926 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7ff8b4065180 0x7ff8b4067630 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff8d406adb0 tx=0x7ff8c0007c80 comp rx=0 tx=0).stop 2024-08-17T02:23:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.832+0000 7ff8dc400640 1 -- 172.21.15.2:0/3194025926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc004cc0 msgr2=0x7ff8d40c6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.832+0000 7ff8dc400640 1 --2- 172.21.15.2:0/3194025926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc004cc0 0x7ff8d40c6380 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8001c20 tx=0x7ff8d406b930 comp rx=0 tx=0).stop 2024-08-17T02:23:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.832+0000 7ff8dc400640 1 -- 172.21.15.2:0/3194025926 shutdown_connections 2024-08-17T02:23:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.832+0000 7ff8dc400640 1 --2- 172.21.15.2:0/3194025926 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7ff8b4065180 0x7ff8b4067630 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.832+0000 7ff8dc400640 1 --2- 172.21.15.2:0/3194025926 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8d4155040 0x7ff8d41554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.832+0000 7ff8dc400640 1 --2- 172.21.15.2:0/3194025926 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff8d4169080 0x7ff8d40c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.832+0000 7ff8dc400640 1 --2- 172.21.15.2:0/3194025926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8bc004cc0 0x7ff8d40c6380 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.832+0000 7ff8dc400640 1 -- 172.21.15.2:0/3194025926 >> 172.21.15.2:0/3194025926 conn(0x7ff8d4066e60 msgr2=0x7ff8d414ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.832+0000 7ff8dc400640 1 -- 172.21.15.2:0/3194025926 shutdown_connections 2024-08-17T02:23:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.832+0000 7ff8dc400640 1 -- 172.21.15.2:0/3194025926 wait complete. 2024-08-17T02:23:43.848 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-17T02:23:43.849 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.998+0000 7f14d7000640 1 Processor -- start 2024-08-17T02:23:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:43.998+0000 7f14d7000640 1 -- start start 2024-08-17T02:23:44.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.000+0000 7f14d7000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14d00ad960 0x7f14d015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.000+0000 7f14d7000640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f14d00add30 0x7f14d0156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.000+0000 7f14d7000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d015b5e0 con 0x7f14d00ca050 2024-08-17T02:23:44.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.000+0000 7f14d7000640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d00cb160 con 0x7f14d00add30 2024-08-17T02:23:44.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.000+0000 7f14d7000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d00b0d10 con 0x7f14d00ad960 2024-08-17T02:23:44.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.000+0000 7f14cf400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f14d00ca050 0x7f14d0156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36224/0 (socket says 172.21.15.2:36224) 2024-08-17T02:23:44.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.000+0000 7f14cf400640 1 -- 172.21.15.2:0/1791755520 learned_addr learned my addr 172.21.15.2:0/1791755520 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:44.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.000+0000 7f14d5000640 1 --2- 172.21.15.2:0/1791755520 >> v2:172.21.15.145:3300/0 conn(0x7f14d00add30 0x7f14d0156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.000+0000 7f14cfe00640 1 --2- 172.21.15.2:0/1791755520 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14d00ad960 0x7f14d015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.000+0000 7f14cea00640 1 -- 172.21.15.2:0/1791755520 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 559094065 0 0) 0x7f14bc001110 con 0x7f14d00ca050 2024-08-17T02:23:44.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.000+0000 7f14cea00640 1 -- 172.21.15.2:0/1791755520 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14b40034e0 con 0x7f14d00ca050 2024-08-17T02:23:44.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.001+0000 7f14d5000640 1 -- 172.21.15.2:0/1791755520 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14d00ad960 msgr2=0x7f14d015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:44.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.001+0000 7f14d5000640 1 --2- 172.21.15.2:0/1791755520 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14d00ad960 0x7f14d015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.001+0000 7f14d5000640 1 -- 172.21.15.2:0/1791755520 >> v1:172.21.15.2:6789/0 conn(0x7f14d00ca050 legacy=0x7f14d0156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.001+0000 7f14cea00640 1 -- 172.21.15.2:0/1791755520 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1897742513 0 0) 0x7f14b40034e0 con 0x7f14d00ca050 2024-08-17T02:23:44.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.001+0000 7f14d5000640 1 -- 172.21.15.2:0/1791755520 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d00ca550 con 0x7f14d00add30 2024-08-17T02:23:44.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.002+0000 7f14d5000640 1 --2- 172.21.15.2:0/1791755520 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14d00add30 0x7f14d0156b30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f14c8009e60 tx=0x7f14c8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d517c7944404197f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.002+0000 7f14cea00640 1 -- 172.21.15.2:0/1791755520 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc001600 con 0x7f14d00add30 2024-08-17T02:23:44.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.002+0000 7f14cea00640 1 -- 172.21.15.2:0/1791755520 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c802d050 con 0x7f14d00add30 2024-08-17T02:23:44.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.002+0000 7f14cea00640 1 -- 172.21.15.2:0/1791755520 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8031630 con 0x7f14d00add30 2024-08-17T02:23:44.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.003+0000 7f14d7000640 1 -- 172.21.15.2:0/1791755520 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14d00add30 msgr2=0x7f14d0156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.003+0000 7f14d7000640 1 --2- 172.21.15.2:0/1791755520 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14d00add30 0x7f14d0156b30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f14c8009e60 tx=0x7f14c8009780 comp rx=0 tx=0).stop 2024-08-17T02:23:44.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.003+0000 7f14d7000640 1 -- 172.21.15.2:0/1791755520 shutdown_connections 2024-08-17T02:23:44.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.003+0000 7f14d7000640 1 --2- 172.21.15.2:0/1791755520 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14d00add30 0x7f14d0156b30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.003+0000 7f14d7000640 1 --2- 172.21.15.2:0/1791755520 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14d00ad960 0x7f14d015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.003+0000 7f14d7000640 1 -- 172.21.15.2:0/1791755520 >> 172.21.15.2:0/1791755520 conn(0x7f14d0066e60 msgr2=0x7f14d0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:44.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.003+0000 7f14d7000640 1 -- 172.21.15.2:0/1791755520 shutdown_connections 2024-08-17T02:23:44.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.003+0000 7f14d7000640 1 -- 172.21.15.2:0/1791755520 wait complete. 2024-08-17T02:23:44.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.004+0000 7f14d7000640 1 Processor -- start 2024-08-17T02:23:44.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.004+0000 7f14d7000640 1 -- start start 2024-08-17T02:23:44.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.005+0000 7f14d7000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14d00ad960 0x7f14d00a9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.005+0000 7f14d7000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14d00add30 0x7f14d0149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.005+0000 7f14d7000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14d00ca050 0x7f14d006d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.005+0000 7f14d7000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d00aa510 con 0x7f14d00ca050 2024-08-17T02:23:44.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.005+0000 7f14d7000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d016c5a0 con 0x7f14d00add30 2024-08-17T02:23:44.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.005+0000 7f14d7000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d016c880 con 0x7f14d00ad960 2024-08-17T02:23:44.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.005+0000 7f14d5000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14d00ca050 0x7f14d006d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.006+0000 7f14d5000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14d00ca050 0x7f14d006d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54354/0 (socket says 172.21.15.2:54354) 2024-08-17T02:23:44.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.006+0000 7f14d5000640 1 -- 172.21.15.2:0/1016014592 learned_addr learned my addr 172.21.15.2:0/1016014592 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:44.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.006+0000 7f14cfe00640 1 --2- 172.21.15.2:0/1016014592 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14d00ad960 0x7f14d00a9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.006+0000 7f14cf400640 1 --2- 172.21.15.2:0/1016014592 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14d00add30 0x7f14d0149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.006+0000 7f14d5000640 1 -- 172.21.15.2:0/1016014592 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14d00ad960 msgr2=0x7f14d00a9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.006+0000 7f14d5000640 1 --2- 172.21.15.2:0/1016014592 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14d00ad960 0x7f14d00a9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.006+0000 7f14d5000640 1 -- 172.21.15.2:0/1016014592 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14d00add30 msgr2=0x7f14d0149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.006+0000 7f14d5000640 1 --2- 172.21.15.2:0/1016014592 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14d00add30 0x7f14d0149a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.006+0000 7f14d5000640 1 -- 172.21.15.2:0/1016014592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c8009a20 con 0x7f14d00ca050 2024-08-17T02:23:44.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.006+0000 7f14d5000640 1 --2- 172.21.15.2:0/1016014592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14d00ca050 0x7f14d006d7d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f14c80099f0 tx=0x7f14c8037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.006+0000 7f14c7400640 1 -- 172.21.15.2:0/1016014592 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c803ba70 con 0x7f14d00ca050 2024-08-17T02:23:44.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.006+0000 7f14c7400640 1 -- 172.21.15.2:0/1016014592 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c8040070 con 0x7f14d00ca050 2024-08-17T02:23:44.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.006+0000 7f14c7400640 1 -- 172.21.15.2:0/1016014592 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c803be60 con 0x7f14d00ca050 2024-08-17T02:23:44.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.007+0000 7f14d7000640 1 -- 172.21.15.2:0/1016014592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d016cb60 con 0x7f14d00ca050 2024-08-17T02:23:44.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.007+0000 7f14d7000640 1 -- 172.21.15.2:0/1016014592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d0149f80 con 0x7f14d00ca050 2024-08-17T02:23:44.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.008+0000 7f14d7000640 1 -- 172.21.15.2:0/1016014592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d016d060 con 0x7f14d00ca050 2024-08-17T02:23:44.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.008+0000 7f14c7400640 1 -- 172.21.15.2:0/1016014592 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f14c8046640 con 0x7f14d00ca050 2024-08-17T02:23:44.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.009+0000 7f14c7400640 1 --2- 172.21.15.2:0/1016014592 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f14b0065150 0x7f14b0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.009+0000 7f14c7400640 1 -- 172.21.15.2:0/1016014592 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f14c8042070 con 0x7f14d00ca050 2024-08-17T02:23:44.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.010+0000 7f14cfe00640 1 --2- 172.21.15.2:0/1016014592 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f14b0065150 0x7f14b0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.011+0000 7f14cfe00640 1 --2- 172.21.15.2:0/1016014592 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f14b0065150 0x7f14b0067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009cb0 tx=0x7f14c0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.013+0000 7f14c7400640 1 -- 172.21.15.2:0/1016014592 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f14c8071460 con 0x7f14d00ca050 2024-08-17T02:23:44.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.196+0000 7f14d7000640 1 -- 172.21.15.2:0/1016014592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14d0063fb0 con 0x7f14d00ca050 2024-08-17T02:23:44.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.197+0000 7f14c7400640 1 -- 172.21.15.2:0/1016014592 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f14c8074a80 con 0x7f14d00ca050 2024-08-17T02:23:44.198 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:44.198 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:23:32.955197+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:29.708835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:30.361908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:44.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.199+0000 7f14d7000640 1 -- 172.21.15.2:0/1016014592 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f14b0065150 msgr2=0x7f14b0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.199+0000 7f14d7000640 1 --2- 172.21.15.2:0/1016014592 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f14b0065150 0x7f14b0067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009cb0 tx=0x7f14c0008040 comp rx=0 tx=0).stop 2024-08-17T02:23:44.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.199+0000 7f14d7000640 1 -- 172.21.15.2:0/1016014592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14d00ca050 msgr2=0x7f14d006d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.199+0000 7f14d7000640 1 --2- 172.21.15.2:0/1016014592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14d00ca050 0x7f14d006d7d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f14c80099f0 tx=0x7f14c8037000 comp rx=0 tx=0).stop 2024-08-17T02:23:44.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.199+0000 7f14d7000640 1 -- 172.21.15.2:0/1016014592 shutdown_connections 2024-08-17T02:23:44.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.199+0000 7f14d7000640 1 --2- 172.21.15.2:0/1016014592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14d00ca050 0x7f14d006d7d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.199+0000 7f14d7000640 1 --2- 172.21.15.2:0/1016014592 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14d00add30 0x7f14d0149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.199+0000 7f14d7000640 1 --2- 172.21.15.2:0/1016014592 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f14b0065150 0x7f14b0067600 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.199+0000 7f14d7000640 1 --2- 172.21.15.2:0/1016014592 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14d00ad960 0x7f14d00a9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.199+0000 7f14d7000640 1 -- 172.21.15.2:0/1016014592 >> 172.21.15.2:0/1016014592 conn(0x7f14d0066e60 msgr2=0x7f14d00af5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:44.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.199+0000 7f14d7000640 1 -- 172.21.15.2:0/1016014592 shutdown_connections 2024-08-17T02:23:44.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.199+0000 7f14d7000640 1 -- 172.21.15.2:0/1016014592 wait complete. 2024-08-17T02:23:44.215 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:23:26.107978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:23:29.708835+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:23:30.361908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:23:44.215 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:23:44.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.368+0000 7fe885000640 1 Processor -- start 2024-08-17T02:23:44.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.369+0000 7fe885000640 1 -- start start 2024-08-17T02:23:44.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.370+0000 7fe885000640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe88006d900 0x7fe88006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.370+0000 7fe885000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe880159640 con 0x7fe8800ade50 2024-08-17T02:23:44.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.370+0000 7fe885000640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8800ae2d0 con 0x7fe8800ae6c0 2024-08-17T02:23:44.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.370+0000 7fe885000640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe880156e50 con 0x7fe88006d900 2024-08-17T02:23:44.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.370+0000 7fe877e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe8800ade50 0x7fe880155db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36234/0 (socket says 172.21.15.2:36234) 2024-08-17T02:23:44.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.370+0000 7fe877e00640 1 -- 172.21.15.2:0/3215199102 learned_addr learned my addr 172.21.15.2:0/3215199102 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.370+0000 7fe87f400640 1 --2- 172.21.15.2:0/3215199102 >> v2:172.21.15.145:3300/0 conn(0x7fe88006d900 0x7fe88006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.371+0000 7fe87ea00640 1 -- 172.21.15.2:0/3215199102 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 32749760 0 0) 0x7fe880159640 con 0x7fe8800ade50 2024-08-17T02:23:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.371+0000 7fe87ea00640 1 -- 172.21.15.2:0/3215199102 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8640034e0 con 0x7fe8800ade50 2024-08-17T02:23:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.371+0000 7fe87ea00640 1 -- 172.21.15.2:0/3215199102 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998656650 0 0) 0x7fe8800ae2d0 con 0x7fe8800ae6c0 2024-08-17T02:23:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.371+0000 7fe87ea00640 1 -- 172.21.15.2:0/3215199102 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe880159640 con 0x7fe8800ae6c0 2024-08-17T02:23:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.371+0000 7fe87ea00640 1 -- 172.21.15.2:0/3215199102 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3557204158 0 0) 0x7fe8640034e0 con 0x7fe8800ade50 2024-08-17T02:23:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.371+0000 7fe87ea00640 1 -- 172.21.15.2:0/3215199102 >> v2:172.21.15.145:3300/0 conn(0x7fe88006d900 msgr2=0x7fe88006dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.371+0000 7fe87ea00640 1 --2- 172.21.15.2:0/3215199102 >> v2:172.21.15.145:3300/0 conn(0x7fe88006d900 0x7fe88006dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.371+0000 7fe87ea00640 1 -- 172.21.15.2:0/3215199102 >> v1:172.21.15.145:6789/0 conn(0x7fe8800ae6c0 legacy=0x7fe880159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.371+0000 7fe87ea00640 1 -- 172.21.15.2:0/3215199102 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8801565b0 con 0x7fe8800ade50 2024-08-17T02:23:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.371+0000 7fe87ea00640 1 -- 172.21.15.2:0/3215199102 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7fe868001470 con 0x7fe8800ade50 2024-08-17T02:23:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.371+0000 7fe87ea00640 1 -- 172.21.15.2:0/3215199102 >> v1:172.21.15.2:6789/0 conn(0x7fe8800ade50 legacy=0x7fe880155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.371+0000 7fe87ea00640 1 --2- 172.21.15.2:0/3215199102 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe864003bd0 0x7fe864003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.371+0000 7fe87ea00640 1 --2- 172.21.15.2:0/3215199102 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe864004780 0x7fe864004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.371+0000 7fe87ea00640 1 --2- 172.21.15.2:0/3215199102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe864005180 0x7fe86400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.371+0000 7fe87ea00640 1 -- 172.21.15.2:0/3215199102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe880156e50 con 0x7fe864005180 2024-08-17T02:23:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.371+0000 7fe87ea00640 1 -- 172.21.15.2:0/3215199102 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86400e2b0 con 0x7fe864003bd0 2024-08-17T02:23:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.371+0000 7fe87ea00640 1 -- 172.21.15.2:0/3215199102 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe86400e470 con 0x7fe864004780 2024-08-17T02:23:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.371+0000 7fe87f400640 1 --2- 172.21.15.2:0/3215199102 >> v2:172.21.15.145:3300/0 conn(0x7fe88006d900 0x7fe88006dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.371+0000 7fe87fe00640 1 --2- 172.21.15.2:0/3215199102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe864005180 0x7fe86400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.371+0000 7fe877e00640 1 --2- 172.21.15.2:0/3215199102 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe864004780 0x7fe864004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.371+0000 7fe87f400640 1 --2- 172.21.15.2:0/3215199102 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe864003bd0 0x7fe864003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.372+0000 7fe87fe00640 1 -- 172.21.15.2:0/3215199102 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe864004780 msgr2=0x7fe864004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.372+0000 7fe87fe00640 1 --2- 172.21.15.2:0/3215199102 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe864004780 0x7fe864004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.372+0000 7fe87fe00640 1 -- 172.21.15.2:0/3215199102 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe864003bd0 msgr2=0x7fe864003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.372+0000 7fe87fe00640 1 --2- 172.21.15.2:0/3215199102 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe864003bd0 0x7fe864003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.372+0000 7fe87fe00640 1 -- 172.21.15.2:0/3215199102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8640034e0 con 0x7fe864005180 2024-08-17T02:23:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.373+0000 7fe87fe00640 1 -- 172.21.15.2:0/3215199102 reap_dead start 2024-08-17T02:23:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.373+0000 7fe87fe00640 1 --2- 172.21.15.2:0/3215199102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe864005180 0x7fe86400b9d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe878002080 tx=0x7fe878007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d567e17bdb1ee0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.373+0000 7fe87ea00640 1 -- 172.21.15.2:0/3215199102 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe878031440 con 0x7fe864005180 2024-08-17T02:23:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.373+0000 7fe87ea00640 1 -- 172.21.15.2:0/3215199102 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87802d050 con 0x7fe864005180 2024-08-17T02:23:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.373+0000 7fe87ea00640 1 -- 172.21.15.2:0/3215199102 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8780317d0 con 0x7fe864005180 2024-08-17T02:23:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.374+0000 7fe885000640 1 -- 172.21.15.2:0/3215199102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe864005180 msgr2=0x7fe86400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.374+0000 7fe885000640 1 --2- 172.21.15.2:0/3215199102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe864005180 0x7fe86400b9d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe878002080 tx=0x7fe878007f90 comp rx=0 tx=0).stop 2024-08-17T02:23:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.374+0000 7fe885000640 1 -- 172.21.15.2:0/3215199102 shutdown_connections 2024-08-17T02:23:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.374+0000 7fe885000640 1 --2- 172.21.15.2:0/3215199102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe864005180 0x7fe86400b9d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.374+0000 7fe885000640 1 -- 172.21.15.2:0/3215199102 >> 172.21.15.2:0/3215199102 conn(0x7fe8800cb770 msgr2=0x7fe8800cbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.374+0000 7fe885000640 1 -- 172.21.15.2:0/3215199102 shutdown_connections 2024-08-17T02:23:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.374+0000 7fe885000640 1 -- 172.21.15.2:0/3215199102 wait complete. 2024-08-17T02:23:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.375+0000 7fe885000640 1 Processor -- start 2024-08-17T02:23:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.375+0000 7fe885000640 1 -- start start 2024-08-17T02:23:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.376+0000 7fe885000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe864005180 0x7fe880164bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.376+0000 7fe885000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe880149120 0x7fe880154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.376+0000 7fe885000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe880149570 0x7fe880151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.376+0000 7fe885000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8801554d0 con 0x7fe880149570 2024-08-17T02:23:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.376+0000 7fe885000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8801551f0 con 0x7fe864005180 2024-08-17T02:23:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.376+0000 7fe885000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88014d0b0 con 0x7fe880149120 2024-08-17T02:23:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.376+0000 7fe87fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe880149570 0x7fe880151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.376+0000 7fe87fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe880149570 0x7fe880151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54378/0 (socket says 172.21.15.2:54378) 2024-08-17T02:23:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.376+0000 7fe87fe00640 1 -- 172.21.15.2:0/260007741 learned_addr learned my addr 172.21.15.2:0/260007741 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.376+0000 7fe87f400640 1 --2- 172.21.15.2:0/260007741 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe864005180 0x7fe880164bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.376+0000 7fe877e00640 1 --2- 172.21.15.2:0/260007741 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe880149120 0x7fe880154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.377+0000 7fe87f400640 1 -- 172.21.15.2:0/260007741 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe880149120 msgr2=0x7fe880154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.377+0000 7fe87f400640 1 --2- 172.21.15.2:0/260007741 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe880149120 0x7fe880154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.377+0000 7fe87f400640 1 -- 172.21.15.2:0/260007741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe880149570 msgr2=0x7fe880151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.377+0000 7fe87f400640 1 --2- 172.21.15.2:0/260007741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe880149570 0x7fe880151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.377+0000 7fe87f400640 1 -- 172.21.15.2:0/260007741 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88014d390 con 0x7fe864005180 2024-08-17T02:23:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.377+0000 7fe87f400640 1 --2- 172.21.15.2:0/260007741 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe864005180 0x7fe880164bb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe870011b20 tx=0x7fe8700090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.377+0000 7fe876a00640 1 -- 172.21.15.2:0/260007741 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87000fcc0 con 0x7fe864005180 2024-08-17T02:23:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.378+0000 7fe876a00640 1 -- 172.21.15.2:0/260007741 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87000fe20 con 0x7fe864005180 2024-08-17T02:23:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.378+0000 7fe876a00640 1 -- 172.21.15.2:0/260007741 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe870014690 con 0x7fe864005180 2024-08-17T02:23:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.378+0000 7fe885000640 1 -- 172.21.15.2:0/260007741 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe88014d670 con 0x7fe864005180 2024-08-17T02:23:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.378+0000 7fe885000640 1 -- 172.21.15.2:0/260007741 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe880154c60 con 0x7fe864005180 2024-08-17T02:23:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.379+0000 7fe885000640 1 -- 172.21.15.2:0/260007741 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe88014cf10 con 0x7fe864005180 2024-08-17T02:23:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.380+0000 7fe876a00640 1 -- 172.21.15.2:0/260007741 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe870014a40 con 0x7fe864005180 2024-08-17T02:23:44.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.380+0000 7fe876a00640 1 --2- 172.21.15.2:0/260007741 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe85c065180 0x7fe85c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.380+0000 7fe876a00640 1 -- 172.21.15.2:0/260007741 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe870018030 con 0x7fe864005180 2024-08-17T02:23:44.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.381+0000 7fe877e00640 1 --2- 172.21.15.2:0/260007741 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe85c065180 0x7fe85c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.381+0000 7fe877e00640 1 --2- 172.21.15.2:0/260007741 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe85c065180 0x7fe85c067630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe868001660 tx=0x7fe868001e10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.386+0000 7fe876a00640 1 -- 172.21.15.2:0/260007741 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe88014cf10 con 0x7fe864005180 2024-08-17T02:23:44.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.569+0000 7fe885000640 1 -- 172.21.15.2:0/260007741 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe88014cf10 con 0x7fe864005180 2024-08-17T02:23:44.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.570+0000 7fe876a00640 1 -- 172.21.15.2:0/260007741 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe88014cf10 con 0x7fe864005180 2024-08-17T02:23:44.571 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-17T02:23:44.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.572+0000 7fe885000640 1 -- 172.21.15.2:0/260007741 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe85c065180 msgr2=0x7fe85c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.572+0000 7fe885000640 1 --2- 172.21.15.2:0/260007741 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe85c065180 0x7fe85c067630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe868001660 tx=0x7fe868001e10 comp rx=0 tx=0).stop 2024-08-17T02:23:44.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.572+0000 7fe885000640 1 -- 172.21.15.2:0/260007741 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe864005180 msgr2=0x7fe880164bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.572+0000 7fe885000640 1 --2- 172.21.15.2:0/260007741 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe864005180 0x7fe880164bb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe870011b20 tx=0x7fe8700090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.572+0000 7fe885000640 1 -- 172.21.15.2:0/260007741 shutdown_connections 2024-08-17T02:23:44.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.572+0000 7fe885000640 1 --2- 172.21.15.2:0/260007741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe880149570 0x7fe880151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.572+0000 7fe885000640 1 --2- 172.21.15.2:0/260007741 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe85c065180 0x7fe85c067630 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.572+0000 7fe885000640 1 --2- 172.21.15.2:0/260007741 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe880149120 0x7fe880154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.572+0000 7fe885000640 1 --2- 172.21.15.2:0/260007741 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe864005180 0x7fe880164bb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.572+0000 7fe885000640 1 -- 172.21.15.2:0/260007741 >> 172.21.15.2:0/260007741 conn(0x7fe8800cb770 msgr2=0x7fe880069730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:44.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.572+0000 7fe885000640 1 -- 172.21.15.2:0/260007741 shutdown_connections 2024-08-17T02:23:44.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.572+0000 7fe885000640 1 -- 172.21.15.2:0/260007741 wait complete. 2024-08-17T02:23:44.588 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:23:44.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.741+0000 7fc036c00640 1 Processor -- start 2024-08-17T02:23:44.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.741+0000 7fc036c00640 1 -- start start 2024-08-17T02:23:44.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.742+0000 7fc036c00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc0300b1850 0x7fc0300b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.742+0000 7fc036c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc0300d0650 0x7fc0300ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.742+0000 7fc036c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc0301585a0 0x7fc030158a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.742+0000 7fc036c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0300ce9b0 con 0x7fc0301585a0 2024-08-17T02:23:44.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.742+0000 7fc036c00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0300cec90 con 0x7fc0300b1850 2024-08-17T02:23:44.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.742+0000 7fc036c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0300cef70 con 0x7fc0300d0650 2024-08-17T02:23:44.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.742+0000 7fc036200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc0301585a0 0x7fc030158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.742+0000 7fc036200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc0301585a0 0x7fc030158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54390/0 (socket says 172.21.15.2:54390) 2024-08-17T02:23:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.742+0000 7fc036200640 1 -- 172.21.15.2:0/2406488264 learned_addr learned my addr 172.21.15.2:0/2406488264 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.742+0000 7fc035800640 1 --2- 172.21.15.2:0/2406488264 >> v2:172.21.15.145:3300/0 conn(0x7fc0300b1850 0x7fc0300b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.742+0000 7fc034e00640 1 --2- 172.21.15.2:0/2406488264 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc0300d0650 0x7fc0300ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.743+0000 7fc036200640 1 -- 172.21.15.2:0/2406488264 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc0300d0650 msgr2=0x7fc0300ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.743+0000 7fc036200640 1 --2- 172.21.15.2:0/2406488264 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc0300d0650 0x7fc0300ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.743+0000 7fc036200640 1 -- 172.21.15.2:0/2406488264 >> v2:172.21.15.145:3300/0 conn(0x7fc0300b1850 msgr2=0x7fc0300b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.743+0000 7fc036200640 1 --2- 172.21.15.2:0/2406488264 >> v2:172.21.15.145:3300/0 conn(0x7fc0300b1850 0x7fc0300b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.743+0000 7fc036200640 1 -- 172.21.15.2:0/2406488264 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0300cf250 con 0x7fc0301585a0 2024-08-17T02:23:44.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.744+0000 7fc036200640 1 --2- 172.21.15.2:0/2406488264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0301585a0 0x7fc030158a20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc030088960 tx=0x7fc028009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a7bfcef9a5ace2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.744+0000 7fc02fe00640 1 -- 172.21.15.2:0/2406488264 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028031400 con 0x7fc0301585a0 2024-08-17T02:23:44.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.744+0000 7fc02fe00640 1 -- 172.21.15.2:0/2406488264 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02802d050 con 0x7fc0301585a0 2024-08-17T02:23:44.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.744+0000 7fc02fe00640 1 -- 172.21.15.2:0/2406488264 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0280317d0 con 0x7fc0301585a0 2024-08-17T02:23:44.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.744+0000 7fc036c00640 1 -- 172.21.15.2:0/2406488264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0301585a0 msgr2=0x7fc030158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.744+0000 7fc036c00640 1 --2- 172.21.15.2:0/2406488264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0301585a0 0x7fc030158a20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc030088960 tx=0x7fc028009840 comp rx=0 tx=0).stop 2024-08-17T02:23:44.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.744+0000 7fc036c00640 1 -- 172.21.15.2:0/2406488264 shutdown_connections 2024-08-17T02:23:44.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.744+0000 7fc036c00640 1 --2- 172.21.15.2:0/2406488264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0301585a0 0x7fc030158a20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.744+0000 7fc036c00640 1 --2- 172.21.15.2:0/2406488264 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc0300d0650 0x7fc0300ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.744+0000 7fc036c00640 1 --2- 172.21.15.2:0/2406488264 >> v2:172.21.15.145:3300/0 conn(0x7fc0300b1850 0x7fc0300b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.744+0000 7fc036c00640 1 -- 172.21.15.2:0/2406488264 >> 172.21.15.2:0/2406488264 conn(0x7fc03006e590 msgr2=0x7fc03006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:44.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.745+0000 7fc036c00640 1 -- 172.21.15.2:0/2406488264 shutdown_connections 2024-08-17T02:23:44.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.745+0000 7fc036c00640 1 -- 172.21.15.2:0/2406488264 wait complete. 2024-08-17T02:23:44.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.746+0000 7fc036c00640 1 Processor -- start 2024-08-17T02:23:44.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.746+0000 7fc036c00640 1 -- start start 2024-08-17T02:23:44.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.747+0000 7fc036c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0300b1850 0x7fc03015bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.747+0000 7fc036c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc0300d0650 0x7fc03013acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.747+0000 7fc036c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc0301585a0 0x7fc03013be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.747+0000 7fc036c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03013f060 con 0x7fc0300b1850 2024-08-17T02:23:44.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.747+0000 7fc036c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03013e490 con 0x7fc0300d0650 2024-08-17T02:23:44.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.747+0000 7fc036c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03013e730 con 0x7fc0301585a0 2024-08-17T02:23:44.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.747+0000 7fc035800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0300b1850 0x7fc03015bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.747+0000 7fc035800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0300b1850 0x7fc03015bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54392/0 (socket says 172.21.15.2:54392) 2024-08-17T02:23:44.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.747+0000 7fc035800640 1 -- 172.21.15.2:0/1121486747 learned_addr learned my addr 172.21.15.2:0/1121486747 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:44.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.747+0000 7fc035800640 1 -- 172.21.15.2:0/1121486747 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc0301585a0 msgr2=0x7fc03013be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.747+0000 7fc035800640 1 --2- 172.21.15.2:0/1121486747 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc0301585a0 0x7fc03013be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.747+0000 7fc035800640 1 -- 172.21.15.2:0/1121486747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc0300d0650 msgr2=0x7fc03013acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.747+0000 7fc035800640 1 --2- 172.21.15.2:0/1121486747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc0300d0650 0x7fc03013acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.747+0000 7fc035800640 1 -- 172.21.15.2:0/1121486747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc028009ae0 con 0x7fc0300b1850 2024-08-17T02:23:44.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.748+0000 7fc035800640 1 --2- 172.21.15.2:0/1121486747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0300b1850 0x7fc03015bb20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc02400d890 tx=0x7fc024008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.748+0000 7fc02cc00640 1 -- 172.21.15.2:0/1121486747 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02400de20 con 0x7fc0300b1850 2024-08-17T02:23:44.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.748+0000 7fc02cc00640 1 -- 172.21.15.2:0/1121486747 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc024009940 con 0x7fc0300b1850 2024-08-17T02:23:44.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.748+0000 7fc02cc00640 1 -- 172.21.15.2:0/1121486747 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc024009ce0 con 0x7fc0300b1850 2024-08-17T02:23:44.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.748+0000 7fc036c00640 1 -- 172.21.15.2:0/1121486747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc03013ea10 con 0x7fc0300b1850 2024-08-17T02:23:44.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.748+0000 7fc036c00640 1 -- 172.21.15.2:0/1121486747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc03013b1f0 con 0x7fc0300b1850 2024-08-17T02:23:44.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.749+0000 7fc036c00640 1 -- 172.21.15.2:0/1121486747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc030070720 con 0x7fc0300b1850 2024-08-17T02:23:44.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.750+0000 7fc02cc00640 1 -- 172.21.15.2:0/1121486747 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc024014620 con 0x7fc0300b1850 2024-08-17T02:23:44.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.751+0000 7fc02cc00640 1 --2- 172.21.15.2:0/1121486747 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc010065180 0x7fc010067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.751+0000 7fc02cc00640 1 -- 172.21.15.2:0/1121486747 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc024082d00 con 0x7fc0300b1850 2024-08-17T02:23:44.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.751+0000 7fc034e00640 1 --2- 172.21.15.2:0/1121486747 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc010065180 0x7fc010067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.752+0000 7fc034e00640 1 --2- 172.21.15.2:0/1121486747 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc010065180 0x7fc010067630 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc01c006fd0 tx=0x7fc01c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.755+0000 7fc02cc00640 1 -- 172.21.15.2:0/1121486747 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc024050de0 con 0x7fc0300b1850 2024-08-17T02:23:44.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.936+0000 7fc036c00640 1 -- 172.21.15.2:0/1121486747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc030068140 con 0x7fc0300b1850 2024-08-17T02:23:44.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.936+0000 7fc02cc00640 1 -- 172.21.15.2:0/1121486747 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc024054400 con 0x7fc0300b1850 2024-08-17T02:23:44.938 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:23:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.938+0000 7fc036c00640 1 -- 172.21.15.2:0/1121486747 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc010065180 msgr2=0x7fc010067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.938+0000 7fc036c00640 1 --2- 172.21.15.2:0/1121486747 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc010065180 0x7fc010067630 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc01c006fd0 tx=0x7fc01c008040 comp rx=0 tx=0).stop 2024-08-17T02:23:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.938+0000 7fc036c00640 1 -- 172.21.15.2:0/1121486747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0300b1850 msgr2=0x7fc03015bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.938+0000 7fc036c00640 1 --2- 172.21.15.2:0/1121486747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0300b1850 0x7fc03015bb20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc02400d890 tx=0x7fc024008040 comp rx=0 tx=0).stop 2024-08-17T02:23:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.938+0000 7fc036c00640 1 -- 172.21.15.2:0/1121486747 shutdown_connections 2024-08-17T02:23:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.938+0000 7fc036c00640 1 --2- 172.21.15.2:0/1121486747 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc010065180 0x7fc010067630 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.938+0000 7fc036c00640 1 --2- 172.21.15.2:0/1121486747 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc0301585a0 0x7fc03013be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.938+0000 7fc036c00640 1 --2- 172.21.15.2:0/1121486747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc0300d0650 0x7fc03013acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.938+0000 7fc036c00640 1 --2- 172.21.15.2:0/1121486747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0300b1850 0x7fc03015bb20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.938+0000 7fc036c00640 1 -- 172.21.15.2:0/1121486747 >> 172.21.15.2:0/1121486747 conn(0x7fc03006e590 msgr2=0x7fc0300afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.938+0000 7fc036c00640 1 -- 172.21.15.2:0/1121486747 shutdown_connections 2024-08-17T02:23:44.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:44.938+0000 7fc036c00640 1 -- 172.21.15.2:0/1121486747 wait complete. 2024-08-17T02:23:44.955 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:23:45.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.107+0000 7f40b8800640 1 Processor -- start 2024-08-17T02:23:45.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.107+0000 7f40b8800640 1 -- start start 2024-08-17T02:23:45.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.108+0000 7f40b8800640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f40b00ad960 0x7f40b015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.108+0000 7f40b8800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40b00add30 0x7f40b0156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.108+0000 7f40b8800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b015b5e0 con 0x7f40b00ca050 2024-08-17T02:23:45.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.108+0000 7f40b8800640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b00cb160 con 0x7f40b00ad960 2024-08-17T02:23:45.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.108+0000 7f40b8800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b00b0d10 con 0x7f40b00add30 2024-08-17T02:23:45.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.108+0000 7f40b5400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f40b00ca050 0x7f40b0156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58636/0 (socket says 172.21.15.2:58636) 2024-08-17T02:23:45.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.108+0000 7f40b5400640 1 -- 172.21.15.2:0/1013190756 learned_addr learned my addr 172.21.15.2:0/1013190756 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:45.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.109+0000 7f40b5e00640 1 --2- 172.21.15.2:0/1013190756 >> v2:172.21.15.145:3300/0 conn(0x7f40b00ad960 0x7f40b015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.109+0000 7f40b6800640 1 --2- 172.21.15.2:0/1013190756 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40b00add30 0x7f40b0156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.109+0000 7f40b4a00640 1 -- 172.21.15.2:0/1013190756 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942197322 0 0) 0x7f40a0001110 con 0x7f40b00ca050 2024-08-17T02:23:45.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.109+0000 7f40b4a00640 1 -- 172.21.15.2:0/1013190756 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40980034e0 con 0x7f40b00ca050 2024-08-17T02:23:45.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.109+0000 7f40b5e00640 1 -- 172.21.15.2:0/1013190756 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40b00add30 msgr2=0x7f40b0156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:45.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.109+0000 7f40b5e00640 1 --2- 172.21.15.2:0/1013190756 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40b00add30 0x7f40b0156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.109+0000 7f40b5e00640 1 -- 172.21.15.2:0/1013190756 >> v1:172.21.15.2:6789/0 conn(0x7f40b00ca050 legacy=0x7f40b0156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.109+0000 7f40b5e00640 1 -- 172.21.15.2:0/1013190756 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b00ca550 con 0x7f40b00ad960 2024-08-17T02:23:45.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.110+0000 7f40b5e00640 1 --2- 172.21.15.2:0/1013190756 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40b00ad960 0x7f40b015b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f40a4009850 tx=0x7f40a40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92001239bd5b5412 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:45.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.111+0000 7f40b4a00640 1 -- 172.21.15.2:0/1013190756 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a402ae20 con 0x7f40b00ad960 2024-08-17T02:23:45.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.111+0000 7f40b4a00640 1 -- 172.21.15.2:0/1013190756 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a4032440 con 0x7f40b00ad960 2024-08-17T02:23:45.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.111+0000 7f40b4a00640 1 -- 172.21.15.2:0/1013190756 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a4032800 con 0x7f40b00ad960 2024-08-17T02:23:45.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.111+0000 7f40b8800640 1 -- 172.21.15.2:0/1013190756 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40b00ad960 msgr2=0x7f40b015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.111+0000 7f40b8800640 1 --2- 172.21.15.2:0/1013190756 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40b00ad960 0x7f40b015b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f40a4009850 tx=0x7f40a40090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.111+0000 7f40b8800640 1 -- 172.21.15.2:0/1013190756 shutdown_connections 2024-08-17T02:23:45.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.111+0000 7f40b8800640 1 --2- 172.21.15.2:0/1013190756 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40b00add30 0x7f40b0156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.111+0000 7f40b8800640 1 --2- 172.21.15.2:0/1013190756 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40b00ad960 0x7f40b015b0a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.111+0000 7f40b8800640 1 -- 172.21.15.2:0/1013190756 >> 172.21.15.2:0/1013190756 conn(0x7f40b0066e60 msgr2=0x7f40b0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:45.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.111+0000 7f40b8800640 1 -- 172.21.15.2:0/1013190756 shutdown_connections 2024-08-17T02:23:45.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.111+0000 7f40b8800640 1 -- 172.21.15.2:0/1013190756 wait complete. 2024-08-17T02:23:45.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.113+0000 7f40b8800640 1 Processor -- start 2024-08-17T02:23:45.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.113+0000 7f40b8800640 1 -- start start 2024-08-17T02:23:45.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.113+0000 7f40b8800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40b00ad960 0x7f40b00aa120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.113+0000 7f40b8800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40b00add30 0x7f40b01596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.114+0000 7f40b8800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40b00ca050 0x7f40b01505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.114+0000 7f40b8800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b0169450 con 0x7f40b00ad960 2024-08-17T02:23:45.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.114+0000 7f40b8800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b0159bf0 con 0x7f40b00ca050 2024-08-17T02:23:45.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.114+0000 7f40b8800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b0159e00 con 0x7f40b00add30 2024-08-17T02:23:45.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.114+0000 7f40b5e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40b00ad960 0x7f40b00aa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.114+0000 7f40b5e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40b00ad960 0x7f40b00aa120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47024/0 (socket says 172.21.15.2:47024) 2024-08-17T02:23:45.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.114+0000 7f40b5e00640 1 -- 172.21.15.2:0/2311457071 learned_addr learned my addr 172.21.15.2:0/2311457071 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:45.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.114+0000 7f40b6800640 1 --2- 172.21.15.2:0/2311457071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40b00ca050 0x7f40b01505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.114+0000 7f40b5400640 1 --2- 172.21.15.2:0/2311457071 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40b00add30 0x7f40b01596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.114+0000 7f40b5e00640 1 -- 172.21.15.2:0/2311457071 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40b00add30 msgr2=0x7f40b01596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.114+0000 7f40b5e00640 1 --2- 172.21.15.2:0/2311457071 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40b00add30 0x7f40b01596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.114+0000 7f40b5e00640 1 -- 172.21.15.2:0/2311457071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40b00ca050 msgr2=0x7f40b01505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.114+0000 7f40b5e00640 1 --2- 172.21.15.2:0/2311457071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40b00ca050 0x7f40b01505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.114+0000 7f40b5e00640 1 -- 172.21.15.2:0/2311457071 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a4009390 con 0x7f40b00ad960 2024-08-17T02:23:45.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.114+0000 7f40b6800640 1 --2- 172.21.15.2:0/2311457071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40b00ca050 0x7f40b01505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:45.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.114+0000 7f40b5400640 1 --2- 172.21.15.2:0/2311457071 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40b00add30 0x7f40b01596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:45.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.115+0000 7f40b5e00640 1 --2- 172.21.15.2:0/2311457071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40b00ad960 0x7f40b00aa120 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f40a4009850 tx=0x7f40a4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:45.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.115+0000 7f40a9600640 1 -- 172.21.15.2:0/2311457071 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a4031830 con 0x7f40b00ad960 2024-08-17T02:23:45.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.115+0000 7f40b8800640 1 -- 172.21.15.2:0/2311457071 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b0169f70 con 0x7f40b00ad960 2024-08-17T02:23:45.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.115+0000 7f40a9600640 1 -- 172.21.15.2:0/2311457071 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a4031990 con 0x7f40b00ad960 2024-08-17T02:23:45.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.115+0000 7f40a9600640 1 -- 172.21.15.2:0/2311457071 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a4031d70 con 0x7f40b00ad960 2024-08-17T02:23:45.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.115+0000 7f40b8800640 1 -- 172.21.15.2:0/2311457071 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b0169640 con 0x7f40b00ad960 2024-08-17T02:23:45.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.116+0000 7f40b8800640 1 -- 172.21.15.2:0/2311457071 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b0063fb0 con 0x7f40b00ad960 2024-08-17T02:23:45.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.117+0000 7f40a9600640 1 -- 172.21.15.2:0/2311457071 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f40a403c400 con 0x7f40b00ad960 2024-08-17T02:23:45.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.118+0000 7f40a9600640 1 --2- 172.21.15.2:0/2311457071 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4094065180 0x7f4094067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.118+0000 7f40a9600640 1 -- 172.21.15.2:0/2311457071 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40a40a2580 con 0x7f40b00ad960 2024-08-17T02:23:45.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.118+0000 7f40b5400640 1 --2- 172.21.15.2:0/2311457071 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4094065180 0x7f4094067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.119+0000 7f40b5400640 1 --2- 172.21.15.2:0/2311457071 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4094065180 0x7f4094067630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f40b0159660 tx=0x7f40a0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:45.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.123+0000 7f40a9600640 1 -- 172.21.15.2:0/2311457071 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f40a4070640 con 0x7f40b00ad960 2024-08-17T02:23:45.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.303+0000 7f40b8800640 1 -- 172.21.15.2:0/2311457071 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f40b006b840 con 0x7f40b00ad960 2024-08-17T02:23:45.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.304+0000 7f40a9600640 1 -- 172.21.15.2:0/2311457071 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f40a4073c60 con 0x7f40b00ad960 2024-08-17T02:23:45.305 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-08-17T02:23:45.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.306+0000 7f40b8800640 1 -- 172.21.15.2:0/2311457071 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4094065180 msgr2=0x7f4094067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.306+0000 7f40b8800640 1 --2- 172.21.15.2:0/2311457071 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4094065180 0x7f4094067630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f40b0159660 tx=0x7f40a0009040 comp rx=0 tx=0).stop 2024-08-17T02:23:45.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.306+0000 7f40b8800640 1 -- 172.21.15.2:0/2311457071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40b00ad960 msgr2=0x7f40b00aa120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.306+0000 7f40b8800640 1 --2- 172.21.15.2:0/2311457071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40b00ad960 0x7f40b00aa120 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f40a4009850 tx=0x7f40a4032000 comp rx=0 tx=0).stop 2024-08-17T02:23:45.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.306+0000 7f40b8800640 1 -- 172.21.15.2:0/2311457071 shutdown_connections 2024-08-17T02:23:45.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.306+0000 7f40b8800640 1 --2- 172.21.15.2:0/2311457071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40b00ca050 0x7f40b01505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.306+0000 7f40b8800640 1 --2- 172.21.15.2:0/2311457071 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4094065180 0x7f4094067630 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.306+0000 7f40b8800640 1 --2- 172.21.15.2:0/2311457071 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40b00add30 0x7f40b01596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.306+0000 7f40b8800640 1 --2- 172.21.15.2:0/2311457071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40b00ad960 0x7f40b00aa120 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.306+0000 7f40b8800640 1 -- 172.21.15.2:0/2311457071 >> 172.21.15.2:0/2311457071 conn(0x7f40b0066e60 msgr2=0x7f40b0153fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:45.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.306+0000 7f40b8800640 1 -- 172.21.15.2:0/2311457071 shutdown_connections 2024-08-17T02:23:45.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.306+0000 7f40b8800640 1 -- 172.21.15.2:0/2311457071 wait complete. 2024-08-17T02:23:45.323 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:23:45.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.473+0000 7f9b43e00640 1 Processor -- start 2024-08-17T02:23:45.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.473+0000 7f9b43e00640 1 -- start start 2024-08-17T02:23:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.474+0000 7f9b43e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b3c06e4b0 0x7f9b3c0afa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.474+0000 7f9b43e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3c0aeeb0 con 0x7f9b3c06e060 2024-08-17T02:23:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.474+0000 7f9b43e00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3c0aadd0 con 0x7f9b3c155040 2024-08-17T02:23:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.474+0000 7f9b43e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c1597f0 con 0x7f9b3c06e4b0 2024-08-17T02:23:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.475+0000 7f9b40a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9b3c06e060 0x7f9b3c0af340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58650/0 (socket says 172.21.15.2:58650) 2024-08-17T02:23:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.475+0000 7f9b40a00640 1 -- 172.21.15.2:0/3058245027 learned_addr learned my addr 172.21.15.2:0/3058245027 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.475+0000 7f9b41e00640 1 --2- 172.21.15.2:0/3058245027 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b3c06e4b0 0x7f9b3c0afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.475+0000 7f9b3be00640 1 -- 172.21.15.2:0/3058245027 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833540583 0 0) 0x7f9b3c0aeeb0 con 0x7f9b3c06e060 2024-08-17T02:23:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.475+0000 7f9b3be00640 1 -- 172.21.15.2:0/3058245027 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b240034e0 con 0x7f9b3c06e060 2024-08-17T02:23:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.475+0000 7f9b3be00640 1 -- 172.21.15.2:0/3058245027 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292037739 0 0) 0x7f9b3c0aadd0 con 0x7f9b3c155040 2024-08-17T02:23:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.475+0000 7f9b3be00640 1 -- 172.21.15.2:0/3058245027 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b3c0aeeb0 con 0x7f9b3c155040 2024-08-17T02:23:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.475+0000 7f9b41e00640 1 -- 172.21.15.2:0/3058245027 >> v1:172.21.15.145:6789/0 conn(0x7f9b3c155040 legacy=0x7f9b3c158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.475+0000 7f9b41e00640 1 -- 172.21.15.2:0/3058245027 >> v1:172.21.15.2:6789/0 conn(0x7f9b3c06e060 legacy=0x7f9b3c0af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.475+0000 7f9b41e00640 1 -- 172.21.15.2:0/3058245027 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c159ad0 con 0x7f9b3c06e4b0 2024-08-17T02:23:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.476+0000 7f9b41e00640 1 --2- 172.21.15.2:0/3058245027 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b3c06e4b0 0x7f9b3c0afa50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400afa0 tx=0x7f9b3400a890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79db809e8c460e8e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.477+0000 7f9b3be00640 1 -- 172.21.15.2:0/3058245027 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3400a2e0 con 0x7f9b3c06e4b0 2024-08-17T02:23:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.477+0000 7f9b3be00640 1 -- 172.21.15.2:0/3058245027 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3402f050 con 0x7f9b3c06e4b0 2024-08-17T02:23:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.477+0000 7f9b3be00640 1 -- 172.21.15.2:0/3058245027 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b340086a0 con 0x7f9b3c06e4b0 2024-08-17T02:23:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.478+0000 7f9b43e00640 1 -- 172.21.15.2:0/3058245027 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b3c06e4b0 msgr2=0x7f9b3c0afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.478+0000 7f9b43e00640 1 --2- 172.21.15.2:0/3058245027 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b3c06e4b0 0x7f9b3c0afa50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400afa0 tx=0x7f9b3400a890 comp rx=0 tx=0).stop 2024-08-17T02:23:45.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.478+0000 7f9b43e00640 1 -- 172.21.15.2:0/3058245027 shutdown_connections 2024-08-17T02:23:45.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.478+0000 7f9b43e00640 1 --2- 172.21.15.2:0/3058245027 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b3c06e4b0 0x7f9b3c0afa50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.478+0000 7f9b43e00640 1 -- 172.21.15.2:0/3058245027 >> 172.21.15.2:0/3058245027 conn(0x7f9b3c066e60 msgr2=0x7f9b3c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:45.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.478+0000 7f9b43e00640 1 -- 172.21.15.2:0/3058245027 shutdown_connections 2024-08-17T02:23:45.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.478+0000 7f9b43e00640 1 -- 172.21.15.2:0/3058245027 wait complete. 2024-08-17T02:23:45.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.479+0000 7f9b43e00640 1 Processor -- start 2024-08-17T02:23:45.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.479+0000 7f9b43e00640 1 -- start start 2024-08-17T02:23:45.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.480+0000 7f9b43e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b3c06e060 0x7f9b3c0a9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.480+0000 7f9b43e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b3c06e4b0 0x7f9b3c169ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.480+0000 7f9b43e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b3c155040 0x7f9b3c0ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.480+0000 7f9b43e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c16a000 con 0x7f9b3c06e4b0 2024-08-17T02:23:45.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.480+0000 7f9b43e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0caa00 con 0x7f9b3c155040 2024-08-17T02:23:45.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.480+0000 7f9b43e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0a8cc0 con 0x7f9b3c06e060 2024-08-17T02:23:45.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.480+0000 7f9b40a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b3c06e4b0 0x7f9b3c169ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.480+0000 7f9b40a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b3c06e4b0 0x7f9b3c169ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47026/0 (socket says 172.21.15.2:47026) 2024-08-17T02:23:45.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.480+0000 7f9b40a00640 1 -- 172.21.15.2:0/4102615534 learned_addr learned my addr 172.21.15.2:0/4102615534 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:45.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.481+0000 7f9b41e00640 1 --2- 172.21.15.2:0/4102615534 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b3c155040 0x7f9b3c0ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.480+0000 7f9b41400640 1 --2- 172.21.15.2:0/4102615534 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b3c06e060 0x7f9b3c0a9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.481+0000 7f9b40a00640 1 -- 172.21.15.2:0/4102615534 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b3c06e060 msgr2=0x7f9b3c0a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.481+0000 7f9b40a00640 1 --2- 172.21.15.2:0/4102615534 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b3c06e060 0x7f9b3c0a9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.481+0000 7f9b40a00640 1 -- 172.21.15.2:0/4102615534 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b3c155040 msgr2=0x7f9b3c0ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.481+0000 7f9b40a00640 1 --2- 172.21.15.2:0/4102615534 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b3c155040 0x7f9b3c0ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.481+0000 7f9b40a00640 1 -- 172.21.15.2:0/4102615534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3400ab30 con 0x7f9b3c06e4b0 2024-08-17T02:23:45.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.481+0000 7f9b40a00640 1 --2- 172.21.15.2:0/4102615534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b3c06e4b0 0x7f9b3c169ac0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9b28005840 tx=0x7f9b28007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:45.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.481+0000 7f9b38c00640 1 -- 172.21.15.2:0/4102615534 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b28005aa0 con 0x7f9b3c06e4b0 2024-08-17T02:23:45.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.481+0000 7f9b38c00640 1 -- 172.21.15.2:0/4102615534 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b28005c00 con 0x7f9b3c06e4b0 2024-08-17T02:23:45.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.481+0000 7f9b38c00640 1 -- 172.21.15.2:0/4102615534 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b280070f0 con 0x7f9b3c06e4b0 2024-08-17T02:23:45.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.481+0000 7f9b43e00640 1 -- 172.21.15.2:0/4102615534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b3c0a8fa0 con 0x7f9b3c06e4b0 2024-08-17T02:23:45.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.482+0000 7f9b43e00640 1 -- 172.21.15.2:0/4102615534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3c0a9560 con 0x7f9b3c06e4b0 2024-08-17T02:23:45.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.483+0000 7f9b43e00640 1 -- 172.21.15.2:0/4102615534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b3c063fb0 con 0x7f9b3c06e4b0 2024-08-17T02:23:45.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.483+0000 7f9b38c00640 1 -- 172.21.15.2:0/4102615534 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9b28007520 con 0x7f9b3c06e4b0 2024-08-17T02:23:45.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.484+0000 7f9b38c00640 1 --2- 172.21.15.2:0/4102615534 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9b1c065150 0x7f9b1c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.484+0000 7f9b38c00640 1 -- 172.21.15.2:0/4102615534 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9b28081da0 con 0x7f9b3c06e4b0 2024-08-17T02:23:45.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.485+0000 7f9b41400640 1 --2- 172.21.15.2:0/4102615534 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9b1c065150 0x7f9b1c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.485+0000 7f9b41400640 1 --2- 172.21.15.2:0/4102615534 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9b1c065150 0x7f9b1c067600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c153e30 tx=0x7f9b30007cc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:45.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.488+0000 7f9b38c00640 1 -- 172.21.15.2:0/4102615534 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9b2804ff90 con 0x7f9b3c06e4b0 2024-08-17T02:23:45.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.706+0000 7f9b43e00640 1 -- 172.21.15.2:0/4102615534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b3c153b80 con 0x7f9b3c06e4b0 2024-08-17T02:23:45.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.707+0000 7f9b38c00640 1 -- 172.21.15.2:0/4102615534 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f9b280535b0 con 0x7f9b3c06e4b0 2024-08-17T02:23:45.709 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:45.709 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/88006300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":88006300},{"type":"v1","addr":"172.21.15.2:6835","nonce":88006300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3374741059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3374741059},{"type":"v1","addr":"172.21.15.2:6833","nonce":3374741059}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/3494373963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":3494373963},{"type":"v1","addr":"172.21.15.145:6837","nonce":3494373963}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:31.378654+0000","modified":"2024-08-17T02:23:34.968351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6836/3984927211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3984927211},{"type":"v1","addr":"172.21.15.145:6836","nonce":3984927211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:23:45.710 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2024-08-17T02:23:45.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.709+0000 7f9b43e00640 1 -- 172.21.15.2:0/4102615534 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9b1c065150 msgr2=0x7f9b1c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.709+0000 7f9b43e00640 1 --2- 172.21.15.2:0/4102615534 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9b1c065150 0x7f9b1c067600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c153e30 tx=0x7f9b30007cc0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.709+0000 7f9b43e00640 1 -- 172.21.15.2:0/4102615534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b3c06e4b0 msgr2=0x7f9b3c169ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.709+0000 7f9b43e00640 1 --2- 172.21.15.2:0/4102615534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b3c06e4b0 0x7f9b3c169ac0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9b28005840 tx=0x7f9b28007e10 comp rx=0 tx=0).stop 2024-08-17T02:23:45.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.709+0000 7f9b43e00640 1 -- 172.21.15.2:0/4102615534 shutdown_connections 2024-08-17T02:23:45.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.709+0000 7f9b43e00640 1 --2- 172.21.15.2:0/4102615534 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b3c155040 0x7f9b3c0ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.709+0000 7f9b43e00640 1 --2- 172.21.15.2:0/4102615534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b3c06e4b0 0x7f9b3c169ac0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.709+0000 7f9b43e00640 1 --2- 172.21.15.2:0/4102615534 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9b1c065150 0x7f9b1c067600 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.709+0000 7f9b43e00640 1 --2- 172.21.15.2:0/4102615534 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b3c06e060 0x7f9b3c0a9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.709+0000 7f9b43e00640 1 -- 172.21.15.2:0/4102615534 >> 172.21.15.2:0/4102615534 conn(0x7f9b3c066e60 msgr2=0x7f9b3c151560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:45.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.709+0000 7f9b43e00640 1 -- 172.21.15.2:0/4102615534 shutdown_connections 2024-08-17T02:23:45.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.709+0000 7f9b43e00640 1 -- 172.21.15.2:0/4102615534 wait complete. 2024-08-17T02:23:45.727 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:45.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.876+0000 7fed15e00640 1 Processor -- start 2024-08-17T02:23:45.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.877+0000 7fed15e00640 1 -- start start 2024-08-17T02:23:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.878+0000 7fed15e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fed10158c90 0x7fed100ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.878+0000 7fed15e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fed100cadc0 0x7fed100cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.878+0000 7fed15e00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fed100cca40 0x7fed100685f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.878+0000 7fed15e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed100cf600 con 0x7fed100cadc0 2024-08-17T02:23:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.878+0000 7fed15e00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed100cea90 con 0x7fed100cca40 2024-08-17T02:23:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.878+0000 7fed15e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed100ced30 con 0x7fed10158c90 2024-08-17T02:23:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.878+0000 7fed0fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fed100cadc0 0x7fed100cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.878+0000 7fed0fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fed100cadc0 0x7fed100cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47030/0 (socket says 172.21.15.2:47030) 2024-08-17T02:23:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.878+0000 7fed0fe00640 1 -- 172.21.15.2:0/3338054477 learned_addr learned my addr 172.21.15.2:0/3338054477 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.878+0000 7fed15400640 1 --2- 172.21.15.2:0/3338054477 >> v2:172.21.15.145:3300/0 conn(0x7fed100cca40 0x7fed100685f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.878+0000 7fed14a00640 1 --2- 172.21.15.2:0/3338054477 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fed10158c90 0x7fed100ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.878+0000 7fed0fe00640 1 -- 172.21.15.2:0/3338054477 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fed10158c90 msgr2=0x7fed100ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.878+0000 7fed0fe00640 1 --2- 172.21.15.2:0/3338054477 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fed10158c90 0x7fed100ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.878+0000 7fed0fe00640 1 -- 172.21.15.2:0/3338054477 >> v2:172.21.15.145:3300/0 conn(0x7fed100cca40 msgr2=0x7fed100685f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.878+0000 7fed0fe00640 1 --2- 172.21.15.2:0/3338054477 >> v2:172.21.15.145:3300/0 conn(0x7fed100cca40 0x7fed100685f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.879+0000 7fed0fe00640 1 -- 172.21.15.2:0/3338054477 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed100cefd0 con 0x7fed100cadc0 2024-08-17T02:23:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.879+0000 7fed14a00640 1 --2- 172.21.15.2:0/3338054477 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fed10158c90 0x7fed100ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:45.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.879+0000 7fed0fe00640 1 --2- 172.21.15.2:0/3338054477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed100cadc0 0x7fed100cc500 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fed10088bb0 tx=0x7fecfc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42bccf77e8eac0b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:45.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.880+0000 7fed0f400640 1 -- 172.21.15.2:0/3338054477 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc02add0 con 0x7fed100cadc0 2024-08-17T02:23:45.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.880+0000 7fed0f400640 1 -- 172.21.15.2:0/3338054477 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecfc032440 con 0x7fed100cadc0 2024-08-17T02:23:45.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.880+0000 7fed0f400640 1 -- 172.21.15.2:0/3338054477 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc032820 con 0x7fed100cadc0 2024-08-17T02:23:45.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.880+0000 7fed15e00640 1 -- 172.21.15.2:0/3338054477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed100cadc0 msgr2=0x7fed100cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.880+0000 7fed15e00640 1 --2- 172.21.15.2:0/3338054477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed100cadc0 0x7fed100cc500 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fed10088bb0 tx=0x7fecfc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.880+0000 7fed15e00640 1 -- 172.21.15.2:0/3338054477 shutdown_connections 2024-08-17T02:23:45.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.880+0000 7fed15e00640 1 --2- 172.21.15.2:0/3338054477 >> v2:172.21.15.145:3300/0 conn(0x7fed100cca40 0x7fed100685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.880+0000 7fed15e00640 1 --2- 172.21.15.2:0/3338054477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed100cadc0 0x7fed100cc500 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.880+0000 7fed15e00640 1 --2- 172.21.15.2:0/3338054477 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fed10158c90 0x7fed100ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.880+0000 7fed15e00640 1 -- 172.21.15.2:0/3338054477 >> 172.21.15.2:0/3338054477 conn(0x7fed10087a80 msgr2=0x7fed1006e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:45.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.881+0000 7fed15e00640 1 -- 172.21.15.2:0/3338054477 shutdown_connections 2024-08-17T02:23:45.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.881+0000 7fed15e00640 1 -- 172.21.15.2:0/3338054477 wait complete. 2024-08-17T02:23:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.882+0000 7fed15e00640 1 Processor -- start 2024-08-17T02:23:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.882+0000 7fed15e00640 1 -- start start 2024-08-17T02:23:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.883+0000 7fed15e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fed100cadc0 0x7fed10153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.883+0000 7fed15e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed100cca40 0x7fed100c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.883+0000 7fed15e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed10158c90 0x7fed1015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.883+0000 7fed15e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed10159470 con 0x7fed10158c90 2024-08-17T02:23:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.883+0000 7fed15e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed100c7650 con 0x7fed100cca40 2024-08-17T02:23:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.883+0000 7fed15e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1015bf70 con 0x7fed100cadc0 2024-08-17T02:23:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.883+0000 7fed15400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed10158c90 0x7fed1015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.883+0000 7fed15400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed10158c90 0x7fed1015acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47036/0 (socket says 172.21.15.2:47036) 2024-08-17T02:23:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.883+0000 7fed15400640 1 -- 172.21.15.2:0/2257230375 learned_addr learned my addr 172.21.15.2:0/2257230375 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.883+0000 7fed0fe00640 1 --2- 172.21.15.2:0/2257230375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed100cca40 0x7fed100c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.883+0000 7fed14a00640 1 --2- 172.21.15.2:0/2257230375 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fed100cadc0 0x7fed10153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.884+0000 7fed15400640 1 -- 172.21.15.2:0/2257230375 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fed100cadc0 msgr2=0x7fed10153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.884+0000 7fed15400640 1 --2- 172.21.15.2:0/2257230375 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fed100cadc0 0x7fed10153420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.884+0000 7fed15400640 1 -- 172.21.15.2:0/2257230375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed100cca40 msgr2=0x7fed100c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.884+0000 7fed15400640 1 --2- 172.21.15.2:0/2257230375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed100cca40 0x7fed100c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.884+0000 7fed15400640 1 -- 172.21.15.2:0/2257230375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc009450 con 0x7fed10158c90 2024-08-17T02:23:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.884+0000 7fed15400640 1 --2- 172.21.15.2:0/2257230375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed10158c90 0x7fed1015acd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fed08009fa0 tx=0x7fed08009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.884+0000 7fed03e00640 1 -- 172.21.15.2:0/2257230375 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0800ee60 con 0x7fed10158c90 2024-08-17T02:23:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.884+0000 7fed03e00640 1 -- 172.21.15.2:0/2257230375 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed08014420 con 0x7fed10158c90 2024-08-17T02:23:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.884+0000 7fed03e00640 1 -- 172.21.15.2:0/2257230375 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed080147e0 con 0x7fed10158c90 2024-08-17T02:23:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.884+0000 7fed15e00640 1 -- 172.21.15.2:0/2257230375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed1015b9b0 con 0x7fed10158c90 2024-08-17T02:23:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.884+0000 7fed15e00640 1 -- 172.21.15.2:0/2257230375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed10159100 con 0x7fed10158c90 2024-08-17T02:23:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.885+0000 7fed15e00640 1 -- 172.21.15.2:0/2257230375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed101595e0 con 0x7fed10158c90 2024-08-17T02:23:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.886+0000 7fed03e00640 1 -- 172.21.15.2:0/2257230375 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fed08014b50 con 0x7fed10158c90 2024-08-17T02:23:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.887+0000 7fed03e00640 1 --2- 172.21.15.2:0/2257230375 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fecf0065150 0x7fecf0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.887+0000 7fed03e00640 1 -- 172.21.15.2:0/2257230375 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fed08082be0 con 0x7fed10158c90 2024-08-17T02:23:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.887+0000 7fed14a00640 1 --2- 172.21.15.2:0/2257230375 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fecf0065150 0x7fecf0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.888+0000 7fed14a00640 1 --2- 172.21.15.2:0/2257230375 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fecf0065150 0x7fecf0067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fed100b2120 tx=0x7fed04008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:45.891+0000 7fed03e00640 1 -- 172.21.15.2:0/2257230375 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fed08050cb0 con 0x7fed10158c90 2024-08-17T02:23:46.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.075+0000 7fed15e00640 1 -- 172.21.15.2:0/2257230375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed10070720 con 0x7fed10158c90 2024-08-17T02:23:46.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.076+0000 7fed03e00640 1 -- 172.21.15.2:0/2257230375 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fed080542d0 con 0x7fed10158c90 2024-08-17T02:23:46.077 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:46.078 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:23:32.955197+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:29.708835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:30.361908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:46.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.078+0000 7fed15e00640 1 -- 172.21.15.2:0/2257230375 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fecf0065150 msgr2=0x7fecf0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.078+0000 7fed15e00640 1 --2- 172.21.15.2:0/2257230375 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fecf0065150 0x7fecf0067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fed100b2120 tx=0x7fed04008040 comp rx=0 tx=0).stop 2024-08-17T02:23:46.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.078+0000 7fed15e00640 1 -- 172.21.15.2:0/2257230375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed10158c90 msgr2=0x7fed1015acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.078+0000 7fed15e00640 1 --2- 172.21.15.2:0/2257230375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed10158c90 0x7fed1015acd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fed08009fa0 tx=0x7fed08009900 comp rx=0 tx=0).stop 2024-08-17T02:23:46.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.078+0000 7fed15e00640 1 -- 172.21.15.2:0/2257230375 shutdown_connections 2024-08-17T02:23:46.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.078+0000 7fed15e00640 1 --2- 172.21.15.2:0/2257230375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed10158c90 0x7fed1015acd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.078+0000 7fed15e00640 1 --2- 172.21.15.2:0/2257230375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed100cca40 0x7fed100c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.078+0000 7fed15e00640 1 --2- 172.21.15.2:0/2257230375 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fecf0065150 0x7fecf0067600 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.078+0000 7fed15e00640 1 --2- 172.21.15.2:0/2257230375 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fed100cadc0 0x7fed10153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.078+0000 7fed15e00640 1 -- 172.21.15.2:0/2257230375 >> 172.21.15.2:0/2257230375 conn(0x7fed10087a80 msgr2=0x7fed10154290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:46.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.079+0000 7fed15e00640 1 -- 172.21.15.2:0/2257230375 shutdown_connections 2024-08-17T02:23:46.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.079+0000 7fed15e00640 1 -- 172.21.15.2:0/2257230375 wait complete. 2024-08-17T02:23:46.095 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:23:26.107978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:23:29.708835+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:23:30.361908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:23:46.095 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:23:46.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.249+0000 7f9912a00640 1 Processor -- start 2024-08-17T02:23:46.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.249+0000 7f9912a00640 1 -- start start 2024-08-17T02:23:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.250+0000 7f9912a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f990c0b0ac0 0x7f990c0add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.250+0000 7f9912a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f990c0ad8a0 con 0x7f990c0ae860 2024-08-17T02:23:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.250+0000 7f9912a00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f990c06edf0 con 0x7f990c158e60 2024-08-17T02:23:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.250+0000 7f9912a00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990c0acc90 con 0x7f990c0b0ac0 2024-08-17T02:23:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.250+0000 7f9910a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f990c0ae860 0x7f990c0c8e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58660/0 (socket says 172.21.15.2:58660) 2024-08-17T02:23:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.250+0000 7f9910a00640 1 -- 172.21.15.2:0/2911307041 learned_addr learned my addr 172.21.15.2:0/2911307041 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.251+0000 7f9903e00640 1 --2- 172.21.15.2:0/2911307041 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f990c0b0ac0 0x7f990c0add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.251+0000 7f990b400640 1 -- 172.21.15.2:0/2911307041 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464791656 0 0) 0x7f990c0ad8a0 con 0x7f990c0ae860 2024-08-17T02:23:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.251+0000 7f990b400640 1 -- 172.21.15.2:0/2911307041 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98f00034e0 con 0x7f990c0ae860 2024-08-17T02:23:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.251+0000 7f990b400640 1 -- 172.21.15.2:0/2911307041 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402976989 0 0) 0x7f990c06edf0 con 0x7f990c158e60 2024-08-17T02:23:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.251+0000 7f990b400640 1 -- 172.21.15.2:0/2911307041 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f990c0ad8a0 con 0x7f990c158e60 2024-08-17T02:23:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.251+0000 7f990b400640 1 -- 172.21.15.2:0/2911307041 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1541133998 0 0) 0x7f98f00034e0 con 0x7f990c0ae860 2024-08-17T02:23:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.251+0000 7f990b400640 1 -- 172.21.15.2:0/2911307041 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f990c0b0ac0 msgr2=0x7f990c0add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.251+0000 7f990b400640 1 --2- 172.21.15.2:0/2911307041 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f990c0b0ac0 0x7f990c0add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.251+0000 7f990b400640 1 -- 172.21.15.2:0/2911307041 >> v1:172.21.15.145:6789/0 conn(0x7f990c158e60 legacy=0x7f990c0b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.251+0000 7f990b400640 1 -- 172.21.15.2:0/2911307041 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990c0acf70 con 0x7f990c0ae860 2024-08-17T02:23:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.251+0000 7f990b400640 1 -- 172.21.15.2:0/2911307041 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7f99040017f0 con 0x7f990c0ae860 2024-08-17T02:23:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.251+0000 7f990b400640 1 -- 172.21.15.2:0/2911307041 >> v1:172.21.15.2:6789/0 conn(0x7f990c0ae860 legacy=0x7f990c0c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.251+0000 7f990b400640 1 --2- 172.21.15.2:0/2911307041 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f990c0b0ac0 0x7f98f0003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.251+0000 7f990b400640 1 --2- 172.21.15.2:0/2911307041 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98f0004140 0x7f98f0004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.251+0000 7f990b400640 1 --2- 172.21.15.2:0/2911307041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f0004cc0 0x7f98f0005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.251+0000 7f990b400640 1 -- 172.21.15.2:0/2911307041 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990c0acc90 con 0x7f98f0004cc0 2024-08-17T02:23:46.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.251+0000 7f990b400640 1 -- 172.21.15.2:0/2911307041 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f000dd70 con 0x7f98f0004140 2024-08-17T02:23:46.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.251+0000 7f990b400640 1 -- 172.21.15.2:0/2911307041 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f000df30 con 0x7f990c0b0ac0 2024-08-17T02:23:46.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.252+0000 7f9910a00640 1 --2- 172.21.15.2:0/2911307041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f0004cc0 0x7f98f0005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.252+0000 7f990be00640 1 --2- 172.21.15.2:0/2911307041 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f990c0b0ac0 0x7f98f0003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.252+0000 7f9903e00640 1 --2- 172.21.15.2:0/2911307041 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98f0004140 0x7f98f0004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.252+0000 7f9910a00640 1 -- 172.21.15.2:0/2911307041 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f990c0b0ac0 msgr2=0x7f98f0003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:46.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.252+0000 7f9910a00640 1 --2- 172.21.15.2:0/2911307041 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f990c0b0ac0 0x7f98f0003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.252+0000 7f9910a00640 1 -- 172.21.15.2:0/2911307041 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98f0004140 msgr2=0x7f98f0004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:46.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.252+0000 7f9910a00640 1 --2- 172.21.15.2:0/2911307041 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98f0004140 0x7f98f0004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.252+0000 7f9910a00640 1 -- 172.21.15.2:0/2911307041 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f00034e0 con 0x7f98f0004cc0 2024-08-17T02:23:46.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.253+0000 7f9910a00640 1 --2- 172.21.15.2:0/2911307041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f0004cc0 0x7f98f0005130 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f990400a800 tx=0x7f99040020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40d2b6149053b28 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:46.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.253+0000 7f990b400640 1 -- 172.21.15.2:0/2911307041 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99040071c0 con 0x7f98f0004cc0 2024-08-17T02:23:46.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.253+0000 7f990b400640 1 -- 172.21.15.2:0/2911307041 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9904007340 con 0x7f98f0004cc0 2024-08-17T02:23:46.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.253+0000 7f990b400640 1 -- 172.21.15.2:0/2911307041 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904007700 con 0x7f98f0004cc0 2024-08-17T02:23:46.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.254+0000 7f9912a00640 1 -- 172.21.15.2:0/2911307041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f0004cc0 msgr2=0x7f98f0005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.254+0000 7f9912a00640 1 --2- 172.21.15.2:0/2911307041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f0004cc0 0x7f98f0005130 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f990400a800 tx=0x7f99040020c0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.254+0000 7f9910a00640 1 -- 172.21.15.2:0/2911307041 reap_dead start 2024-08-17T02:23:46.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.254+0000 7f9912a00640 1 -- 172.21.15.2:0/2911307041 shutdown_connections 2024-08-17T02:23:46.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.254+0000 7f9912a00640 1 -- 172.21.15.2:0/2911307041 >> 172.21.15.2:0/2911307041 conn(0x7f990c0cc390 msgr2=0x7f990c066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:46.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.254+0000 7f9912a00640 1 -- 172.21.15.2:0/2911307041 shutdown_connections 2024-08-17T02:23:46.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.254+0000 7f9912a00640 1 -- 172.21.15.2:0/2911307041 wait complete. 2024-08-17T02:23:46.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.255+0000 7f9912a00640 1 Processor -- start 2024-08-17T02:23:46.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.255+0000 7f9912a00640 1 -- start start 2024-08-17T02:23:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.256+0000 7f9912a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f0004cc0 0x7f990c0a9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.256+0000 7f9912a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f990c0aa160 0x7f990c158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.256+0000 7f9912a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f990c158540 0x7f990c0a56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.256+0000 7f9912a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990c0a64b0 con 0x7f98f0004cc0 2024-08-17T02:23:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.256+0000 7f9912a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990c1589b0 con 0x7f990c158540 2024-08-17T02:23:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.256+0000 7f9912a00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990c0a7930 con 0x7f990c0aa160 2024-08-17T02:23:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.256+0000 7f990be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f0004cc0 0x7f990c0a9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.256+0000 7f990be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f0004cc0 0x7f990c0a9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47056/0 (socket says 172.21.15.2:47056) 2024-08-17T02:23:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.256+0000 7f990be00640 1 -- 172.21.15.2:0/3785576048 learned_addr learned my addr 172.21.15.2:0/3785576048 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.257+0000 7f9903e00640 1 --2- 172.21.15.2:0/3785576048 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f990c0aa160 0x7f990c158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.257+0000 7f9910a00640 1 --2- 172.21.15.2:0/3785576048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f990c158540 0x7f990c0a56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.257+0000 7f990be00640 1 -- 172.21.15.2:0/3785576048 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f990c0aa160 msgr2=0x7f990c158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.257+0000 7f990be00640 1 --2- 172.21.15.2:0/3785576048 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f990c0aa160 0x7f990c158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.257+0000 7f990be00640 1 -- 172.21.15.2:0/3785576048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f990c158540 msgr2=0x7f990c0a56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.257+0000 7f990be00640 1 --2- 172.21.15.2:0/3785576048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f990c158540 0x7f990c0a56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.257+0000 7f990be00640 1 -- 172.21.15.2:0/3785576048 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990c0a7000 con 0x7f98f0004cc0 2024-08-17T02:23:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.257+0000 7f990be00640 1 --2- 172.21.15.2:0/3785576048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f0004cc0 0x7f990c0a9c20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f98fc002b70 tx=0x7f98fc007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.257+0000 7f9903400640 1 -- 172.21.15.2:0/3785576048 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc00faf0 con 0x7f98f0004cc0 2024-08-17T02:23:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.257+0000 7f9903400640 1 -- 172.21.15.2:0/3785576048 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98fc00fc70 con 0x7f98f0004cc0 2024-08-17T02:23:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.257+0000 7f9912a00640 1 -- 172.21.15.2:0/3785576048 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f990c0a72e0 con 0x7f98f0004cc0 2024-08-17T02:23:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.257+0000 7f9903400640 1 -- 172.21.15.2:0/3785576048 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc0133f0 con 0x7f98f0004cc0 2024-08-17T02:23:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.258+0000 7f9912a00640 1 -- 172.21.15.2:0/3785576048 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f990c0a5c20 con 0x7f98f0004cc0 2024-08-17T02:23:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.258+0000 7f9912a00640 1 -- 172.21.15.2:0/3785576048 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f990c063fb0 con 0x7f98f0004cc0 2024-08-17T02:23:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.259+0000 7f9903400640 1 -- 172.21.15.2:0/3785576048 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f98fc0137c0 con 0x7f98f0004cc0 2024-08-17T02:23:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.260+0000 7f9903400640 1 --2- 172.21.15.2:0/3785576048 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f98e8065150 0x7f98e8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.260+0000 7f9903400640 1 -- 172.21.15.2:0/3785576048 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f98fc082bc0 con 0x7f98f0004cc0 2024-08-17T02:23:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.261+0000 7f9903e00640 1 --2- 172.21.15.2:0/3785576048 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f98e8065150 0x7f98e8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.261+0000 7f9903e00640 1 --2- 172.21.15.2:0/3785576048 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f98e8065150 0x7f98e8067600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f990c155ab0 tx=0x7f98f40090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.264+0000 7f9903400640 1 -- 172.21.15.2:0/3785576048 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f98fc050be0 con 0x7f98f0004cc0 2024-08-17T02:23:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.449+0000 7f9912a00640 1 -- 172.21.15.2:0/3785576048 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f990c0699c0 con 0x7f98f0004cc0 2024-08-17T02:23:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.449+0000 7f9903400640 1 -- 172.21.15.2:0/3785576048 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f98fc017020 con 0x7f98f0004cc0 2024-08-17T02:23:46.450 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-17T02:23:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.451+0000 7f9912a00640 1 -- 172.21.15.2:0/3785576048 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f98e8065150 msgr2=0x7f98e8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.451+0000 7f9912a00640 1 --2- 172.21.15.2:0/3785576048 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f98e8065150 0x7f98e8067600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f990c155ab0 tx=0x7f98f40090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.451+0000 7f9912a00640 1 -- 172.21.15.2:0/3785576048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f0004cc0 msgr2=0x7f990c0a9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.451+0000 7f9912a00640 1 --2- 172.21.15.2:0/3785576048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f0004cc0 0x7f990c0a9c20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f98fc002b70 tx=0x7f98fc007ca0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.452+0000 7f9912a00640 1 -- 172.21.15.2:0/3785576048 shutdown_connections 2024-08-17T02:23:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.452+0000 7f9912a00640 1 --2- 172.21.15.2:0/3785576048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f990c158540 0x7f990c0a56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.452+0000 7f9912a00640 1 --2- 172.21.15.2:0/3785576048 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f98e8065150 0x7f98e8067600 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.452+0000 7f9912a00640 1 --2- 172.21.15.2:0/3785576048 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f990c0aa160 0x7f990c158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.452+0000 7f9912a00640 1 --2- 172.21.15.2:0/3785576048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f0004cc0 0x7f990c0a9c20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.452+0000 7f9912a00640 1 -- 172.21.15.2:0/3785576048 >> 172.21.15.2:0/3785576048 conn(0x7f990c0cc390 msgr2=0x7f990c156170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:46.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.452+0000 7f9912a00640 1 -- 172.21.15.2:0/3785576048 shutdown_connections 2024-08-17T02:23:46.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.452+0000 7f9912a00640 1 -- 172.21.15.2:0/3785576048 wait complete. 2024-08-17T02:23:46.467 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:23:46.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.620+0000 7f5e84e00640 1 Processor -- start 2024-08-17T02:23:46.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.620+0000 7f5e84e00640 1 -- start start 2024-08-17T02:23:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.621+0000 7f5e84e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5e80159120 0x7f5e800ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.621+0000 7f5e84e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e800abe30 0x7f5e800aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.621+0000 7f5e84e00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e800a96c0 con 0x7f5e80158d50 2024-08-17T02:23:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.621+0000 7f5e84e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e800ac270 con 0x7f5e80159120 2024-08-17T02:23:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.621+0000 7f5e84e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e800acf00 con 0x7f5e800abe30 2024-08-17T02:23:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.621+0000 7f5e7d400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5e80159120 0x7f5e800ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.621+0000 7f5e7d400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5e80159120 0x7f5e800ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47070/0 (socket says 172.21.15.2:47070) 2024-08-17T02:23:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.621+0000 7f5e7d400640 1 -- 172.21.15.2:0/879036258 learned_addr learned my addr 172.21.15.2:0/879036258 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.621+0000 7f5e7e800640 1 --2- 172.21.15.2:0/879036258 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e800abe30 0x7f5e800aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.622+0000 7f5e7d400640 1 -- 172.21.15.2:0/879036258 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e800abe30 msgr2=0x7f5e800aa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.622+0000 7f5e7d400640 1 --2- 172.21.15.2:0/879036258 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e800abe30 0x7f5e800aa3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.622+0000 7f5e7d400640 1 -- 172.21.15.2:0/879036258 >> v1:172.21.15.145:6789/0 conn(0x7f5e80158d50 legacy=0x7f5e800ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.622+0000 7f5e7d400640 1 -- 172.21.15.2:0/879036258 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e800af7d0 con 0x7f5e80159120 2024-08-17T02:23:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.623+0000 7f5e7d400640 1 --2- 172.21.15.2:0/879036258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e80159120 0x7f5e800ab8f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c009910 tx=0x7f5e6c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d076aafcfe2028 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.623+0000 7f5e7ca00640 1 -- 172.21.15.2:0/879036258 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c02adb0 con 0x7f5e80159120 2024-08-17T02:23:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.623+0000 7f5e7ca00640 1 -- 172.21.15.2:0/879036258 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c032440 con 0x7f5e80159120 2024-08-17T02:23:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.623+0000 7f5e7ca00640 1 -- 172.21.15.2:0/879036258 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c032820 con 0x7f5e80159120 2024-08-17T02:23:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.623+0000 7f5e84e00640 1 -- 172.21.15.2:0/879036258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e80159120 msgr2=0x7f5e800ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.623+0000 7f5e84e00640 1 --2- 172.21.15.2:0/879036258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e80159120 0x7f5e800ab8f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c009910 tx=0x7f5e6c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.624+0000 7f5e84e00640 1 -- 172.21.15.2:0/879036258 shutdown_connections 2024-08-17T02:23:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.624+0000 7f5e84e00640 1 --2- 172.21.15.2:0/879036258 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e800abe30 0x7f5e800aa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.624+0000 7f5e84e00640 1 --2- 172.21.15.2:0/879036258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e80159120 0x7f5e800ab8f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.624+0000 7f5e84e00640 1 -- 172.21.15.2:0/879036258 >> 172.21.15.2:0/879036258 conn(0x7f5e80095a70 msgr2=0x7f5e80095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.624+0000 7f5e84e00640 1 -- 172.21.15.2:0/879036258 shutdown_connections 2024-08-17T02:23:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.624+0000 7f5e84e00640 1 -- 172.21.15.2:0/879036258 wait complete. 2024-08-17T02:23:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.625+0000 7f5e84e00640 1 Processor -- start 2024-08-17T02:23:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.625+0000 7f5e84e00640 1 -- start start 2024-08-17T02:23:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.626+0000 7f5e84e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e800abe30 0x7f5e800972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.626+0000 7f5e84e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e80158d50 0x7f5e80152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.626+0000 7f5e84e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e80159120 0x7f5e800b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.626+0000 7f5e84e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e80097a00 con 0x7f5e80158d50 2024-08-17T02:23:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.626+0000 7f5e84e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e80099970 con 0x7f5e80159120 2024-08-17T02:23:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.626+0000 7f5e84e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e800977f0 con 0x7f5e800abe30 2024-08-17T02:23:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.626+0000 7f5e7d400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e80158d50 0x7f5e80152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.626+0000 7f5e7d400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e80158d50 0x7f5e80152560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47082/0 (socket says 172.21.15.2:47082) 2024-08-17T02:23:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.626+0000 7f5e7d400640 1 -- 172.21.15.2:0/3464162833 learned_addr learned my addr 172.21.15.2:0/3464162833 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.626+0000 7f5e7e800640 1 --2- 172.21.15.2:0/3464162833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e80159120 0x7f5e800b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.626+0000 7f5e7de00640 1 --2- 172.21.15.2:0/3464162833 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e800abe30 0x7f5e800972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.627+0000 7f5e7d400640 1 -- 172.21.15.2:0/3464162833 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e800abe30 msgr2=0x7f5e800972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.627+0000 7f5e7d400640 1 --2- 172.21.15.2:0/3464162833 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e800abe30 0x7f5e800972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.627+0000 7f5e7d400640 1 -- 172.21.15.2:0/3464162833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e80159120 msgr2=0x7f5e800b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.627+0000 7f5e7d400640 1 --2- 172.21.15.2:0/3464162833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e80159120 0x7f5e800b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.627+0000 7f5e7d400640 1 -- 172.21.15.2:0/3464162833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c009450 con 0x7f5e80158d50 2024-08-17T02:23:46.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.627+0000 7f5e7d400640 1 --2- 172.21.15.2:0/3464162833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e80158d50 0x7f5e80152560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c009210 tx=0x7f5e6c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:46.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.627+0000 7f5e75600640 1 -- 172.21.15.2:0/3464162833 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c000d10 con 0x7f5e80158d50 2024-08-17T02:23:46.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.627+0000 7f5e75600640 1 -- 172.21.15.2:0/3464162833 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c031de0 con 0x7f5e80158d50 2024-08-17T02:23:46.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.627+0000 7f5e75600640 1 -- 172.21.15.2:0/3464162833 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c03d670 con 0x7f5e80158d50 2024-08-17T02:23:46.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.627+0000 7f5e84e00640 1 -- 172.21.15.2:0/3464162833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e8009a490 con 0x7f5e80158d50 2024-08-17T02:23:46.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.627+0000 7f5e84e00640 1 -- 172.21.15.2:0/3464162833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e80099e40 con 0x7f5e80158d50 2024-08-17T02:23:46.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.629+0000 7f5e84e00640 1 -- 172.21.15.2:0/3464162833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e80063fb0 con 0x7f5e80158d50 2024-08-17T02:23:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.629+0000 7f5e75600640 1 -- 172.21.15.2:0/3464162833 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5e6c039040 con 0x7f5e80158d50 2024-08-17T02:23:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.630+0000 7f5e75600640 1 --2- 172.21.15.2:0/3464162833 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5e60065180 0x7f5e60067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.630+0000 7f5e75600640 1 -- 172.21.15.2:0/3464162833 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5e6c0a2320 con 0x7f5e80158d50 2024-08-17T02:23:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.631+0000 7f5e7de00640 1 --2- 172.21.15.2:0/3464162833 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5e60065180 0x7f5e60067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.631+0000 7f5e7de00640 1 --2- 172.21.15.2:0/3464162833 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5e60065180 0x7f5e60067630 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5e70007fd0 tx=0x7f5e70007e30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:46.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.634+0000 7f5e75600640 1 -- 172.21.15.2:0/3464162833 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5e6c070490 con 0x7f5e80158d50 2024-08-17T02:23:46.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.815+0000 7f5e84e00640 1 -- 172.21.15.2:0/3464162833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5e800b28f0 con 0x7f5e80158d50 2024-08-17T02:23:46.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.816+0000 7f5e75600640 1 -- 172.21.15.2:0/3464162833 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5e6c073ab0 con 0x7f5e80158d50 2024-08-17T02:23:46.817 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:23:46.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.818+0000 7f5e84e00640 1 -- 172.21.15.2:0/3464162833 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5e60065180 msgr2=0x7f5e60067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.818+0000 7f5e84e00640 1 --2- 172.21.15.2:0/3464162833 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5e60065180 0x7f5e60067630 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5e70007fd0 tx=0x7f5e70007e30 comp rx=0 tx=0).stop 2024-08-17T02:23:46.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.818+0000 7f5e84e00640 1 -- 172.21.15.2:0/3464162833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e80158d50 msgr2=0x7f5e80152560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.818+0000 7f5e84e00640 1 --2- 172.21.15.2:0/3464162833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e80158d50 0x7f5e80152560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c009210 tx=0x7f5e6c032000 comp rx=0 tx=0).stop 2024-08-17T02:23:46.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.818+0000 7f5e84e00640 1 -- 172.21.15.2:0/3464162833 shutdown_connections 2024-08-17T02:23:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.818+0000 7f5e84e00640 1 --2- 172.21.15.2:0/3464162833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e80159120 0x7f5e800b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.818+0000 7f5e84e00640 1 --2- 172.21.15.2:0/3464162833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e80158d50 0x7f5e80152560 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.818+0000 7f5e84e00640 1 --2- 172.21.15.2:0/3464162833 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5e60065180 0x7f5e60067630 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.818+0000 7f5e84e00640 1 --2- 172.21.15.2:0/3464162833 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e800abe30 0x7f5e800972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.818+0000 7f5e84e00640 1 -- 172.21.15.2:0/3464162833 >> 172.21.15.2:0/3464162833 conn(0x7f5e80095a70 msgr2=0x7f5e800b21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.818+0000 7f5e84e00640 1 -- 172.21.15.2:0/3464162833 shutdown_connections 2024-08-17T02:23:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.818+0000 7f5e84e00640 1 -- 172.21.15.2:0/3464162833 wait complete. 2024-08-17T02:23:46.834 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:23:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.988+0000 7fa6c2000640 1 Processor -- start 2024-08-17T02:23:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.988+0000 7fa6c2000640 1 -- start start 2024-08-17T02:23:46.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.989+0000 7fa6c2000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6bc158b90 0x7fa6bc0b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.989+0000 7fa6c2000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6bc0afd20 con 0x7fa6bc0af130 2024-08-17T02:23:46.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.989+0000 7fa6c2000640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6bc0affe0 con 0x7fa6bc0b2370 2024-08-17T02:23:46.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.989+0000 7fa6c2000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc0b02c0 con 0x7fa6bc158b90 2024-08-17T02:23:46.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.989+0000 7fa6bbe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa6bc0af130 0x7fa6bc0ca8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58670/0 (socket says 172.21.15.2:58670) 2024-08-17T02:23:46.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.989+0000 7fa6bbe00640 1 -- 172.21.15.2:0/1097606219 learned_addr learned my addr 172.21.15.2:0/1097606219 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:46.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.990+0000 7fa6bb400640 1 --2- 172.21.15.2:0/1097606219 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6bc158b90 0x7fa6bc0b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.990+0000 7fa6ba000640 1 -- 172.21.15.2:0/1097606219 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375056172 0 0) 0x7fa6bc0afd20 con 0x7fa6bc0af130 2024-08-17T02:23:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.990+0000 7fa6ba000640 1 -- 172.21.15.2:0/1097606219 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6a00034e0 con 0x7fa6bc0af130 2024-08-17T02:23:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.990+0000 7fa6ba000640 1 -- 172.21.15.2:0/1097606219 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041528277 0 0) 0x7fa6bc0affe0 con 0x7fa6bc0b2370 2024-08-17T02:23:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.990+0000 7fa6ba000640 1 -- 172.21.15.2:0/1097606219 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6bc0afd20 con 0x7fa6bc0b2370 2024-08-17T02:23:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.990+0000 7fa6bb400640 1 -- 172.21.15.2:0/1097606219 >> v1:172.21.15.145:6789/0 conn(0x7fa6bc0b2370 legacy=0x7fa6bc0aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.990+0000 7fa6bb400640 1 -- 172.21.15.2:0/1097606219 >> v1:172.21.15.2:6789/0 conn(0x7fa6bc0af130 legacy=0x7fa6bc0ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.990+0000 7fa6bb400640 1 -- 172.21.15.2:0/1097606219 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6bc0ca3c0 con 0x7fa6bc158b90 2024-08-17T02:23:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.991+0000 7fa6bb400640 1 --2- 172.21.15.2:0/1097606219 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6bc158b90 0x7fa6bc0b1e30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac009880 tx=0x7fa6ac0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b63ed8a157080b50 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.992+0000 7fa6ba000640 1 -- 172.21.15.2:0/1097606219 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac02ae20 con 0x7fa6bc158b90 2024-08-17T02:23:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.992+0000 7fa6ba000640 1 -- 172.21.15.2:0/1097606219 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ac032440 con 0x7fa6bc158b90 2024-08-17T02:23:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.992+0000 7fa6ba000640 1 -- 172.21.15.2:0/1097606219 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac0327e0 con 0x7fa6bc158b90 2024-08-17T02:23:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.992+0000 7fa6c2000640 1 -- 172.21.15.2:0/1097606219 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6bc158b90 msgr2=0x7fa6bc0b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.992+0000 7fa6c2000640 1 --2- 172.21.15.2:0/1097606219 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6bc158b90 0x7fa6bc0b1e30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac009880 tx=0x7fa6ac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.992+0000 7fa6c2000640 1 -- 172.21.15.2:0/1097606219 shutdown_connections 2024-08-17T02:23:46.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.992+0000 7fa6c2000640 1 --2- 172.21.15.2:0/1097606219 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6bc158b90 0x7fa6bc0b1e30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.992+0000 7fa6c2000640 1 -- 172.21.15.2:0/1097606219 >> 172.21.15.2:0/1097606219 conn(0x7fa6bc06e590 msgr2=0x7fa6bc06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:46.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.992+0000 7fa6c2000640 1 -- 172.21.15.2:0/1097606219 shutdown_connections 2024-08-17T02:23:46.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.992+0000 7fa6c2000640 1 -- 172.21.15.2:0/1097606219 wait complete. 2024-08-17T02:23:46.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.994+0000 7fa6c2000640 1 Processor -- start 2024-08-17T02:23:46.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.994+0000 7fa6c2000640 1 -- start start 2024-08-17T02:23:46.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.995+0000 7fa6c2000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6bc0af130 0x7fa6bc0c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.995+0000 7fa6c2000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6bc0b2370 0x7fa6bc15b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.995+0000 7fa6c2000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6bc158b90 0x7fa6bc159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.995+0000 7fa6c2000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc159a30 con 0x7fa6bc158b90 2024-08-17T02:23:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.995+0000 7fa6c2000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc158880 con 0x7fa6bc0b2370 2024-08-17T02:23:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.995+0000 7fa6c2000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc159100 con 0x7fa6bc0af130 2024-08-17T02:23:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.995+0000 7fa6bbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6bc158b90 0x7fa6bc159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.995+0000 7fa6bbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6bc158b90 0x7fa6bc159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47084/0 (socket says 172.21.15.2:47084) 2024-08-17T02:23:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.995+0000 7fa6bbe00640 1 -- 172.21.15.2:0/514443802 learned_addr learned my addr 172.21.15.2:0/514443802 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.995+0000 7fa6bb400640 1 --2- 172.21.15.2:0/514443802 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6bc0af130 0x7fa6bc0c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.995+0000 7fa6baa00640 1 --2- 172.21.15.2:0/514443802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6bc0b2370 0x7fa6bc15b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.995+0000 7fa6bbe00640 1 -- 172.21.15.2:0/514443802 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6bc0af130 msgr2=0x7fa6bc0c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.995+0000 7fa6bbe00640 1 --2- 172.21.15.2:0/514443802 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6bc0af130 0x7fa6bc0c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.995+0000 7fa6bbe00640 1 -- 172.21.15.2:0/514443802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6bc0b2370 msgr2=0x7fa6bc15b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.995+0000 7fa6bbe00640 1 --2- 172.21.15.2:0/514443802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6bc0b2370 0x7fa6bc15b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.995+0000 7fa6bbe00640 1 -- 172.21.15.2:0/514443802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ac009390 con 0x7fa6bc158b90 2024-08-17T02:23:46.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.996+0000 7fa6bbe00640 1 --2- 172.21.15.2:0/514443802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6bc158b90 0x7fa6bc159ec0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4001460 tx=0x7fa6b4001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:46.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.996+0000 7fa6b2a00640 1 -- 172.21.15.2:0/514443802 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b400ce30 con 0x7fa6bc158b90 2024-08-17T02:23:46.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.996+0000 7fa6b2a00640 1 -- 172.21.15.2:0/514443802 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b400a7f0 con 0x7fa6bc158b90 2024-08-17T02:23:46.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.996+0000 7fa6b2a00640 1 -- 172.21.15.2:0/514443802 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b400abb0 con 0x7fa6bc158b90 2024-08-17T02:23:46.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.996+0000 7fa6c2000640 1 -- 172.21.15.2:0/514443802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6bc1593e0 con 0x7fa6bc158b90 2024-08-17T02:23:46.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.996+0000 7fa6c2000640 1 -- 172.21.15.2:0/514443802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6bc15ba50 con 0x7fa6bc158b90 2024-08-17T02:23:46.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.997+0000 7fa6c2000640 1 -- 172.21.15.2:0/514443802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6bc159be0 con 0x7fa6bc158b90 2024-08-17T02:23:46.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.998+0000 7fa6b2a00640 1 -- 172.21.15.2:0/514443802 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa6b40070f0 con 0x7fa6bc158b90 2024-08-17T02:23:47.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.999+0000 7fa6b2a00640 1 --2- 172.21.15.2:0/514443802 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa69c065150 0x7fa69c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.999+0000 7fa6b2a00640 1 -- 172.21.15.2:0/514443802 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa6b4082640 con 0x7fa6bc158b90 2024-08-17T02:23:47.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:46.999+0000 7fa6bb400640 1 --2- 172.21.15.2:0/514443802 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa69c065150 0x7fa69c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.000+0000 7fa6bb400640 1 --2- 172.21.15.2:0/514443802 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa69c065150 0x7fa69c067600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac034000 tx=0x7fa6ac032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:47.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.002+0000 7fa6b2a00640 1 -- 172.21.15.2:0/514443802 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa6b40507a0 con 0x7fa6bc158b90 2024-08-17T02:23:47.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.186+0000 7fa6c2000640 1 -- 172.21.15.2:0/514443802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa6bc063fb0 con 0x7fa6bc158b90 2024-08-17T02:23:47.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.187+0000 7fa6b2a00640 1 -- 172.21.15.2:0/514443802 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa6b4053dc0 con 0x7fa6bc158b90 2024-08-17T02:23:47.188 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-08-17T02:23:47.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.189+0000 7fa6c2000640 1 -- 172.21.15.2:0/514443802 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa69c065150 msgr2=0x7fa69c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.189+0000 7fa6c2000640 1 --2- 172.21.15.2:0/514443802 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa69c065150 0x7fa69c067600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac034000 tx=0x7fa6ac032000 comp rx=0 tx=0).stop 2024-08-17T02:23:47.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.189+0000 7fa6c2000640 1 -- 172.21.15.2:0/514443802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6bc158b90 msgr2=0x7fa6bc159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.189+0000 7fa6c2000640 1 --2- 172.21.15.2:0/514443802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6bc158b90 0x7fa6bc159ec0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4001460 tx=0x7fa6b4001a20 comp rx=0 tx=0).stop 2024-08-17T02:23:47.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.189+0000 7fa6c2000640 1 -- 172.21.15.2:0/514443802 shutdown_connections 2024-08-17T02:23:47.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.189+0000 7fa6c2000640 1 --2- 172.21.15.2:0/514443802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6bc158b90 0x7fa6bc159ec0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.189+0000 7fa6c2000640 1 --2- 172.21.15.2:0/514443802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6bc0b2370 0x7fa6bc15b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.189+0000 7fa6c2000640 1 --2- 172.21.15.2:0/514443802 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa69c065150 0x7fa69c067600 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.189+0000 7fa6c2000640 1 --2- 172.21.15.2:0/514443802 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6bc0af130 0x7fa6bc0c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.189+0000 7fa6c2000640 1 -- 172.21.15.2:0/514443802 >> 172.21.15.2:0/514443802 conn(0x7fa6bc06e590 msgr2=0x7fa6bc0cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:47.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.189+0000 7fa6c2000640 1 -- 172.21.15.2:0/514443802 shutdown_connections 2024-08-17T02:23:47.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.189+0000 7fa6c2000640 1 -- 172.21.15.2:0/514443802 wait complete. 2024-08-17T02:23:47.205 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:23:47.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.355+0000 7f2e67e00640 1 Processor -- start 2024-08-17T02:23:47.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.355+0000 7f2e67e00640 1 -- start start 2024-08-17T02:23:47.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.356+0000 7f2e67e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2e6006e060 0x7f2e6006e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.356+0000 7f2e67e00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2e600af340 0x7f2e600af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.356+0000 7f2e67e00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e600aeeb0 con 0x7f2e60155040 2024-08-17T02:23:47.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.356+0000 7f2e67e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e6006e9f0 con 0x7f2e6006e060 2024-08-17T02:23:47.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.356+0000 7f2e67e00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e600aadd0 con 0x7f2e600af340 2024-08-17T02:23:47.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.356+0000 7f2e64a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2e6006e060 0x7f2e6006e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.356+0000 7f2e64a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2e6006e060 0x7f2e6006e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47094/0 (socket says 172.21.15.2:47094) 2024-08-17T02:23:47.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.356+0000 7f2e64a00640 1 -- 172.21.15.2:0/1507205368 learned_addr learned my addr 172.21.15.2:0/1507205368 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:47.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.357+0000 7f2e65e00640 1 --2- 172.21.15.2:0/1507205368 >> v2:172.21.15.145:3300/0 conn(0x7f2e600af340 0x7f2e600af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.357+0000 7f2e64a00640 1 -- 172.21.15.2:0/1507205368 >> v2:172.21.15.145:3300/0 conn(0x7f2e600af340 msgr2=0x7f2e600af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:47.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.357+0000 7f2e64a00640 1 --2- 172.21.15.2:0/1507205368 >> v2:172.21.15.145:3300/0 conn(0x7f2e600af340 0x7f2e600af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.357+0000 7f2e64a00640 1 -- 172.21.15.2:0/1507205368 >> v1:172.21.15.145:6789/0 conn(0x7f2e60155040 legacy=0x7f2e60158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:47.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.357+0000 7f2e64a00640 1 -- 172.21.15.2:0/1507205368 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e601597f0 con 0x7f2e6006e060 2024-08-17T02:23:47.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.358+0000 7f2e64a00640 1 --2- 172.21.15.2:0/1507205368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e6006e060 0x7f2e6006e4b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2e600ad790 tx=0x7f2e4c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb55e9f91d9facc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:47.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.358+0000 7f2e5fe00640 1 -- 172.21.15.2:0/1507205368 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c02ad40 con 0x7f2e6006e060 2024-08-17T02:23:47.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.358+0000 7f2e5fe00640 1 -- 172.21.15.2:0/1507205368 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c032440 con 0x7f2e6006e060 2024-08-17T02:23:47.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.358+0000 7f2e5fe00640 1 -- 172.21.15.2:0/1507205368 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c02aea0 con 0x7f2e6006e060 2024-08-17T02:23:47.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.358+0000 7f2e67e00640 1 -- 172.21.15.2:0/1507205368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e6006e060 msgr2=0x7f2e6006e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.359+0000 7f2e67e00640 1 --2- 172.21.15.2:0/1507205368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e6006e060 0x7f2e6006e4b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2e600ad790 tx=0x7f2e4c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.359+0000 7f2e67e00640 1 -- 172.21.15.2:0/1507205368 shutdown_connections 2024-08-17T02:23:47.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.359+0000 7f2e67e00640 1 --2- 172.21.15.2:0/1507205368 >> v2:172.21.15.145:3300/0 conn(0x7f2e600af340 0x7f2e600af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.359+0000 7f2e67e00640 1 --2- 172.21.15.2:0/1507205368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e6006e060 0x7f2e6006e4b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.359+0000 7f2e67e00640 1 -- 172.21.15.2:0/1507205368 >> 172.21.15.2:0/1507205368 conn(0x7f2e60066e60 msgr2=0x7f2e60067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:47.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.359+0000 7f2e67e00640 1 -- 172.21.15.2:0/1507205368 shutdown_connections 2024-08-17T02:23:47.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.359+0000 7f2e67e00640 1 -- 172.21.15.2:0/1507205368 wait complete. 2024-08-17T02:23:47.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.360+0000 7f2e67e00640 1 Processor -- start 2024-08-17T02:23:47.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.360+0000 7f2e67e00640 1 -- start start 2024-08-17T02:23:47.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.361+0000 7f2e67e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e6006e060 0x7f2e60156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.361+0000 7f2e67e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e600af340 0x7f2e600a92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.361+0000 7f2e67e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e60155040 0x7f2e60147440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.361+0000 7f2e67e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6014d1b0 con 0x7f2e60155040 2024-08-17T02:23:47.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.361+0000 7f2e67e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e600a9800 con 0x7f2e600af340 2024-08-17T02:23:47.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.361+0000 7f2e67e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6014c9e0 con 0x7f2e6006e060 2024-08-17T02:23:47.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.361+0000 7f2e65e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e60155040 0x7f2e60147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.362+0000 7f2e65e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e60155040 0x7f2e60147440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47102/0 (socket says 172.21.15.2:47102) 2024-08-17T02:23:47.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.362+0000 7f2e65e00640 1 -- 172.21.15.2:0/3572146967 learned_addr learned my addr 172.21.15.2:0/3572146967 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:47.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.362+0000 7f2e65400640 1 --2- 172.21.15.2:0/3572146967 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e6006e060 0x7f2e60156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.362+0000 7f2e64a00640 1 --2- 172.21.15.2:0/3572146967 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e600af340 0x7f2e600a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.362+0000 7f2e65e00640 1 -- 172.21.15.2:0/3572146967 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e6006e060 msgr2=0x7f2e60156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.362+0000 7f2e65e00640 1 --2- 172.21.15.2:0/3572146967 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e6006e060 0x7f2e60156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.362+0000 7f2e65e00640 1 -- 172.21.15.2:0/3572146967 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e600af340 msgr2=0x7f2e600a92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.362+0000 7f2e65e00640 1 --2- 172.21.15.2:0/3572146967 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e600af340 0x7f2e600a92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.362+0000 7f2e65e00640 1 -- 172.21.15.2:0/3572146967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c009450 con 0x7f2e60155040 2024-08-17T02:23:47.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.362+0000 7f2e64a00640 1 --2- 172.21.15.2:0/3572146967 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e600af340 0x7f2e600a92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:47.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.362+0000 7f2e65e00640 1 --2- 172.21.15.2:0/3572146967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e60155040 0x7f2e60147440 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009fa0 tx=0x7f2e58009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:47.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.362+0000 7f2e5cc00640 1 -- 172.21.15.2:0/3572146967 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5800ee60 con 0x7f2e60155040 2024-08-17T02:23:47.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.362+0000 7f2e5cc00640 1 -- 172.21.15.2:0/3572146967 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e58014420 con 0x7f2e60155040 2024-08-17T02:23:47.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.362+0000 7f2e5cc00640 1 -- 172.21.15.2:0/3572146967 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e580147e0 con 0x7f2e60155040 2024-08-17T02:23:47.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.362+0000 7f2e67e00640 1 -- 172.21.15.2:0/3572146967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6014b370 con 0x7f2e60155040 2024-08-17T02:23:47.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.363+0000 7f2e67e00640 1 -- 172.21.15.2:0/3572146967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e60147980 con 0x7f2e60155040 2024-08-17T02:23:47.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.364+0000 7f2e67e00640 1 -- 172.21.15.2:0/3572146967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6014b500 con 0x7f2e60155040 2024-08-17T02:23:47.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.364+0000 7f2e5cc00640 1 -- 172.21.15.2:0/3572146967 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2e58014b50 con 0x7f2e60155040 2024-08-17T02:23:47.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.365+0000 7f2e5cc00640 1 --2- 172.21.15.2:0/3572146967 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2e40065150 0x7f2e40067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.365+0000 7f2e5cc00640 1 -- 172.21.15.2:0/3572146967 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2e58082d60 con 0x7f2e60155040 2024-08-17T02:23:47.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.365+0000 7f2e65400640 1 --2- 172.21.15.2:0/3572146967 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2e40065150 0x7f2e40067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.366+0000 7f2e65400640 1 --2- 172.21.15.2:0/3572146967 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2e40065150 0x7f2e40067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2e54003720 tx=0x7f2e54009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:47.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.369+0000 7f2e5cc00640 1 -- 172.21.15.2:0/3572146967 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2e58050d80 con 0x7f2e60155040 2024-08-17T02:23:47.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.588+0000 7f2e67e00640 1 -- 172.21.15.2:0/3572146967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e60063fb0 con 0x7f2e60155040 2024-08-17T02:23:47.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.589+0000 7f2e5cc00640 1 -- 172.21.15.2:0/3572146967 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f2e580543a0 con 0x7f2e60155040 2024-08-17T02:23:47.590 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:47.590 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/88006300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":88006300},{"type":"v1","addr":"172.21.15.2:6835","nonce":88006300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3374741059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3374741059},{"type":"v1","addr":"172.21.15.2:6833","nonce":3374741059}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/3494373963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":3494373963},{"type":"v1","addr":"172.21.15.145:6837","nonce":3494373963}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:31.378654+0000","modified":"2024-08-17T02:23:34.968351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6836/3984927211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3984927211},{"type":"v1","addr":"172.21.15.145:6836","nonce":3984927211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:23:47.591 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2024-08-17T02:23:47.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.591+0000 7f2e67e00640 1 -- 172.21.15.2:0/3572146967 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2e40065150 msgr2=0x7f2e40067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.591+0000 7f2e67e00640 1 --2- 172.21.15.2:0/3572146967 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2e40065150 0x7f2e40067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2e54003720 tx=0x7f2e54009040 comp rx=0 tx=0).stop 2024-08-17T02:23:47.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.591+0000 7f2e67e00640 1 -- 172.21.15.2:0/3572146967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e60155040 msgr2=0x7f2e60147440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.591+0000 7f2e67e00640 1 --2- 172.21.15.2:0/3572146967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e60155040 0x7f2e60147440 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009fa0 tx=0x7f2e58009900 comp rx=0 tx=0).stop 2024-08-17T02:23:47.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.591+0000 7f2e67e00640 1 -- 172.21.15.2:0/3572146967 shutdown_connections 2024-08-17T02:23:47.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.591+0000 7f2e67e00640 1 --2- 172.21.15.2:0/3572146967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e60155040 0x7f2e60147440 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.591+0000 7f2e67e00640 1 --2- 172.21.15.2:0/3572146967 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e600af340 0x7f2e600a92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.591+0000 7f2e67e00640 1 --2- 172.21.15.2:0/3572146967 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2e40065150 0x7f2e40067600 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.591+0000 7f2e67e00640 1 --2- 172.21.15.2:0/3572146967 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e6006e060 0x7f2e60156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.591+0000 7f2e67e00640 1 -- 172.21.15.2:0/3572146967 >> 172.21.15.2:0/3572146967 conn(0x7f2e60066e60 msgr2=0x7f2e6006b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:47.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.591+0000 7f2e67e00640 1 -- 172.21.15.2:0/3572146967 shutdown_connections 2024-08-17T02:23:47.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.592+0000 7f2e67e00640 1 -- 172.21.15.2:0/3572146967 wait complete. 2024-08-17T02:23:47.607 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:47.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.757+0000 7ff712400640 1 Processor -- start 2024-08-17T02:23:47.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.758+0000 7ff712400640 1 -- start start 2024-08-17T02:23:47.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.759+0000 7ff712400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff70c0ad790 0x7ff70c0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.759+0000 7ff712400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff70c1559e0 0x7ff70c0ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.759+0000 7ff712400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff70c0ca6b0 con 0x7ff70c0c9d20 2024-08-17T02:23:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.759+0000 7ff712400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff70c0cb180 con 0x7ff70c0ad790 2024-08-17T02:23:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.759+0000 7ff712400640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff70c0af530 con 0x7ff70c1559e0 2024-08-17T02:23:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.759+0000 7ff711000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff70c0ad790 0x7ff70c0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.759+0000 7ff711000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff70c0ad790 0x7ff70c0adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47110/0 (socket says 172.21.15.2:47110) 2024-08-17T02:23:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.759+0000 7ff711000640 1 -- 172.21.15.2:0/4247396386 learned_addr learned my addr 172.21.15.2:0/4247396386 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.759+0000 7ff711a00640 1 --2- 172.21.15.2:0/4247396386 >> v2:172.21.15.145:3300/0 conn(0x7ff70c1559e0 0x7ff70c0ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.759+0000 7ff711000640 1 -- 172.21.15.2:0/4247396386 >> v2:172.21.15.145:3300/0 conn(0x7ff70c1559e0 msgr2=0x7ff70c0ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.759+0000 7ff711000640 1 --2- 172.21.15.2:0/4247396386 >> v2:172.21.15.145:3300/0 conn(0x7ff70c1559e0 0x7ff70c0ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.759+0000 7ff711000640 1 -- 172.21.15.2:0/4247396386 >> v1:172.21.15.2:6789/0 conn(0x7ff70c0c9d20 legacy=0x7ff70c1552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.759+0000 7ff711000640 1 -- 172.21.15.2:0/4247396386 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70c0ca8e0 con 0x7ff70c0ad790 2024-08-17T02:23:47.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.761+0000 7ff711000640 1 --2- 172.21.15.2:0/4247396386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff70c0ad790 0x7ff70c0adb60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0af4a0 tx=0x7ff7000091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185a252d2b156249 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:47.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.761+0000 7ff70b400640 1 -- 172.21.15.2:0/4247396386 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70002add0 con 0x7ff70c0ad790 2024-08-17T02:23:47.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.761+0000 7ff70b400640 1 -- 172.21.15.2:0/4247396386 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff700032440 con 0x7ff70c0ad790 2024-08-17T02:23:47.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.761+0000 7ff70b400640 1 -- 172.21.15.2:0/4247396386 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff700032820 con 0x7ff70c0ad790 2024-08-17T02:23:47.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.761+0000 7ff712400640 1 -- 172.21.15.2:0/4247396386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff70c0ad790 msgr2=0x7ff70c0adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.761+0000 7ff712400640 1 --2- 172.21.15.2:0/4247396386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff70c0ad790 0x7ff70c0adb60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0af4a0 tx=0x7ff7000091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.762+0000 7ff712400640 1 -- 172.21.15.2:0/4247396386 shutdown_connections 2024-08-17T02:23:47.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.762+0000 7ff712400640 1 --2- 172.21.15.2:0/4247396386 >> v2:172.21.15.145:3300/0 conn(0x7ff70c1559e0 0x7ff70c0ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.762+0000 7ff712400640 1 --2- 172.21.15.2:0/4247396386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff70c0ad790 0x7ff70c0adb60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.762+0000 7ff712400640 1 -- 172.21.15.2:0/4247396386 >> 172.21.15.2:0/4247396386 conn(0x7ff70c062af0 msgr2=0x7ff70c062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:47.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.762+0000 7ff712400640 1 -- 172.21.15.2:0/4247396386 shutdown_connections 2024-08-17T02:23:47.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.762+0000 7ff712400640 1 -- 172.21.15.2:0/4247396386 wait complete. 2024-08-17T02:23:47.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.763+0000 7ff712400640 1 Processor -- start 2024-08-17T02:23:47.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.763+0000 7ff712400640 1 -- start start 2024-08-17T02:23:47.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.764+0000 7ff712400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff70c0ad790 0x7ff70c151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.764+0000 7ff712400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff70c0c9d20 0x7ff70c15b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.764+0000 7ff712400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff70c1559e0 0x7ff70c15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.764+0000 7ff712400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70c0a8b90 con 0x7ff70c0c9d20 2024-08-17T02:23:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.764+0000 7ff712400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70c15b580 con 0x7ff70c0ad790 2024-08-17T02:23:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.764+0000 7ff712400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff70c15ace0 con 0x7ff70c1559e0 2024-08-17T02:23:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.764+0000 7ff70be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff70c0c9d20 0x7ff70c15b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.764+0000 7ff70be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff70c0c9d20 0x7ff70c15b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47122/0 (socket says 172.21.15.2:47122) 2024-08-17T02:23:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.764+0000 7ff70be00640 1 -- 172.21.15.2:0/1204422786 learned_addr learned my addr 172.21.15.2:0/1204422786 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.764+0000 7ff711a00640 1 --2- 172.21.15.2:0/1204422786 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff70c1559e0 0x7ff70c15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.764+0000 7ff711000640 1 --2- 172.21.15.2:0/1204422786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff70c0ad790 0x7ff70c151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.765+0000 7ff70be00640 1 -- 172.21.15.2:0/1204422786 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff70c1559e0 msgr2=0x7ff70c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.765+0000 7ff70be00640 1 --2- 172.21.15.2:0/1204422786 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff70c1559e0 0x7ff70c15bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.765+0000 7ff70be00640 1 -- 172.21.15.2:0/1204422786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff70c0ad790 msgr2=0x7ff70c151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.765+0000 7ff70be00640 1 --2- 172.21.15.2:0/1204422786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff70c0ad790 0x7ff70c151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.765+0000 7ff70be00640 1 -- 172.21.15.2:0/1204422786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff700009450 con 0x7ff70c0c9d20 2024-08-17T02:23:47.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.765+0000 7ff711000640 1 --2- 172.21.15.2:0/1204422786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff70c0ad790 0x7ff70c151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:47.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.765+0000 7ff70be00640 1 --2- 172.21.15.2:0/1204422786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff70c0c9d20 0x7ff70c15b9a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800c590 tx=0x7ff6f8007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:47.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.765+0000 7ff6ffe00640 1 -- 172.21.15.2:0/1204422786 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8012630 con 0x7ff70c0c9d20 2024-08-17T02:23:47.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.765+0000 7ff6ffe00640 1 -- 172.21.15.2:0/1204422786 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f80127b0 con 0x7ff70c0c9d20 2024-08-17T02:23:47.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.765+0000 7ff6ffe00640 1 -- 172.21.15.2:0/1204422786 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8012b70 con 0x7ff70c0c9d20 2024-08-17T02:23:47.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.765+0000 7ff712400640 1 -- 172.21.15.2:0/1204422786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff70c15afc0 con 0x7ff70c0c9d20 2024-08-17T02:23:47.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.765+0000 7ff712400640 1 -- 172.21.15.2:0/1204422786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff70c152300 con 0x7ff70c0c9d20 2024-08-17T02:23:47.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.766+0000 7ff712400640 1 -- 172.21.15.2:0/1204422786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff70c0a8d00 con 0x7ff70c0c9d20 2024-08-17T02:23:47.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.767+0000 7ff6ffe00640 1 -- 172.21.15.2:0/1204422786 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff6f801b400 con 0x7ff70c0c9d20 2024-08-17T02:23:47.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.768+0000 7ff6ffe00640 1 --2- 172.21.15.2:0/1204422786 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7ff6ec065150 0x7ff6ec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.768+0000 7ff6ffe00640 1 -- 172.21.15.2:0/1204422786 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff6f8081fe0 con 0x7ff70c0c9d20 2024-08-17T02:23:47.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.769+0000 7ff711000640 1 --2- 172.21.15.2:0/1204422786 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7ff6ec065150 0x7ff6ec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.769+0000 7ff711000640 1 --2- 172.21.15.2:0/1204422786 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7ff6ec065150 0x7ff6ec067600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff700034000 tx=0x7ff700032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:47.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.772+0000 7ff6ffe00640 1 -- 172.21.15.2:0/1204422786 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff70c0a8d00 con 0x7ff70c0c9d20 2024-08-17T02:23:47.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.953+0000 7ff712400640 1 -- 172.21.15.2:0/1204422786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff70c0a8cd0 con 0x7ff70c0c9d20 2024-08-17T02:23:47.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.954+0000 7ff6ffe00640 1 -- 172.21.15.2:0/1204422786 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7ff6f8050000 con 0x7ff70c0c9d20 2024-08-17T02:23:47.956 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:47.956 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:23:32.955197+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:29.708835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:30.361908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:47.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.956+0000 7ff712400640 1 -- 172.21.15.2:0/1204422786 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7ff6ec065150 msgr2=0x7ff6ec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.956+0000 7ff712400640 1 --2- 172.21.15.2:0/1204422786 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7ff6ec065150 0x7ff6ec067600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff700034000 tx=0x7ff700032000 comp rx=0 tx=0).stop 2024-08-17T02:23:47.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.956+0000 7ff712400640 1 -- 172.21.15.2:0/1204422786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff70c0c9d20 msgr2=0x7ff70c15b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.956+0000 7ff712400640 1 --2- 172.21.15.2:0/1204422786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff70c0c9d20 0x7ff70c15b9a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800c590 tx=0x7ff6f8007ef0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.956+0000 7ff712400640 1 -- 172.21.15.2:0/1204422786 shutdown_connections 2024-08-17T02:23:47.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.956+0000 7ff712400640 1 --2- 172.21.15.2:0/1204422786 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7ff6ec065150 0x7ff6ec067600 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.956+0000 7ff712400640 1 --2- 172.21.15.2:0/1204422786 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff70c1559e0 0x7ff70c15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.956+0000 7ff712400640 1 --2- 172.21.15.2:0/1204422786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff70c0c9d20 0x7ff70c15b9a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.956+0000 7ff712400640 1 --2- 172.21.15.2:0/1204422786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff70c0ad790 0x7ff70c151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.956+0000 7ff712400640 1 -- 172.21.15.2:0/1204422786 >> 172.21.15.2:0/1204422786 conn(0x7ff70c062af0 msgr2=0x7ff70c155ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:47.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.956+0000 7ff712400640 1 -- 172.21.15.2:0/1204422786 shutdown_connections 2024-08-17T02:23:47.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:47.956+0000 7ff712400640 1 -- 172.21.15.2:0/1204422786 wait complete. 2024-08-17T02:23:47.975 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:23:48.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.127+0000 7f14a3200640 1 Processor -- start 2024-08-17T02:23:48.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.127+0000 7f14a3200640 1 -- start start 2024-08-17T02:23:48.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.128+0000 7f14a3200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f149c158c60 0x7f149c15a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.128+0000 7f14a3200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f149c159030 0x7f149c0ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.128+0000 7f14a3200640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149c15b6b0 con 0x7f149c0b1920 2024-08-17T02:23:48.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.128+0000 7f14a3200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149c0b0540 con 0x7f149c158c60 2024-08-17T02:23:48.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.128+0000 7f14a3200640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149c15aac0 con 0x7f149c159030 2024-08-17T02:23:48.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.128+0000 7f14a1e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f149c158c60 0x7f149c15a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.129+0000 7f14a1e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f149c158c60 0x7f149c15a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47126/0 (socket says 172.21.15.2:47126) 2024-08-17T02:23:48.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.129+0000 7f14a1e00640 1 -- 172.21.15.2:0/1029295489 learned_addr learned my addr 172.21.15.2:0/1029295489 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:48.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.129+0000 7f14a1400640 1 --2- 172.21.15.2:0/1029295489 >> v2:172.21.15.145:3300/0 conn(0x7f149c159030 0x7f149c0ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.129+0000 7f14a1e00640 1 -- 172.21.15.2:0/1029295489 >> v2:172.21.15.145:3300/0 conn(0x7f149c159030 msgr2=0x7f149c0ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:48.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.129+0000 7f14a1e00640 1 --2- 172.21.15.2:0/1029295489 >> v2:172.21.15.145:3300/0 conn(0x7f149c159030 0x7f149c0ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.129+0000 7f14a1e00640 1 -- 172.21.15.2:0/1029295489 >> v1:172.21.15.145:6789/0 conn(0x7f149c0b1920 legacy=0x7f149c0b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.129+0000 7f14a1e00640 1 -- 172.21.15.2:0/1029295489 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c15ad80 con 0x7f149c158c60 2024-08-17T02:23:48.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.130+0000 7f14a1e00640 1 --2- 172.21.15.2:0/1029295489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149c158c60 0x7f149c15a490 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f149c0cd4d0 tx=0x7f14900091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634c940c63e69d91 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:48.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.130+0000 7f14a0a00640 1 -- 172.21.15.2:0/1029295489 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149002ae80 con 0x7f149c158c60 2024-08-17T02:23:48.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.130+0000 7f14a0a00640 1 -- 172.21.15.2:0/1029295489 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1490032440 con 0x7f149c158c60 2024-08-17T02:23:48.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.130+0000 7f14a0a00640 1 -- 172.21.15.2:0/1029295489 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1490032800 con 0x7f149c158c60 2024-08-17T02:23:48.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.131+0000 7f14a3200640 1 -- 172.21.15.2:0/1029295489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149c158c60 msgr2=0x7f149c15a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.131+0000 7f14a3200640 1 --2- 172.21.15.2:0/1029295489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149c158c60 0x7f149c15a490 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f149c0cd4d0 tx=0x7f14900091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.131+0000 7f14a3200640 1 -- 172.21.15.2:0/1029295489 shutdown_connections 2024-08-17T02:23:48.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.131+0000 7f14a3200640 1 --2- 172.21.15.2:0/1029295489 >> v2:172.21.15.145:3300/0 conn(0x7f149c159030 0x7f149c0ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.131+0000 7f14a3200640 1 --2- 172.21.15.2:0/1029295489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149c158c60 0x7f149c15a490 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.131+0000 7f14a3200640 1 -- 172.21.15.2:0/1029295489 >> 172.21.15.2:0/1029295489 conn(0x7f149c06e590 msgr2=0x7f149c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:48.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.131+0000 7f14a3200640 1 -- 172.21.15.2:0/1029295489 shutdown_connections 2024-08-17T02:23:48.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.131+0000 7f14a3200640 1 -- 172.21.15.2:0/1029295489 wait complete. 2024-08-17T02:23:48.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.132+0000 7f14a3200640 1 Processor -- start 2024-08-17T02:23:48.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.133+0000 7f14a3200640 1 -- start start 2024-08-17T02:23:48.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.133+0000 7f14a3200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f149c0b1920 0x7f149c154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.133+0000 7f14a3200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f149c158c60 0x7f149c0c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.133+0000 7f14a3200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149c159030 0x7f149c0c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.134+0000 7f14a3200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c0b4760 con 0x7f149c159030 2024-08-17T02:23:48.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.134+0000 7f14a3200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c0c8bd0 con 0x7f149c0b1920 2024-08-17T02:23:48.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.134+0000 7f14a3200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149c0b41a0 con 0x7f149c158c60 2024-08-17T02:23:48.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.134+0000 7f14a2800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149c159030 0x7f149c0c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.134+0000 7f14a2800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149c159030 0x7f149c0c7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47142/0 (socket says 172.21.15.2:47142) 2024-08-17T02:23:48.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.134+0000 7f14a2800640 1 -- 172.21.15.2:0/2340334857 learned_addr learned my addr 172.21.15.2:0/2340334857 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:48.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.134+0000 7f14a1e00640 1 --2- 172.21.15.2:0/2340334857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f149c0b1920 0x7f149c154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.134+0000 7f14a1400640 1 --2- 172.21.15.2:0/2340334857 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f149c158c60 0x7f149c0c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.134+0000 7f14a2800640 1 -- 172.21.15.2:0/2340334857 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f149c158c60 msgr2=0x7f149c0c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.134+0000 7f14a2800640 1 --2- 172.21.15.2:0/2340334857 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f149c158c60 0x7f149c0c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.134+0000 7f14a2800640 1 -- 172.21.15.2:0/2340334857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f149c0b1920 msgr2=0x7f149c154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.134+0000 7f14a2800640 1 --2- 172.21.15.2:0/2340334857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f149c0b1920 0x7f149c154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.134+0000 7f14a2800640 1 -- 172.21.15.2:0/2340334857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1490009450 con 0x7f149c159030 2024-08-17T02:23:48.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.134+0000 7f14a2800640 1 --2- 172.21.15.2:0/2340334857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149c159030 0x7f149c0c7bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f149800c7f0 tx=0x7f14980015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:48.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.135+0000 7f1495600640 1 -- 172.21.15.2:0/2340334857 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149800a640 con 0x7f149c159030 2024-08-17T02:23:48.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.135+0000 7f1495600640 1 -- 172.21.15.2:0/2340334857 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149800a7c0 con 0x7f149c159030 2024-08-17T02:23:48.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.135+0000 7f1495600640 1 -- 172.21.15.2:0/2340334857 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149800ab80 con 0x7f149c159030 2024-08-17T02:23:48.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.135+0000 7f14a3200640 1 -- 172.21.15.2:0/2340334857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149c0b4480 con 0x7f149c159030 2024-08-17T02:23:48.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.135+0000 7f14a3200640 1 -- 172.21.15.2:0/2340334857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149c155100 con 0x7f149c159030 2024-08-17T02:23:48.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.136+0000 7f14a3200640 1 -- 172.21.15.2:0/2340334857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f149c0cb950 con 0x7f149c159030 2024-08-17T02:23:48.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.137+0000 7f1495600640 1 -- 172.21.15.2:0/2340334857 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1498003030 con 0x7f149c159030 2024-08-17T02:23:48.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.137+0000 7f1495600640 1 --2- 172.21.15.2:0/2340334857 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1480065150 0x7f1480067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.137+0000 7f1495600640 1 -- 172.21.15.2:0/2340334857 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f14980824e0 con 0x7f149c159030 2024-08-17T02:23:48.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.138+0000 7f14a1e00640 1 --2- 172.21.15.2:0/2340334857 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1480065150 0x7f1480067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.138+0000 7f14a1e00640 1 --2- 172.21.15.2:0/2340334857 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1480065150 0x7f1480067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1490034000 tx=0x7f1490032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:48.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.141+0000 7f1495600640 1 -- 172.21.15.2:0/2340334857 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f149c0cb950 con 0x7f149c159030 2024-08-17T02:23:48.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.360+0000 7f14a3200640 1 -- 172.21.15.2:0/2340334857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f149c0cb950 con 0x7f149c159030 2024-08-17T02:23:48.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.361+0000 7f1495600640 1 -- 172.21.15.2:0/2340334857 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f149c0cb950 con 0x7f149c159030 2024-08-17T02:23:48.362 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:48.362 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/88006300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":88006300},{"type":"v1","addr":"172.21.15.2:6835","nonce":88006300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3374741059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3374741059},{"type":"v1","addr":"172.21.15.2:6833","nonce":3374741059}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/3494373963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":3494373963},{"type":"v1","addr":"172.21.15.145:6837","nonce":3494373963}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:31.378654+0000","modified":"2024-08-17T02:23:34.968351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6836/3984927211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3984927211},{"type":"v1","addr":"172.21.15.145:6836","nonce":3984927211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:23:48.363 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2024-08-17T02:23:48.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.363+0000 7f14a3200640 1 -- 172.21.15.2:0/2340334857 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1480065150 msgr2=0x7f1480067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.363+0000 7f14a3200640 1 --2- 172.21.15.2:0/2340334857 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1480065150 0x7f1480067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1490034000 tx=0x7f1490032000 comp rx=0 tx=0).stop 2024-08-17T02:23:48.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.363+0000 7f14a3200640 1 -- 172.21.15.2:0/2340334857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149c159030 msgr2=0x7f149c0c7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.363+0000 7f14a3200640 1 --2- 172.21.15.2:0/2340334857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149c159030 0x7f149c0c7bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f149800c7f0 tx=0x7f14980015f0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.363+0000 7f14a3200640 1 -- 172.21.15.2:0/2340334857 shutdown_connections 2024-08-17T02:23:48.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.363+0000 7f14a3200640 1 --2- 172.21.15.2:0/2340334857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149c159030 0x7f149c0c7bf0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.363+0000 7f14a3200640 1 --2- 172.21.15.2:0/2340334857 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1480065150 0x7f1480067600 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.363+0000 7f14a3200640 1 --2- 172.21.15.2:0/2340334857 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f149c158c60 0x7f149c0c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.363+0000 7f14a3200640 1 --2- 172.21.15.2:0/2340334857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f149c0b1920 0x7f149c154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.363+0000 7f14a3200640 1 -- 172.21.15.2:0/2340334857 >> 172.21.15.2:0/2340334857 conn(0x7f149c06e590 msgr2=0x7f149c157bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:48.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.363+0000 7f14a3200640 1 -- 172.21.15.2:0/2340334857 shutdown_connections 2024-08-17T02:23:48.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.363+0000 7f14a3200640 1 -- 172.21.15.2:0/2340334857 wait complete. 2024-08-17T02:23:48.783 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:23:31.378654+0000', 'modified': '2024-08-17T02:23:34.968351+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4264}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4264': {'gid': 4264, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.145:6836/3984927211', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6834', 'nonce': 3984927211}, {'type': 'v1', 'addr': '172.21.15.145:6836', 'nonce': 3984927211}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:23:48.783 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:23:48.783 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-08-17T02:23:48.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.936+0000 7f0695a00640 1 Processor -- start 2024-08-17T02:23:48.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.936+0000 7f0695a00640 1 -- start start 2024-08-17T02:23:48.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.937+0000 7f0695a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f06900c9ed0 0x7f06900aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.937+0000 7f0695a00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f06900aff50 0x7f06900af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.937+0000 7f0695a00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06900cb180 con 0x7f06900ae8d0 2024-08-17T02:23:48.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.937+0000 7f0695a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06900af720 con 0x7f06900c9ed0 2024-08-17T02:23:48.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.937+0000 7f0695a00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06900ad6b0 con 0x7f06900aff50 2024-08-17T02:23:48.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.938+0000 7f0686000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f06900c9ed0 0x7f06900aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.938+0000 7f0686000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f06900c9ed0 0x7f06900aeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47154/0 (socket says 172.21.15.2:47154) 2024-08-17T02:23:48.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.938+0000 7f0686000640 1 -- 172.21.15.2:0/207386432 learned_addr learned my addr 172.21.15.2:0/207386432 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:48.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.938+0000 7f068f400640 1 --2- 172.21.15.2:0/207386432 >> v2:172.21.15.145:3300/0 conn(0x7f06900aff50 0x7f06900af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.938+0000 7f0686000640 1 -- 172.21.15.2:0/207386432 >> v2:172.21.15.145:3300/0 conn(0x7f06900aff50 msgr2=0x7f06900af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:48.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.938+0000 7f0686000640 1 --2- 172.21.15.2:0/207386432 >> v2:172.21.15.145:3300/0 conn(0x7f06900aff50 0x7f06900af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.938+0000 7f0686000640 1 -- 172.21.15.2:0/207386432 >> v1:172.21.15.145:6789/0 conn(0x7f06900ae8d0 legacy=0x7f06900aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.938+0000 7f0686000640 1 -- 172.21.15.2:0/207386432 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06900ad990 con 0x7f06900c9ed0 2024-08-17T02:23:48.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.939+0000 7f0686000640 1 --2- 172.21.15.2:0/207386432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06900c9ed0 0x7f06900aeca0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f069006f4c0 tx=0x7f06780091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf6e8d31885a221 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:48.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.939+0000 7f068e000640 1 -- 172.21.15.2:0/207386432 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067802ae80 con 0x7f06900c9ed0 2024-08-17T02:23:48.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.940+0000 7f068e000640 1 -- 172.21.15.2:0/207386432 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0678032440 con 0x7f06900c9ed0 2024-08-17T02:23:48.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.940+0000 7f068e000640 1 -- 172.21.15.2:0/207386432 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0678032800 con 0x7f06900c9ed0 2024-08-17T02:23:48.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.940+0000 7f0695a00640 1 -- 172.21.15.2:0/207386432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06900c9ed0 msgr2=0x7f06900aeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.940+0000 7f0695a00640 1 --2- 172.21.15.2:0/207386432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06900c9ed0 0x7f06900aeca0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f069006f4c0 tx=0x7f06780091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.940+0000 7f0695a00640 1 -- 172.21.15.2:0/207386432 shutdown_connections 2024-08-17T02:23:48.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.940+0000 7f0695a00640 1 --2- 172.21.15.2:0/207386432 >> v2:172.21.15.145:3300/0 conn(0x7f06900aff50 0x7f06900af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.940+0000 7f0695a00640 1 --2- 172.21.15.2:0/207386432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06900c9ed0 0x7f06900aeca0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.940+0000 7f0695a00640 1 -- 172.21.15.2:0/207386432 >> 172.21.15.2:0/207386432 conn(0x7f0690066e60 msgr2=0x7f0690067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:48.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.940+0000 7f0695a00640 1 -- 172.21.15.2:0/207386432 shutdown_connections 2024-08-17T02:23:48.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.940+0000 7f0695a00640 1 -- 172.21.15.2:0/207386432 wait complete. 2024-08-17T02:23:48.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.942+0000 7f0695a00640 1 Processor -- start 2024-08-17T02:23:48.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.942+0000 7f0695a00640 1 -- start start 2024-08-17T02:23:48.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.942+0000 7f0695a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06900ae8d0 0x7f06901361a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.943+0000 7f0695a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06900aff50 0x7f06901520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.943+0000 7f0695a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06900c9ed0 0x7f069014b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.943+0000 7f0695a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0690151db0 con 0x7f06900c9ed0 2024-08-17T02:23:48.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.943+0000 7f0695a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069014dd30 con 0x7f06900ae8d0 2024-08-17T02:23:48.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.943+0000 7f0695a00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069014e010 con 0x7f06900aff50 2024-08-17T02:23:48.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.943+0000 7f068f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06900c9ed0 0x7f069014b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.943+0000 7f068f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06900c9ed0 0x7f069014b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47166/0 (socket says 172.21.15.2:47166) 2024-08-17T02:23:48.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.943+0000 7f068f400640 1 -- 172.21.15.2:0/1414121315 learned_addr learned my addr 172.21.15.2:0/1414121315 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:48.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.943+0000 7f068ea00640 1 --2- 172.21.15.2:0/1414121315 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06900ae8d0 0x7f06901361a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.943+0000 7f0686000640 1 --2- 172.21.15.2:0/1414121315 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06900aff50 0x7f06901520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.943+0000 7f068f400640 1 -- 172.21.15.2:0/1414121315 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06900aff50 msgr2=0x7f06901520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.943+0000 7f068f400640 1 --2- 172.21.15.2:0/1414121315 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06900aff50 0x7f06901520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.943+0000 7f068f400640 1 -- 172.21.15.2:0/1414121315 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06900ae8d0 msgr2=0x7f06901361a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.943+0000 7f068f400640 1 --2- 172.21.15.2:0/1414121315 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06900ae8d0 0x7f06901361a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.943+0000 7f068f400640 1 -- 172.21.15.2:0/1414121315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0678009450 con 0x7f06900c9ed0 2024-08-17T02:23:48.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.944+0000 7f068f400640 1 --2- 172.21.15.2:0/1414121315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06900c9ed0 0x7f069014b9d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0688009fa0 tx=0x7f0688009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:48.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.944+0000 7f0686a00640 1 -- 172.21.15.2:0/1414121315 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068800ee60 con 0x7f06900c9ed0 2024-08-17T02:23:48.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.944+0000 7f0686a00640 1 -- 172.21.15.2:0/1414121315 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0688014420 con 0x7f06900c9ed0 2024-08-17T02:23:48.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.944+0000 7f0686a00640 1 -- 172.21.15.2:0/1414121315 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06880147e0 con 0x7f06900c9ed0 2024-08-17T02:23:48.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.944+0000 7f0695a00640 1 -- 172.21.15.2:0/1414121315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069014e2f0 con 0x7f06900c9ed0 2024-08-17T02:23:48.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.944+0000 7f0695a00640 1 -- 172.21.15.2:0/1414121315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06901366e0 con 0x7f06900c9ed0 2024-08-17T02:23:48.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.946+0000 7f0686a00640 1 -- 172.21.15.2:0/1414121315 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0688014b50 con 0x7f06900c9ed0 2024-08-17T02:23:48.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.947+0000 7f0686a00640 1 --2- 172.21.15.2:0/1414121315 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f066c065150 0x7f066c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.947+0000 7f0686a00640 1 -- 172.21.15.2:0/1414121315 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0688082b90 con 0x7f06900c9ed0 2024-08-17T02:23:48.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.947+0000 7f068ea00640 1 --2- 172.21.15.2:0/1414121315 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f066c065150 0x7f066c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.948+0000 7f0697fa5740 1 Processor -- start 2024-08-17T02:23:48.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.948+0000 7f0697fa5740 1 -- start start 2024-08-17T02:23:48.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.948+0000 7f068ea00640 1 --2- 172.21.15.2:0/1414121315 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f066c065150 0x7f066c067600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0680007fd0 tx=0x7f0680007e30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:48.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.948+0000 7f0697fa5740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556091ef5e40 0x556091ef6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.948+0000 7f0697fa5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091ed14b0 0x556091f139e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.948+0000 7f0697fa5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556091f13f20 0x556091ecad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.948+0000 7f0697fa5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x556091e87380 con 0x556091ed14b0 2024-08-17T02:23:48.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.948+0000 7f0697fa5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x556091e309e0 con 0x556091f13f20 2024-08-17T02:23:48.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.948+0000 7f0697fa5740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x556091e2e170 con 0x556091ef5e40 2024-08-17T02:23:48.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.949+0000 7f0686000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091ed14b0 0x556091f139e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.949+0000 7f0686000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091ed14b0 0x556091f139e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47168/0 (socket says 172.21.15.2:47168) 2024-08-17T02:23:48.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.949+0000 7f0686000640 1 -- 172.21.15.2:0/2597738930 learned_addr learned my addr 172.21.15.2:0/2597738930 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:48.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.949+0000 7f068ea00640 1 --2- 172.21.15.2:0/2597738930 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556091ef5e40 0x556091ef6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.949+0000 7f068f400640 1 --2- 172.21.15.2:0/2597738930 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556091f13f20 0x556091ecad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.949+0000 7f0686000640 1 -- 172.21.15.2:0/2597738930 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556091ef5e40 msgr2=0x556091ef6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:48.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.949+0000 7f0686000640 1 --2- 172.21.15.2:0/2597738930 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556091ef5e40 0x556091ef6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.949+0000 7f0686000640 1 -- 172.21.15.2:0/2597738930 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556091f13f20 msgr2=0x556091ecad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:48.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.949+0000 7f0686000640 1 --2- 172.21.15.2:0/2597738930 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556091f13f20 0x556091ecad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.949+0000 7f0686000640 1 -- 172.21.15.2:0/2597738930 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556091ddd820 con 0x556091ed14b0 2024-08-17T02:23:48.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.949+0000 7f0686000640 1 --2- 172.21.15.2:0/2597738930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091ed14b0 0x556091f139e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0678009940 tx=0x7f0678032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bbb86dd9a3904af server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:48.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.950+0000 7f067ea00640 1 -- 172.21.15.2:0/2597738930 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0678000cc0 con 0x556091ed14b0 2024-08-17T02:23:48.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.950+0000 7f067ea00640 1 -- 172.21.15.2:0/2597738930 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06780325b0 con 0x556091ed14b0 2024-08-17T02:23:48.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.950+0000 7f067ea00640 1 -- 172.21.15.2:0/2597738930 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0678046440 con 0x556091ed14b0 2024-08-17T02:23:48.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.950+0000 7f0697fa5740 1 -- 172.21.15.2:0/2597738930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091ed14b0 msgr2=0x556091f139e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.950+0000 7f0697fa5740 1 --2- 172.21.15.2:0/2597738930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091ed14b0 0x556091f139e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0678009940 tx=0x7f0678032000 comp rx=0 tx=0).stop 2024-08-17T02:23:48.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.950+0000 7f0697fa5740 1 -- 172.21.15.2:0/2597738930 shutdown_connections 2024-08-17T02:23:48.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.950+0000 7f0697fa5740 1 --2- 172.21.15.2:0/2597738930 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556091f13f20 0x556091ecad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.950+0000 7f0697fa5740 1 --2- 172.21.15.2:0/2597738930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091ed14b0 0x556091f139e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.950+0000 7f0697fa5740 1 --2- 172.21.15.2:0/2597738930 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556091ef5e40 0x556091ef6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.950+0000 7f0697fa5740 1 -- 172.21.15.2:0/2597738930 >> 172.21.15.2:0/2597738930 conn(0x556091e65030 msgr2=0x556091f18080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:48.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.950+0000 7f0697fa5740 1 -- 172.21.15.2:0/2597738930 shutdown_connections 2024-08-17T02:23:48.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.951+0000 7f0697fa5740 1 -- 172.21.15.2:0/2597738930 wait complete. 2024-08-17T02:23:48.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.951+0000 7f0697fa5740 1 -- start start 2024-08-17T02:23:48.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.951+0000 7f0697fa5740 1 Processor -- start 2024-08-17T02:23:48.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.952+0000 7f0697fa5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556091ed14b0 0x556091efcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.952+0000 7f0697fa5740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556091ef5e40 0x556091f17fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.952+0000 7f0697fa5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091f13f20 0x556091f24930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.952+0000 7f0697fa5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x556091e29f60 con 0x556091f13f20 2024-08-17T02:23:48.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.952+0000 7f0697fa5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x556091dd2690 con 0x556091ed14b0 2024-08-17T02:23:48.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.952+0000 7f0697fa5740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x556091dd2330 con 0x556091ef5e40 2024-08-17T02:23:48.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.952+0000 7f0697fa5740 10 client.0 _ll_register_callbacks cb 0x556091dcc2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:23:48.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.953+0000 7f068f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091f13f20 0x556091f24930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.953+0000 7f068f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091f13f20 0x556091f24930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47174/0 (socket says 172.21.15.2:47174) 2024-08-17T02:23:48.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.953+0000 7f068f400640 1 -- 172.21.15.2:0/1867392357 learned_addr learned my addr 172.21.15.2:0/1867392357 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:48.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.953+0000 7f068ea00640 1 --2- 172.21.15.2:0/1867392357 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556091ed14b0 0x556091efcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.953+0000 7f0686000640 1 --2- 172.21.15.2:0/1867392357 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556091ef5e40 0x556091f17fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.953+0000 7f068f400640 1 -- 172.21.15.2:0/1867392357 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556091ef5e40 msgr2=0x556091f17fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:48.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.953+0000 7f068f400640 1 --2- 172.21.15.2:0/1867392357 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556091ef5e40 0x556091f17fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.953+0000 7f068f400640 1 -- 172.21.15.2:0/1867392357 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556091ed14b0 msgr2=0x556091efcac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:48.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.953+0000 7f068f400640 1 --2- 172.21.15.2:0/1867392357 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556091ed14b0 0x556091efcac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.953+0000 7f068f400640 1 -- 172.21.15.2:0/1867392357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06900ad990 con 0x556091f13f20 2024-08-17T02:23:48.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.953+0000 7f068f400640 1 --2- 172.21.15.2:0/1867392357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091f13f20 0x556091f24930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f06880548b0 tx=0x7f0688057040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b643e0716b7d05c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:48.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.953+0000 7f0673400640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-17T02:23:48.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.953+0000 7f0673400640 1 -- 172.21.15.2:0/1867392357 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688052dc0 con 0x556091f13f20 2024-08-17T02:23:48.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.953+0000 7f0673400640 1 -- 172.21.15.2:0/1867392357 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f068807ce10 con 0x556091f13f20 2024-08-17T02:23:48.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.953+0000 7f0697fa5740 1 -- 172.21.15.2:0/1867392357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556091e5dd20 con 0x556091f13f20 2024-08-17T02:23:48.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.954+0000 7f0673400640 1 -- 172.21.15.2:0/1867392357 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f068805b380 con 0x556091f13f20 2024-08-17T02:23:48.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.954+0000 7f0697fa5740 10 client.4659 fetch_fsmap learned FSMap version 8 2024-08-17T02:23:48.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.954+0000 7f0697fa5740 1 -- 172.21.15.2:0/1867392357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x556091df3ab0 con 0x556091f13f20 2024-08-17T02:23:48.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.954+0000 7f0673400640 1 -- 172.21.15.2:0/1867392357 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068805f070 con 0x556091f13f20 2024-08-17T02:23:48.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.954+0000 7f0673400640 1 -- 172.21.15.2:0/1867392357 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0688050710 con 0x556091f13f20 2024-08-17T02:23:48.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.954+0000 7f0697fa5740 10 client.4659 fetch_fsmap finished waiting for FSMap version 8 2024-08-17T02:23:48.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.954+0000 7f0697fa5740 10 client.4659 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-17T02:23:48.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.954+0000 7f0697fa5740 20 client.4659 populate_metadata read hostname 'smithi002' 2024-08-17T02:23:48.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.954+0000 7f0697fa5740 1 --2- 172.21.15.2:0/1867392357 >> [v2:172.21.15.145:6834/3984927211,v1:172.21.15.145:6836/3984927211] conn(0x556091ef3ef0 0x556091ef42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.954+0000 7f0697fa5740 4 client.4659 mds_command: new command op to 4264 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:23:48.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.954+0000 7f0697fa5740 1 -- 172.21.15.2:0/1867392357 --> [v2:172.21.15.145:6834/3984927211,v1:172.21.15.145:6836/3984927211] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556091b313c0 con 0x556091ef3ef0 2024-08-17T02:23:48.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.954+0000 7f068ea00640 1 --2- 172.21.15.2:0/1867392357 >> [v2:172.21.15.145:6834/3984927211,v1:172.21.15.145:6836/3984927211] conn(0x556091ef3ef0 0x556091ef42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.955+0000 7f068ea00640 1 --2- 172.21.15.2:0/1867392357 >> [v2:172.21.15.145:6834/3984927211,v1:172.21.15.145:6836/3984927211] conn(0x556091ef3ef0 0x556091ef42c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d83d7d4ff90cfaf server_cookie=5285b02ec3ce55d5 in_seq=0 out_seq=0 2024-08-17T02:23:48.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.955+0000 7f0673400640 10 client.4659 ms_handle_connect on v2:172.21.15.145:6834/3984927211 2024-08-17T02:23:48.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.956+0000 7f0673400640 1 -- 172.21.15.2:0/1867392357 <== mds.0 v2:172.21.15.145:6834/3984927211 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x556091b313c0 con 0x556091ef3ef0 2024-08-17T02:23:48.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.956+0000 7f0673400640 10 client.4659 handle_command_reply: tid=0 2024-08-17T02:23:48.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.956+0000 7f0697fa5740 1 client.4659 shutdown 2024-08-17T02:23:48.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.956+0000 7f0697fa5740 1 -- 172.21.15.2:0/1867392357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091f13f20 msgr2=0x556091f24930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.956+0000 7f0697fa5740 1 --2- 172.21.15.2:0/1867392357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091f13f20 0x556091f24930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f06880548b0 tx=0x7f0688057040 comp rx=0 tx=0).stop 2024-08-17T02:23:48.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.956+0000 7f0697fa5740 1 -- 172.21.15.2:0/1867392357 shutdown_connections 2024-08-17T02:23:48.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.956+0000 7f0697fa5740 1 --2- 172.21.15.2:0/1867392357 >> [v2:172.21.15.145:6834/3984927211,v1:172.21.15.145:6836/3984927211] conn(0x556091ef3ef0 0x556091ef42c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.956+0000 7f0697fa5740 1 --2- 172.21.15.2:0/1867392357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091f13f20 0x556091f24930 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.956+0000 7f0697fa5740 1 --2- 172.21.15.2:0/1867392357 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556091ef5e40 0x556091f17fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.956+0000 7f0697fa5740 1 --2- 172.21.15.2:0/1867392357 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556091ed14b0 0x556091efcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.956+0000 7f0673400640 0 client.4659 ms_handle_reset on v2:172.21.15.145:6834/3984927211 2024-08-17T02:23:48.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.956+0000 7f0697fa5740 1 -- 172.21.15.2:0/1867392357 >> 172.21.15.2:0/1867392357 conn(0x556091e65030 msgr2=0x556091f14850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:48.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.957+0000 7f0697fa5740 1 -- 172.21.15.2:0/1867392357 shutdown_connections 2024-08-17T02:23:48.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.957+0000 7f0697fa5740 1 -- 172.21.15.2:0/1867392357 wait complete. 2024-08-17T02:23:48.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.957+0000 7f0697fa5740 20 client.4659 trim_cache size 0 max 16384 2024-08-17T02:23:48.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.973+0000 7f0697fa5740 1 Processor -- start 2024-08-17T02:23:48.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.973+0000 7f0697fa5740 1 -- start start 2024-08-17T02:23:48.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.973+0000 7f0697fa5740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556091ed14b0 0x556091f11680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.973+0000 7f0697fa5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556091ef5e40 0x556091ed0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.973+0000 7f0697fa5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091f13f20 0x556091ec4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.973+0000 7f0697fa5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x556091ba4f20 con 0x556091f13f20 2024-08-17T02:23:48.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.973+0000 7f0697fa5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x556091ef9b20 con 0x556091ef5e40 2024-08-17T02:23:48.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.973+0000 7f0697fa5740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x556091eccc70 con 0x556091ed14b0 2024-08-17T02:23:48.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.974+0000 7f068f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091f13f20 0x556091ec4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.974+0000 7f068f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091f13f20 0x556091ec4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47182/0 (socket says 172.21.15.2:47182) 2024-08-17T02:23:48.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.974+0000 7f068f400640 1 -- 172.21.15.2:0/3746817675 learned_addr learned my addr 172.21.15.2:0/3746817675 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:48.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.974+0000 7f0686000640 1 --2- 172.21.15.2:0/3746817675 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556091ef5e40 0x556091ed0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.974+0000 7f068ea00640 1 --2- 172.21.15.2:0/3746817675 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556091ed14b0 0x556091f11680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.974+0000 7f068f400640 1 -- 172.21.15.2:0/3746817675 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556091ed14b0 msgr2=0x556091f11680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:48.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.974+0000 7f068f400640 1 --2- 172.21.15.2:0/3746817675 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556091ed14b0 0x556091f11680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.974+0000 7f068f400640 1 -- 172.21.15.2:0/3746817675 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556091ef5e40 msgr2=0x556091ed0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:48.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.974+0000 7f068f400640 1 --2- 172.21.15.2:0/3746817675 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556091ef5e40 0x556091ed0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.974+0000 7f068f400640 1 -- 172.21.15.2:0/3746817675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556091df7490 con 0x556091f13f20 2024-08-17T02:23:48.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.974+0000 7f0686000640 1 --2- 172.21.15.2:0/3746817675 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556091ef5e40 0x556091ed0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:48.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.974+0000 7f068ea00640 1 --2- 172.21.15.2:0/3746817675 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556091ed14b0 0x556091f11680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.974+0000 7f068f400640 1 --2- 172.21.15.2:0/3746817675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091f13f20 0x556091ec4e20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0688052c70 tx=0x7f0688068000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bce6296861cd75c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.974+0000 7f067f400640 1 -- 172.21.15.2:0/3746817675 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688052cc0 con 0x556091f13f20 2024-08-17T02:23:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.974+0000 7f067f400640 1 -- 172.21.15.2:0/3746817675 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068805f070 con 0x556091f13f20 2024-08-17T02:23:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.974+0000 7f067f400640 1 -- 172.21.15.2:0/3746817675 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688050710 con 0x556091f13f20 2024-08-17T02:23:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.975+0000 7f0697fa5740 1 -- 172.21.15.2:0/3746817675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091f13f20 msgr2=0x556091ec4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.975+0000 7f0697fa5740 1 --2- 172.21.15.2:0/3746817675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091f13f20 0x556091ec4e20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0688052c70 tx=0x7f0688068000 comp rx=0 tx=0).stop 2024-08-17T02:23:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.975+0000 7f0697fa5740 1 -- 172.21.15.2:0/3746817675 shutdown_connections 2024-08-17T02:23:48.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.975+0000 7f0697fa5740 1 --2- 172.21.15.2:0/3746817675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091f13f20 0x556091ec4e20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.975+0000 7f0697fa5740 1 --2- 172.21.15.2:0/3746817675 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556091ef5e40 0x556091ed0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.975+0000 7f0697fa5740 1 --2- 172.21.15.2:0/3746817675 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556091ed14b0 0x556091f11680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.975+0000 7f0697fa5740 1 -- 172.21.15.2:0/3746817675 >> 172.21.15.2:0/3746817675 conn(0x556091e65030 msgr2=0x556091f11d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:48.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.975+0000 7f0697fa5740 1 -- 172.21.15.2:0/3746817675 shutdown_connections 2024-08-17T02:23:48.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.975+0000 7f0697fa5740 1 -- 172.21.15.2:0/3746817675 wait complete. 2024-08-17T02:23:48.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.976+0000 7f0697fa5740 1 -- start start 2024-08-17T02:23:48.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.976+0000 7f0697fa5740 1 Processor -- start 2024-08-17T02:23:48.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.977+0000 7f0697fa5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091ed14b0 0x556091f1de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.977+0000 7f0697fa5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556091ef5e40 0x556091ece980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.977+0000 7f0697fa5740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556091f13f20 0x556091eceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.977+0000 7f0697fa5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x556091f24980 con 0x556091ed14b0 2024-08-17T02:23:48.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.977+0000 7f0697fa5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x556091f7cec0 con 0x556091ef5e40 2024-08-17T02:23:48.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.977+0000 7f0697fa5740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x556091ef9650 con 0x556091f13f20 2024-08-17T02:23:48.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.977+0000 7f0697fa5740 10 client.0 _ll_register_callbacks cb 0x7f0688057ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:23:48.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.977+0000 7f068ea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091ed14b0 0x556091f1de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.977+0000 7f068ea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091ed14b0 0x556091f1de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47192/0 (socket says 172.21.15.2:47192) 2024-08-17T02:23:48.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.977+0000 7f068ea00640 1 -- 172.21.15.2:0/2010897858 learned_addr learned my addr 172.21.15.2:0/2010897858 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:48.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.977+0000 7f068f400640 1 --2- 172.21.15.2:0/2010897858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556091f13f20 0x556091eceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.977+0000 7f0686000640 1 --2- 172.21.15.2:0/2010897858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556091ef5e40 0x556091ece980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.977+0000 7f068ea00640 1 -- 172.21.15.2:0/2010897858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556091f13f20 msgr2=0x556091eceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:48.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.977+0000 7f068ea00640 1 --2- 172.21.15.2:0/2010897858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556091f13f20 0x556091eceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.977+0000 7f068ea00640 1 -- 172.21.15.2:0/2010897858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556091ef5e40 msgr2=0x556091ece980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:48.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.977+0000 7f068ea00640 1 --2- 172.21.15.2:0/2010897858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556091ef5e40 0x556091ece980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.977+0000 7f068ea00640 1 -- 172.21.15.2:0/2010897858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556091df3ab0 con 0x556091ed14b0 2024-08-17T02:23:48.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.977+0000 7f0686000640 1 --2- 172.21.15.2:0/2010897858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556091ef5e40 0x556091ece980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:48.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.978+0000 7f068ea00640 1 --2- 172.21.15.2:0/2010897858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091ed14b0 0x556091f1de30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x556091efabc0 tx=0x7f0680029490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230c46256971dcf1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:48.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.978+0000 7f0673400640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-17T02:23:48.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.978+0000 7f0673400640 1 -- 172.21.15.2:0/2010897858 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0680029070 con 0x556091ed14b0 2024-08-17T02:23:48.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.978+0000 7f0673400640 1 -- 172.21.15.2:0/2010897858 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f068001c040 con 0x556091ed14b0 2024-08-17T02:23:48.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.978+0000 7f0697fa5740 1 -- 172.21.15.2:0/2010897858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f06780325b0 con 0x556091ed14b0 2024-08-17T02:23:48.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.978+0000 7f0673400640 1 -- 172.21.15.2:0/2010897858 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06800292a0 con 0x556091ed14b0 2024-08-17T02:23:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.978+0000 7f0697fa5740 10 client.4665 fetch_fsmap learned FSMap version 8 2024-08-17T02:23:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.978+0000 7f0697fa5740 1 -- 172.21.15.2:0/2010897858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x556091df71e0 con 0x556091ed14b0 2024-08-17T02:23:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.978+0000 7f0673400640 1 -- 172.21.15.2:0/2010897858 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06780325b0 con 0x556091ed14b0 2024-08-17T02:23:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.978+0000 7f0673400640 1 -- 172.21.15.2:0/2010897858 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0680012070 con 0x556091ed14b0 2024-08-17T02:23:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.978+0000 7f0697fa5740 10 client.4665 fetch_fsmap finished waiting for FSMap version 8 2024-08-17T02:23:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.978+0000 7f0697fa5740 10 client.4665 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-17T02:23:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.979+0000 7f0697fa5740 20 client.4665 populate_metadata read hostname 'smithi002' 2024-08-17T02:23:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.979+0000 7f0697fa5740 1 --2- 172.21.15.2:0/2010897858 >> [v2:172.21.15.145:6834/3984927211,v1:172.21.15.145:6836/3984927211] conn(0x556091f7bea0 0x556091f7c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.979+0000 7f0697fa5740 4 client.4665 mds_command: new command op to 4264 tid=0[{"prefix": "status"}] 2024-08-17T02:23:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.979+0000 7f0697fa5740 1 -- 172.21.15.2:0/2010897858 --> [v2:172.21.15.145:6834/3984927211,v1:172.21.15.145:6836/3984927211] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556091b426c0 con 0x556091f7bea0 2024-08-17T02:23:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.979+0000 7f0686000640 1 --2- 172.21.15.2:0/2010897858 >> [v2:172.21.15.145:6834/3984927211,v1:172.21.15.145:6836/3984927211] conn(0x556091f7bea0 0x556091f7c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.979+0000 7f0686000640 1 --2- 172.21.15.2:0/2010897858 >> [v2:172.21.15.145:6834/3984927211,v1:172.21.15.145:6836/3984927211] conn(0x556091f7bea0 0x556091f7c270 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=242533dd7c4bfee7 server_cookie=9714f43ae50b3092 in_seq=0 out_seq=0 2024-08-17T02:23:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.979+0000 7f0673400640 10 client.4665 ms_handle_connect on v2:172.21.15.145:6834/3984927211 2024-08-17T02:23:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.980+0000 7f0673400640 1 -- 172.21.15.2:0/2010897858 <== mds.0 v2:172.21.15.145:6834/3984927211 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x556091b426c0 con 0x556091f7bea0 2024-08-17T02:23:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.980+0000 7f0673400640 10 client.4665 handle_command_reply: tid=0 2024-08-17T02:23:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.980+0000 7f0697fa5740 1 client.4665 shutdown 2024-08-17T02:23:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.980+0000 7f0697fa5740 1 -- 172.21.15.2:0/2010897858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091ed14b0 msgr2=0x556091f1de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.980+0000 7f0697fa5740 1 --2- 172.21.15.2:0/2010897858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091ed14b0 0x556091f1de30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x556091efabc0 tx=0x7f0680029490 comp rx=0 tx=0).stop 2024-08-17T02:23:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.980+0000 7f0697fa5740 1 -- 172.21.15.2:0/2010897858 shutdown_connections 2024-08-17T02:23:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.980+0000 7f0697fa5740 1 --2- 172.21.15.2:0/2010897858 >> [v2:172.21.15.145:6834/3984927211,v1:172.21.15.145:6836/3984927211] conn(0x556091f7bea0 0x556091f7c270 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.980+0000 7f0697fa5740 1 --2- 172.21.15.2:0/2010897858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556091f13f20 0x556091eceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.980+0000 7f0697fa5740 1 --2- 172.21.15.2:0/2010897858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556091ef5e40 0x556091ece980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.980+0000 7f0697fa5740 1 --2- 172.21.15.2:0/2010897858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556091ed14b0 0x556091f1de30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.980+0000 7f0673400640 0 client.4665 ms_handle_reset on v2:172.21.15.145:6834/3984927211 2024-08-17T02:23:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.980+0000 7f0697fa5740 1 -- 172.21.15.2:0/2010897858 >> 172.21.15.2:0/2010897858 conn(0x556091e65030 msgr2=0x556091ec4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.980+0000 7f0697fa5740 1 -- 172.21.15.2:0/2010897858 shutdown_connections 2024-08-17T02:23:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.980+0000 7f0697fa5740 1 -- 172.21.15.2:0/2010897858 wait complete. 2024-08-17T02:23:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.980+0000 7f0697fa5740 20 client.4665 trim_cache size 0 max 16384 2024-08-17T02:23:48.988 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-17T02:23:48.988 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "66491975-1283-4d8c-92e2-26a46f113139", 2024-08-17T02:23:48.989 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-08-17T02:23:48.989 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 4264, 2024-08-17T02:23:48.989 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-08-17T02:23:48.989 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-08-17T02:23:48.989 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-08-17T02:23:48.989 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 17.037919633000001, 2024-08-17T02:23:48.989 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 8, 2024-08-17T02:23:48.989 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 21, 2024-08-17T02:23:48.989 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 21, 2024-08-17T02:23:48.989 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 23.888010443999999 2024-08-17T02:23:48.989 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-17T02:23:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.981+0000 7f0695a00640 1 -- 172.21.15.2:0/1414121315 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f066c065150 msgr2=0x7f066c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.981+0000 7f0695a00640 1 --2- 172.21.15.2:0/1414121315 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f066c065150 0x7f066c067600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0680007fd0 tx=0x7f0680007e30 comp rx=0 tx=0).stop 2024-08-17T02:23:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.981+0000 7f0695a00640 1 -- 172.21.15.2:0/1414121315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06900c9ed0 msgr2=0x7f069014b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.981+0000 7f0695a00640 1 --2- 172.21.15.2:0/1414121315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06900c9ed0 0x7f069014b9d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0688009fa0 tx=0x7f0688009900 comp rx=0 tx=0).stop 2024-08-17T02:23:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.981+0000 7f0695a00640 1 -- 172.21.15.2:0/1414121315 shutdown_connections 2024-08-17T02:23:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.981+0000 7f0695a00640 1 --2- 172.21.15.2:0/1414121315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06900c9ed0 0x7f069014b9d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.981+0000 7f0695a00640 1 --2- 172.21.15.2:0/1414121315 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f066c065150 0x7f066c067600 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.981+0000 7f0695a00640 1 --2- 172.21.15.2:0/1414121315 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06900aff50 0x7f06901520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.981+0000 7f0695a00640 1 --2- 172.21.15.2:0/1414121315 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06900ae8d0 0x7f06901361a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.981+0000 7f0695a00640 1 -- 172.21.15.2:0/1414121315 >> 172.21.15.2:0/1414121315 conn(0x7f0690066e60 msgr2=0x7f0690067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.981+0000 7f0695a00640 1 -- 172.21.15.2:0/1414121315 shutdown_connections 2024-08-17T02:23:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:48.981+0000 7f0695a00640 1 -- 172.21.15.2:0/1414121315 wait complete. 2024-08-17T02:23:48.999 INFO:teuthology.run_tasks:Running task kclient... 2024-08-17T02:23:49.024 INFO:tasks.kclient:Mounting kernel clients... 2024-08-17T02:23:49.024 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-08-17T02:23:49.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:49.024 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-08-17T02:23:49.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:49.061 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-08-17T02:23:49.160 INFO:teuthology.orchestra.run.smithi002.stderr:Cannot find device "ceph-brx" 2024-08-17T02:23:49.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:23:49.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:49.163 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-08-17T02:23:49.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:49.199 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-08-17T02:23:49.296 INFO:teuthology.orchestra.run.smithi002.stderr:Cannot find device "ceph-brx" 2024-08-17T02:23:49.299 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:23:49.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:49.299 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list 2024-08-17T02:23:49.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:49.340 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link delete ceph-brx 2024-08-17T02:23:49.443 INFO:teuthology.orchestra.run.smithi145.stderr:Cannot find device "ceph-brx" 2024-08-17T02:23:49.446 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:23:49.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:49.447 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list 2024-08-17T02:23:49.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:49.483 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link delete ceph-brx 2024-08-17T02:23:49.581 INFO:teuthology.orchestra.run.smithi145.stderr:Cannot find device "ceph-brx" 2024-08-17T02:23:49.584 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:23:49.585 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-08-17T02:23:49.585 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:23:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.736+0000 7fb239200640 1 Processor -- start 2024-08-17T02:23:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.736+0000 7fb239200640 1 -- start start 2024-08-17T02:23:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.737+0000 7fb239200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb2340afca0 0x7fb2340b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.737+0000 7fb239200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb2340acf10 0x7fb234159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.737+0000 7fb239200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2341589a0 0x7fb234158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.737+0000 7fb239200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2340b0980 con 0x7fb2340afca0 2024-08-17T02:23:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.737+0000 7fb239200640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23415a4e0 con 0x7fb2340acf10 2024-08-17T02:23:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.737+0000 7fb239200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2340c92b0 con 0x7fb2341589a0 2024-08-17T02:23:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.737+0000 7fb231e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb2340afca0 0x7fb2340b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.737+0000 7fb231e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb2340afca0 0x7fb2340b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47208/0 (socket says 172.21.15.2:47208) 2024-08-17T02:23:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.737+0000 7fb231e00640 1 -- 172.21.15.2:0/2801757698 learned_addr learned my addr 172.21.15.2:0/2801757698 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:49.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.737+0000 7fb231400640 1 --2- 172.21.15.2:0/2801757698 >> v2:172.21.15.145:3300/0 conn(0x7fb2340acf10 0x7fb234159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:49.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.738+0000 7fb232800640 1 --2- 172.21.15.2:0/2801757698 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2341589a0 0x7fb234158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:49.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.738+0000 7fb231e00640 1 -- 172.21.15.2:0/2801757698 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2341589a0 msgr2=0x7fb234158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:49.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.738+0000 7fb231e00640 1 --2- 172.21.15.2:0/2801757698 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2341589a0 0x7fb234158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.738+0000 7fb231e00640 1 -- 172.21.15.2:0/2801757698 >> v2:172.21.15.145:3300/0 conn(0x7fb2340acf10 msgr2=0x7fb234159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:49.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.738+0000 7fb231e00640 1 --2- 172.21.15.2:0/2801757698 >> v2:172.21.15.145:3300/0 conn(0x7fb2340acf10 0x7fb234159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.738+0000 7fb231e00640 1 -- 172.21.15.2:0/2801757698 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb234159360 con 0x7fb2340afca0 2024-08-17T02:23:49.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.738+0000 7fb232800640 1 --2- 172.21.15.2:0/2801757698 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2341589a0 0x7fb234158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:49.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.739+0000 7fb231e00640 1 --2- 172.21.15.2:0/2801757698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2340afca0 0x7fb2340b0070 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb2340c83b0 tx=0x7fb2240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46919e69ea2957a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:49.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.739+0000 7fb230a00640 1 -- 172.21.15.2:0/2801757698 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22402add0 con 0x7fb2340afca0 2024-08-17T02:23:49.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.739+0000 7fb230a00640 1 -- 172.21.15.2:0/2801757698 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb224032440 con 0x7fb2340afca0 2024-08-17T02:23:49.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.739+0000 7fb230a00640 1 -- 172.21.15.2:0/2801757698 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb224032820 con 0x7fb2340afca0 2024-08-17T02:23:49.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.740+0000 7fb239200640 1 -- 172.21.15.2:0/2801757698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2340afca0 msgr2=0x7fb2340b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.740+0000 7fb239200640 1 --2- 172.21.15.2:0/2801757698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2340afca0 0x7fb2340b0070 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb2340c83b0 tx=0x7fb2240091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.740+0000 7fb239200640 1 -- 172.21.15.2:0/2801757698 shutdown_connections 2024-08-17T02:23:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.740+0000 7fb239200640 1 --2- 172.21.15.2:0/2801757698 >> v2:172.21.15.145:3300/0 conn(0x7fb2340acf10 0x7fb234159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.740+0000 7fb239200640 1 --2- 172.21.15.2:0/2801757698 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2341589a0 0x7fb234158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.740+0000 7fb239200640 1 --2- 172.21.15.2:0/2801757698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2340afca0 0x7fb2340b0070 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.740+0000 7fb239200640 1 -- 172.21.15.2:0/2801757698 >> 172.21.15.2:0/2801757698 conn(0x7fb234066e60 msgr2=0x7fb234067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.740+0000 7fb239200640 1 -- 172.21.15.2:0/2801757698 shutdown_connections 2024-08-17T02:23:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.740+0000 7fb239200640 1 -- 172.21.15.2:0/2801757698 wait complete. 2024-08-17T02:23:49.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.741+0000 7fb239200640 1 Processor -- start 2024-08-17T02:23:49.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.741+0000 7fb239200640 1 -- start start 2024-08-17T02:23:49.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.742+0000 7fb239200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2340acf10 0x7fb2340ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:49.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.742+0000 7fb239200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2340afca0 0x7fb234132ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.742+0000 7fb239200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2341589a0 0x7fb23414e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.742+0000 7fb239200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23414e080 con 0x7fb2341589a0 2024-08-17T02:23:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.742+0000 7fb239200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23414d470 con 0x7fb2340acf10 2024-08-17T02:23:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.742+0000 7fb239200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23414d750 con 0x7fb2340afca0 2024-08-17T02:23:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.742+0000 7fb232800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2341589a0 0x7fb23414e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.742+0000 7fb232800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2341589a0 0x7fb23414e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47216/0 (socket says 172.21.15.2:47216) 2024-08-17T02:23:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.742+0000 7fb232800640 1 -- 172.21.15.2:0/1665641517 learned_addr learned my addr 172.21.15.2:0/1665641517 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.742+0000 7fb231e00640 1 --2- 172.21.15.2:0/1665641517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2340acf10 0x7fb2340ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.742+0000 7fb231400640 1 --2- 172.21.15.2:0/1665641517 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2340afca0 0x7fb234132ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:49.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.743+0000 7fb232800640 1 -- 172.21.15.2:0/1665641517 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2340afca0 msgr2=0x7fb234132ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:49.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.743+0000 7fb232800640 1 --2- 172.21.15.2:0/1665641517 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2340afca0 0x7fb234132ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.743+0000 7fb232800640 1 -- 172.21.15.2:0/1665641517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2340acf10 msgr2=0x7fb2340ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:49.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.743+0000 7fb232800640 1 --2- 172.21.15.2:0/1665641517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2340acf10 0x7fb2340ca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.743+0000 7fb232800640 1 -- 172.21.15.2:0/1665641517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb224009450 con 0x7fb2341589a0 2024-08-17T02:23:49.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.743+0000 7fb232800640 1 --2- 172.21.15.2:0/1665641517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2341589a0 0x7fb23414e510 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00d180 tx=0x7fb22c009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:49.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.743+0000 7fb229600640 1 -- 172.21.15.2:0/1665641517 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c015440 con 0x7fb2341589a0 2024-08-17T02:23:49.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.743+0000 7fb229600640 1 -- 172.21.15.2:0/1665641517 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22c00f040 con 0x7fb2341589a0 2024-08-17T02:23:49.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.743+0000 7fb229600640 1 -- 172.21.15.2:0/1665641517 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c015810 con 0x7fb2341589a0 2024-08-17T02:23:49.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.743+0000 7fb239200640 1 -- 172.21.15.2:0/1665641517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb23414da30 con 0x7fb2341589a0 2024-08-17T02:23:49.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.743+0000 7fb239200640 1 -- 172.21.15.2:0/1665641517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2341477d0 con 0x7fb2341589a0 2024-08-17T02:23:49.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.744+0000 7fb239200640 1 -- 172.21.15.2:0/1665641517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb234063fb0 con 0x7fb2341589a0 2024-08-17T02:23:49.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.745+0000 7fb229600640 1 -- 172.21.15.2:0/1665641517 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb22c01e3b0 con 0x7fb2341589a0 2024-08-17T02:23:49.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.746+0000 7fb229600640 1 --2- 172.21.15.2:0/1665641517 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb214065150 0x7fb214067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:49.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.746+0000 7fb229600640 1 -- 172.21.15.2:0/1665641517 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb22c082e40 con 0x7fb2341589a0 2024-08-17T02:23:49.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.746+0000 7fb231e00640 1 --2- 172.21.15.2:0/1665641517 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb214065150 0x7fb214067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:49.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.747+0000 7fb231e00640 1 --2- 172.21.15.2:0/1665641517 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb214065150 0x7fb214067600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb224034000 tx=0x7fb224032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:49.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.750+0000 7fb229600640 1 -- 172.21.15.2:0/1665641517 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb22c050f10 con 0x7fb2341589a0 2024-08-17T02:23:49.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.973+0000 7fb239200640 1 -- 172.21.15.2:0/1665641517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb234067b70 con 0x7fb2341589a0 2024-08-17T02:23:49.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.974+0000 7fb229600640 1 -- 172.21.15.2:0/1665641517 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb22c01a060 con 0x7fb2341589a0 2024-08-17T02:23:49.975 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:23:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.976+0000 7fb239200640 1 -- 172.21.15.2:0/1665641517 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb214065150 msgr2=0x7fb214067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.976+0000 7fb239200640 1 --2- 172.21.15.2:0/1665641517 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb214065150 0x7fb214067600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb224034000 tx=0x7fb224032000 comp rx=0 tx=0).stop 2024-08-17T02:23:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.976+0000 7fb239200640 1 -- 172.21.15.2:0/1665641517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2341589a0 msgr2=0x7fb23414e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.976+0000 7fb239200640 1 --2- 172.21.15.2:0/1665641517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2341589a0 0x7fb23414e510 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00d180 tx=0x7fb22c009a50 comp rx=0 tx=0).stop 2024-08-17T02:23:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.976+0000 7fb239200640 1 -- 172.21.15.2:0/1665641517 shutdown_connections 2024-08-17T02:23:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.976+0000 7fb239200640 1 --2- 172.21.15.2:0/1665641517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2341589a0 0x7fb23414e510 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.976+0000 7fb239200640 1 --2- 172.21.15.2:0/1665641517 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb214065150 0x7fb214067600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.976+0000 7fb239200640 1 --2- 172.21.15.2:0/1665641517 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2340afca0 0x7fb234132ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.976+0000 7fb239200640 1 --2- 172.21.15.2:0/1665641517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2340acf10 0x7fb2340ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.976+0000 7fb239200640 1 -- 172.21.15.2:0/1665641517 >> 172.21.15.2:0/1665641517 conn(0x7fb234066e60 msgr2=0x7fb2340c7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.977+0000 7fb239200640 1 -- 172.21.15.2:0/1665641517 shutdown_connections 2024-08-17T02:23:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:49.977+0000 7fb239200640 1 -- 172.21.15.2:0/1665641517 wait complete. 2024-08-17T02:23:49.993 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:23:49.993 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:23:49.993 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-08-17T02:23:49.993 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:23:49.993 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:23:49.993 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:23:49.993 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:23:49.993 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:23:49.993 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:23:49.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:49.994 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-08-17T02:23:50.029 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:23:50.029 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:23:50.029 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:23:50.030 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:50.030 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-08-17T02:23:50.030 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:50.030 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:23:50.030 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:50.030 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-08-17T02:23:50.030 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:23:50.030 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:50.030 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-08-17T02:23:50.030 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:23:50.030 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:50.030 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-08-17T02:23:50.030 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:23:50.031 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42644sec preferred_lft 42644sec 2024-08-17T02:23:50.031 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link noprefixroute 2024-08-17T02:23:50.031 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:50.031 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:23:50.031 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:50.031 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-08-17T02:23:50.031 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:23:50.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:50.032 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2024-08-17T02:23:50.032 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-17T02:23:50.032 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:23:50.032 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr flush dev ceph-brx 2024-08-17T02:23:50.032 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set ceph-brx up 2024-08-17T02:23:50.032 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:23:50.032 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-17T02:23:50.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:50.393 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:23:50.451 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-08-17T02:23:50.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:50.454 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-08-17T02:23:50.514 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-08-17T02:23:50.514 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:23:50.515 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:23:50.515 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:23:50.515 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:23:50.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:50.515 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2024-08-17T02:23:50.515 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-17T02:23:50.516 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:23:50.516 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:23:50.516 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:23:50.516 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-17T02:23:51.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:51.032 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-08-17T02:23:51.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:51.069 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2024-08-17T02:23:51.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:51.145 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2024-08-17T02:23:51.146 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-17T02:23:51.146 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:23:51.146 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-17T02:23:51.146 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-17T02:23:51.280 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-17T02:23:51.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:51.280 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2024-08-17T02:23:51.281 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-17T02:23:51.281 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-17T02:23:51.281 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:23:51.281 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-17T02:23:51.281 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-17T02:23:51.281 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-17T02:23:51.281 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-17T02:23:51.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:51.473 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2024-08-17T02:23:51.473 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-17T02:23:51.473 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2024-08-17T02:23:51.473 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:23:51.473 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-17T02:23:51.593 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:23:51.593 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:23:51.629 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:23:51.629 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:23:51.629 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:23:51.703 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:23:51.704 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:23:51.704 DEBUG:teuthology.orchestra.run.smithi002:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:23:51.843 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:23:51.843 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:23:52.459 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:23:52.459 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:23:52.459 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.145:3300,172.21.15.145:3301" 2024-08-17T02:23:52.459 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: trying mount with new device syntax: 0@66491975-1283-4d8c-92e2-26a46f113139.cephfs=/ 2024-08-17T02:23:52.459 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.2:3300/172.21.15.145:3300/172.21.15.145:3301" will pass to kernel 2024-08-17T02:23:52.460 INFO:teuthology.orchestra.run.smithi002.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:23:52.460 INFO:teuthology.orchestra.run.smithi002.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:23:52.460 INFO:teuthology.orchestra.run.smithi002.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:23:52.460 INFO:teuthology.orchestra.run.smithi002.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:23:52.461 INFO:teuthology.orchestra.run.smithi002.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:23:52.463 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:23:52.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:52.464 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:23:52.522 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-08-17T02:23:52.522 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:23:52.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.673+0000 7f6561600640 1 Processor -- start 2024-08-17T02:23:52.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.674+0000 7f6561600640 1 -- start start 2024-08-17T02:23:52.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.675+0000 7f6561600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f655c0b0e30 0x7f655c0b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:52.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.675+0000 7f6561600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f655c15a590 0x7f655c13fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:52.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.675+0000 7f6561600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f655c06d7c0 con 0x7f655c156f90 2024-08-17T02:23:52.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.675+0000 7f6561600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655c15ab30 con 0x7f655c0b0e30 2024-08-17T02:23:52.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.675+0000 7f6561600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655c15ae10 con 0x7f655c15a590 2024-08-17T02:23:52.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.675+0000 7f655be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f655c0b0e30 0x7f655c0b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:52.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.675+0000 7f655be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f655c0b0e30 0x7f655c0b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47230/0 (socket says 172.21.15.2:47230) 2024-08-17T02:23:52.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.675+0000 7f655be00640 1 -- 172.21.15.2:0/1211724755 learned_addr learned my addr 172.21.15.2:0/1211724755 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:52.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.675+0000 7f6560c00640 1 --2- 172.21.15.2:0/1211724755 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f655c15a590 0x7f655c13fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:52.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.676+0000 7f655be00640 1 -- 172.21.15.2:0/1211724755 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f655c15a590 msgr2=0x7f655c13fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:52.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.676+0000 7f655be00640 1 --2- 172.21.15.2:0/1211724755 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f655c15a590 0x7f655c13fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:52.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.676+0000 7f655be00640 1 -- 172.21.15.2:0/1211724755 >> v1:172.21.15.2:6789/0 conn(0x7f655c156f90 legacy=0x7f655c0cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:52.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.676+0000 7f655be00640 1 -- 172.21.15.2:0/1211724755 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c15b0f0 con 0x7f655c0b0e30 2024-08-17T02:23:52.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.677+0000 7f655be00640 1 --2- 172.21.15.2:0/1211724755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f655c0b0e30 0x7f655c0b1200 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f654c009910 tx=0x7f654c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17019a3ef8652c76 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:52.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.677+0000 7f655b400640 1 -- 172.21.15.2:0/1211724755 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c02ae40 con 0x7f655c0b0e30 2024-08-17T02:23:52.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.677+0000 7f655b400640 1 -- 172.21.15.2:0/1211724755 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654c032440 con 0x7f655c0b0e30 2024-08-17T02:23:52.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.677+0000 7f655b400640 1 -- 172.21.15.2:0/1211724755 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c032820 con 0x7f655c0b0e30 2024-08-17T02:23:52.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.677+0000 7f6561600640 1 -- 172.21.15.2:0/1211724755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f655c0b0e30 msgr2=0x7f655c0b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:52.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.677+0000 7f6561600640 1 --2- 172.21.15.2:0/1211724755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f655c0b0e30 0x7f655c0b1200 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f654c009910 tx=0x7f654c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:52.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.678+0000 7f6561600640 1 -- 172.21.15.2:0/1211724755 shutdown_connections 2024-08-17T02:23:52.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.678+0000 7f6561600640 1 --2- 172.21.15.2:0/1211724755 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f655c15a590 0x7f655c13fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:52.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.678+0000 7f6561600640 1 --2- 172.21.15.2:0/1211724755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f655c0b0e30 0x7f655c0b1200 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:52.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.678+0000 7f6561600640 1 -- 172.21.15.2:0/1211724755 >> 172.21.15.2:0/1211724755 conn(0x7f655c062af0 msgr2=0x7f655c062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:52.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.678+0000 7f6561600640 1 -- 172.21.15.2:0/1211724755 shutdown_connections 2024-08-17T02:23:52.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.678+0000 7f6561600640 1 -- 172.21.15.2:0/1211724755 wait complete. 2024-08-17T02:23:52.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.679+0000 7f6561600640 1 Processor -- start 2024-08-17T02:23:52.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.679+0000 7f6561600640 1 -- start start 2024-08-17T02:23:52.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.680+0000 7f6561600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f655c0b0e30 0x7f655c0c7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:52.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.680+0000 7f6561600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f655c156f90 0x7f655c13f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:52.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.680+0000 7f6561600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f655c15a590 0x7f655c0c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:52.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.680+0000 7f6561600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655c0c1220 con 0x7f655c0b0e30 2024-08-17T02:23:52.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.680+0000 7f6561600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655c0c1420 con 0x7f655c15a590 2024-08-17T02:23:52.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.680+0000 7f6561600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655c0c1700 con 0x7f655c156f90 2024-08-17T02:23:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.680+0000 7f655be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f655c0b0e30 0x7f655c0c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.680+0000 7f655be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f655c0b0e30 0x7f655c0c7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47236/0 (socket says 172.21.15.2:47236) 2024-08-17T02:23:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.680+0000 7f655be00640 1 -- 172.21.15.2:0/2438351917 learned_addr learned my addr 172.21.15.2:0/2438351917 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:52.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.681+0000 7f6560c00640 1 --2- 172.21.15.2:0/2438351917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f655c15a590 0x7f655c0c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:52.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.681+0000 7f6553e00640 1 --2- 172.21.15.2:0/2438351917 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f655c156f90 0x7f655c13f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:52.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.681+0000 7f655be00640 1 -- 172.21.15.2:0/2438351917 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f655c156f90 msgr2=0x7f655c13f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:52.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.681+0000 7f655be00640 1 --2- 172.21.15.2:0/2438351917 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f655c156f90 0x7f655c13f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:52.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.681+0000 7f655be00640 1 -- 172.21.15.2:0/2438351917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f655c15a590 msgr2=0x7f655c0c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:52.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.681+0000 7f655be00640 1 --2- 172.21.15.2:0/2438351917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f655c15a590 0x7f655c0c5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:52.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.681+0000 7f655be00640 1 -- 172.21.15.2:0/2438351917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654c009450 con 0x7f655c0b0e30 2024-08-17T02:23:52.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.681+0000 7f6553e00640 1 --2- 172.21.15.2:0/2438351917 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f655c156f90 0x7f655c13f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:52.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.681+0000 7f655be00640 1 --2- 172.21.15.2:0/2438351917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f655c0b0e30 0x7f655c0c7130 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f654c035040 tx=0x7f654c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:52.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.681+0000 7f6553400640 1 -- 172.21.15.2:0/2438351917 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c031bb0 con 0x7f655c0b0e30 2024-08-17T02:23:52.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.681+0000 7f6553400640 1 -- 172.21.15.2:0/2438351917 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654c031d30 con 0x7f655c0b0e30 2024-08-17T02:23:52.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.681+0000 7f6561600640 1 -- 172.21.15.2:0/2438351917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655c0c19e0 con 0x7f655c0b0e30 2024-08-17T02:23:52.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.681+0000 7f6553400640 1 -- 172.21.15.2:0/2438351917 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c031ea0 con 0x7f655c0b0e30 2024-08-17T02:23:52.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.682+0000 7f6561600640 1 -- 172.21.15.2:0/2438351917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655c0c1fa0 con 0x7f655c0b0e30 2024-08-17T02:23:52.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.683+0000 7f6561600640 1 -- 172.21.15.2:0/2438351917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655c0c2190 con 0x7f655c0b0e30 2024-08-17T02:23:52.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.683+0000 7f6553400640 1 -- 172.21.15.2:0/2438351917 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f654c039040 con 0x7f655c0b0e30 2024-08-17T02:23:52.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.684+0000 7f6553400640 1 --2- 172.21.15.2:0/2438351917 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6538065150 0x7f6538067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:52.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.684+0000 7f6553400640 1 -- 172.21.15.2:0/2438351917 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f654c02ae40 con 0x7f655c0b0e30 2024-08-17T02:23:52.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.685+0000 7f6553e00640 1 --2- 172.21.15.2:0/2438351917 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6538065150 0x7f6538067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:52.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.685+0000 7f6553e00640 1 --2- 172.21.15.2:0/2438351917 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6538065150 0x7f6538067600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f655c0ae570 tx=0x7f6544009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:52.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.688+0000 7f6553400640 1 -- 172.21.15.2:0/2438351917 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f654c0707c0 con 0x7f655c0b0e30 2024-08-17T02:23:52.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.908+0000 7f6561600640 1 -- 172.21.15.2:0/2438351917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f655c070720 con 0x7f655c0b0e30 2024-08-17T02:23:52.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.908+0000 7f6553400640 1 -- 172.21.15.2:0/2438351917 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f654c073de0 con 0x7f655c0b0e30 2024-08-17T02:23:52.910 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:23:52.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.910+0000 7f6561600640 1 -- 172.21.15.2:0/2438351917 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6538065150 msgr2=0x7f6538067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:52.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.910+0000 7f6561600640 1 --2- 172.21.15.2:0/2438351917 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6538065150 0x7f6538067600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f655c0ae570 tx=0x7f6544009040 comp rx=0 tx=0).stop 2024-08-17T02:23:52.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.910+0000 7f6561600640 1 -- 172.21.15.2:0/2438351917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f655c0b0e30 msgr2=0x7f655c0c7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:52.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.910+0000 7f6561600640 1 --2- 172.21.15.2:0/2438351917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f655c0b0e30 0x7f655c0c7130 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f654c035040 tx=0x7f654c032000 comp rx=0 tx=0).stop 2024-08-17T02:23:52.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.910+0000 7f6561600640 1 -- 172.21.15.2:0/2438351917 shutdown_connections 2024-08-17T02:23:52.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.910+0000 7f6561600640 1 --2- 172.21.15.2:0/2438351917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f655c15a590 0x7f655c0c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:52.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.910+0000 7f6561600640 1 --2- 172.21.15.2:0/2438351917 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6538065150 0x7f6538067600 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:52.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.910+0000 7f6561600640 1 --2- 172.21.15.2:0/2438351917 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f655c156f90 0x7f655c13f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:52.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.910+0000 7f6561600640 1 --2- 172.21.15.2:0/2438351917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f655c0b0e30 0x7f655c0c7130 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:52.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.911+0000 7f6561600640 1 -- 172.21.15.2:0/2438351917 >> 172.21.15.2:0/2438351917 conn(0x7f655c062af0 msgr2=0x7f655c0b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:52.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.911+0000 7f6561600640 1 -- 172.21.15.2:0/2438351917 shutdown_connections 2024-08-17T02:23:52.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:52.911+0000 7f6561600640 1 -- 172.21.15.2:0/2438351917 wait complete. 2024-08-17T02:23:52.926 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:23:52.926 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:23:52.926 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-08-17T02:23:52.926 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-08-17T02:23:52.926 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-17T02:23:52.927 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:23:52.927 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:23:52.927 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:23:52.927 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:23:52.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:52.927 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-08-17T02:23:52.963 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:23:52.963 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:23:52.963 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:23:52.963 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:52.963 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-08-17T02:23:52.964 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:52.964 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:23:52.964 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:52.964 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-08-17T02:23:52.964 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:23:52.964 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:52.964 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-08-17T02:23:52.965 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:23:52.965 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:52.965 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-08-17T02:23:52.965 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:23:52.965 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42641sec preferred_lft 42641sec 2024-08-17T02:23:52.965 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link noprefixroute 2024-08-17T02:23:52.965 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:52.965 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:23:52.965 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:52.965 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-08-17T02:23:52.966 INFO:teuthology.orchestra.run.smithi002.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:23:52.966 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 6a:67:ee:dc:74:9b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:52.966 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:23:52.966 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:52.966 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::f029:5dff:fe25:178a/64 scope link 2024-08-17T02:23:52.966 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:52.966 INFO:teuthology.orchestra.run.smithi002.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:23:52.967 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 6a:67:ee:dc:74:9b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:23:52.967 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::6867:eeff:fedc:749b/64 scope link tentative 2024-08-17T02:23:52.967 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:52.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:52.967 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:23:53.057 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-08-17T02:23:53.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:53.060 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-08-17T02:23:53.096 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-08-17T02:23:53.096 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:23:53.096 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:23:53.096 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:23:53.097 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:23:53.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:53.098 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2024-08-17T02:23:53.098 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-17T02:23:53.098 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:23:53.098 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:23:53.098 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:23:53.098 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-17T02:23:53.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:53.244 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-08-17T02:23:53.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:23:53.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:53.280 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2024-08-17T02:23:53.355 INFO:teuthology.orchestra.run.smithi002.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-08-17T02:23:53.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:53.356 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2024-08-17T02:23:53.356 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-17T02:23:53.356 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:23:53.356 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-08-17T02:23:53.356 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-17T02:23:53.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:53.482 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:23:53.539 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:23:53.539 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:23:53.539 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:23:53.539 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:53.539 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-08-17T02:23:53.539 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:53.539 INFO:teuthology.orchestra.run.smithi002.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:23:53.539 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0e:bf:2e:4b:68:43 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:23:53.539 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:23:53.539 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:53.540 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::cbf:2eff:fe4b:6843/64 scope link 2024-08-17T02:23:53.540 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:53.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:53.542 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:23:53.597 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:23:53.597 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:23:53.598 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:23:53.598 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:53.598 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-08-17T02:23:53.598 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:53.598 INFO:teuthology.orchestra.run.smithi002.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:23:53.598 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0e:bf:2e:4b:68:43 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:23:53.598 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:23:53.598 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:53.598 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::cbf:2eff:fe4b:6843/64 scope link 2024-08-17T02:23:53.598 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:53.600 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-08-17T02:23:53.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:53.600 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2024-08-17T02:23:53.600 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-17T02:23:53.601 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-08-17T02:23:53.601 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:23:53.601 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-08-17T02:23:53.601 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-08-17T02:23:53.601 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-08-17T02:23:53.601 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-17T02:23:53.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:53.767 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2024-08-17T02:23:53.767 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-17T02:23:53.767 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.1 up 2024-08-17T02:23:53.767 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:23:53.767 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-17T02:23:53.882 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:23:53.882 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-08-17T02:23:53.918 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:23:53.918 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:23:53.918 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:23:53.992 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-08-17T02:23:53.993 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:23:53.993 DEBUG:teuthology.orchestra.run.smithi002:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:23:54.116 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:23:54.116 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:23:54.144 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:23:54.144 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:23:54.145 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.145:3300,172.21.15.145:3301" 2024-08-17T02:23:54.145 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: trying mount with new device syntax: 2@66491975-1283-4d8c-92e2-26a46f113139.cephfs=/ 2024-08-17T02:23:54.145 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.2:3300/172.21.15.145:3300/172.21.15.145:3301" will pass to kernel 2024-08-17T02:23:54.145 INFO:teuthology.orchestra.run.smithi002.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-08-17T02:23:54.145 INFO:teuthology.orchestra.run.smithi002.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:23:54.145 INFO:teuthology.orchestra.run.smithi002.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:23:54.145 INFO:teuthology.orchestra.run.smithi002.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:23:54.146 INFO:teuthology.orchestra.run.smithi002.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:23:54.148 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:23:54.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:54.149 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:23:54.204 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-08-17T02:23:54.204 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:23:54.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.354+0000 7fbe4d600640 1 Processor -- start 2024-08-17T02:23:54.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.354+0000 7fbe4d600640 1 -- start start 2024-08-17T02:23:54.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.355+0000 7fbe4d600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbe480ad960 0x7fbe4815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:54.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.355+0000 7fbe4d600640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbe480add30 0x7fbe48156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:54.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.355+0000 7fbe4d600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4815b5e0 con 0x7fbe480ca050 2024-08-17T02:23:54.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.355+0000 7fbe4d600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe480cb160 con 0x7fbe480ad960 2024-08-17T02:23:54.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.355+0000 7fbe4d600640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe480b0d10 con 0x7fbe480add30 2024-08-17T02:23:54.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.356+0000 7fbe46a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbe480ad960 0x7fbe4815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:54.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.356+0000 7fbe46a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbe480ad960 0x7fbe4815b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47246/0 (socket says 172.21.15.2:47246) 2024-08-17T02:23:54.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.356+0000 7fbe46a00640 1 -- 172.21.15.2:0/4278410444 learned_addr learned my addr 172.21.15.2:0/4278410444 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:54.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.356+0000 7fbe47400640 1 --2- 172.21.15.2:0/4278410444 >> v2:172.21.15.145:3300/0 conn(0x7fbe480add30 0x7fbe48156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:54.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.356+0000 7fbe46a00640 1 -- 172.21.15.2:0/4278410444 >> v2:172.21.15.145:3300/0 conn(0x7fbe480add30 msgr2=0x7fbe48156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:54.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.356+0000 7fbe46a00640 1 --2- 172.21.15.2:0/4278410444 >> v2:172.21.15.145:3300/0 conn(0x7fbe480add30 0x7fbe48156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:54.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.356+0000 7fbe46a00640 1 -- 172.21.15.2:0/4278410444 >> v1:172.21.15.2:6789/0 conn(0x7fbe480ca050 legacy=0x7fbe48156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:54.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.356+0000 7fbe46a00640 1 -- 172.21.15.2:0/4278410444 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe480ca550 con 0x7fbe480ad960 2024-08-17T02:23:54.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.357+0000 7fbe46a00640 1 --2- 172.21.15.2:0/4278410444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe480ad960 0x7fbe4815b0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbe480cb0d0 tx=0x7fbe380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcab33b5e4f68773 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:54.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.357+0000 7fbe45600640 1 -- 172.21.15.2:0/4278410444 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe38032440 con 0x7fbe480ad960 2024-08-17T02:23:54.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.357+0000 7fbe45600640 1 -- 172.21.15.2:0/4278410444 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe380325a0 con 0x7fbe480ad960 2024-08-17T02:23:54.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.357+0000 7fbe45600640 1 -- 172.21.15.2:0/4278410444 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe38032980 con 0x7fbe480ad960 2024-08-17T02:23:54.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.358+0000 7fbe4d600640 1 -- 172.21.15.2:0/4278410444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe480ad960 msgr2=0x7fbe4815b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:54.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.358+0000 7fbe4d600640 1 --2- 172.21.15.2:0/4278410444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe480ad960 0x7fbe4815b0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbe480cb0d0 tx=0x7fbe380091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:54.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.358+0000 7fbe4d600640 1 -- 172.21.15.2:0/4278410444 shutdown_connections 2024-08-17T02:23:54.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.358+0000 7fbe4d600640 1 --2- 172.21.15.2:0/4278410444 >> v2:172.21.15.145:3300/0 conn(0x7fbe480add30 0x7fbe48156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:54.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.358+0000 7fbe4d600640 1 --2- 172.21.15.2:0/4278410444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe480ad960 0x7fbe4815b0a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:54.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.358+0000 7fbe4d600640 1 -- 172.21.15.2:0/4278410444 >> 172.21.15.2:0/4278410444 conn(0x7fbe48066e60 msgr2=0x7fbe48067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:54.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.358+0000 7fbe4d600640 1 -- 172.21.15.2:0/4278410444 shutdown_connections 2024-08-17T02:23:54.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.358+0000 7fbe4d600640 1 -- 172.21.15.2:0/4278410444 wait complete. 2024-08-17T02:23:54.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.359+0000 7fbe4d600640 1 Processor -- start 2024-08-17T02:23:54.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.360+0000 7fbe4d600640 1 -- start start 2024-08-17T02:23:54.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.360+0000 7fbe4d600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe480ad960 0x7fbe480ac6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:54.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.360+0000 7fbe4d600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe480add30 0x7fbe480a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:54.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.360+0000 7fbe4d600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe480ca050 0x7fbe480a8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:54.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.360+0000 7fbe4d600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe48157100 con 0x7fbe480ca050 2024-08-17T02:23:54.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.360+0000 7fbe4d600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe48151a60 con 0x7fbe480ad960 2024-08-17T02:23:54.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.360+0000 7fbe4d600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480a9480 con 0x7fbe480add30 2024-08-17T02:23:54.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.361+0000 7fbe47400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe480ca050 0x7fbe480a8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:54.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.361+0000 7fbe47400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe480ca050 0x7fbe480a8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47262/0 (socket says 172.21.15.2:47262) 2024-08-17T02:23:54.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.361+0000 7fbe47400640 1 -- 172.21.15.2:0/2096744169 learned_addr learned my addr 172.21.15.2:0/2096744169 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:54.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.361+0000 7fbe46a00640 1 --2- 172.21.15.2:0/2096744169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe480ad960 0x7fbe480ac6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:54.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.361+0000 7fbe47400640 1 -- 172.21.15.2:0/2096744169 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe480add30 msgr2=0x7fbe480a88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:54.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.361+0000 7fbe46000640 1 --2- 172.21.15.2:0/2096744169 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe480add30 0x7fbe480a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:54.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.361+0000 7fbe47400640 1 --2- 172.21.15.2:0/2096744169 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe480add30 0x7fbe480a88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:54.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.361+0000 7fbe47400640 1 -- 172.21.15.2:0/2096744169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe480ad960 msgr2=0x7fbe480ac6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:54.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.361+0000 7fbe47400640 1 --2- 172.21.15.2:0/2096744169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe480ad960 0x7fbe480ac6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:54.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.361+0000 7fbe47400640 1 -- 172.21.15.2:0/2096744169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe38009450 con 0x7fbe480ca050 2024-08-17T02:23:54.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.361+0000 7fbe46a00640 1 --2- 172.21.15.2:0/2096744169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe480ad960 0x7fbe480ac6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:54.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.361+0000 7fbe46000640 1 --2- 172.21.15.2:0/2096744169 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe480add30 0x7fbe480a88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:54.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.361+0000 7fbe47400640 1 --2- 172.21.15.2:0/2096744169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe480ca050 0x7fbe480a8e20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbe40009fa0 tx=0x7fbe40009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:54.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.362+0000 7fbe3e000640 1 -- 172.21.15.2:0/2096744169 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4000ee60 con 0x7fbe480ca050 2024-08-17T02:23:54.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.362+0000 7fbe3e000640 1 -- 172.21.15.2:0/2096744169 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe40014420 con 0x7fbe480ca050 2024-08-17T02:23:54.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.362+0000 7fbe3e000640 1 -- 172.21.15.2:0/2096744169 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe400147e0 con 0x7fbe480ca050 2024-08-17T02:23:54.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.362+0000 7fbe4d600640 1 -- 172.21.15.2:0/2096744169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe480a9760 con 0x7fbe480ca050 2024-08-17T02:23:54.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.362+0000 7fbe4d600640 1 -- 172.21.15.2:0/2096744169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe48157630 con 0x7fbe480ca050 2024-08-17T02:23:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.363+0000 7fbe4d600640 1 -- 172.21.15.2:0/2096744169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe48157850 con 0x7fbe480ca050 2024-08-17T02:23:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.364+0000 7fbe3e000640 1 -- 172.21.15.2:0/2096744169 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbe40014b50 con 0x7fbe480ca050 2024-08-17T02:23:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.365+0000 7fbe3e000640 1 --2- 172.21.15.2:0/2096744169 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbe28065150 0x7fbe28067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.365+0000 7fbe3e000640 1 -- 172.21.15.2:0/2096744169 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbe40082ce0 con 0x7fbe480ca050 2024-08-17T02:23:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.365+0000 7fbe46a00640 1 --2- 172.21.15.2:0/2096744169 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbe28065150 0x7fbe28067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:54.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.366+0000 7fbe46a00640 1 --2- 172.21.15.2:0/2096744169 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbe28065150 0x7fbe28067600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbe38034000 tx=0x7fbe38032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:54.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.369+0000 7fbe3e000640 1 -- 172.21.15.2:0/2096744169 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbe40050d00 con 0x7fbe480ca050 2024-08-17T02:23:54.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.587+0000 7fbe4d600640 1 -- 172.21.15.2:0/2096744169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbe48063fb0 con 0x7fbe480ca050 2024-08-17T02:23:54.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.588+0000 7fbe3e000640 1 -- 172.21.15.2:0/2096744169 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbe40054320 con 0x7fbe480ca050 2024-08-17T02:23:54.589 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:23:54.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.590+0000 7fbe4d600640 1 -- 172.21.15.2:0/2096744169 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbe28065150 msgr2=0x7fbe28067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:54.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.590+0000 7fbe4d600640 1 --2- 172.21.15.2:0/2096744169 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbe28065150 0x7fbe28067600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbe38034000 tx=0x7fbe38032000 comp rx=0 tx=0).stop 2024-08-17T02:23:54.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.590+0000 7fbe4d600640 1 -- 172.21.15.2:0/2096744169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe480ca050 msgr2=0x7fbe480a8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:54.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.590+0000 7fbe4d600640 1 --2- 172.21.15.2:0/2096744169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe480ca050 0x7fbe480a8e20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbe40009fa0 tx=0x7fbe40009900 comp rx=0 tx=0).stop 2024-08-17T02:23:54.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.590+0000 7fbe4d600640 1 -- 172.21.15.2:0/2096744169 shutdown_connections 2024-08-17T02:23:54.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.590+0000 7fbe4d600640 1 --2- 172.21.15.2:0/2096744169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe480ca050 0x7fbe480a8e20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:54.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.590+0000 7fbe4d600640 1 --2- 172.21.15.2:0/2096744169 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbe28065150 0x7fbe28067600 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:54.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.590+0000 7fbe4d600640 1 --2- 172.21.15.2:0/2096744169 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe480add30 0x7fbe480a88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:54.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.590+0000 7fbe4d600640 1 --2- 172.21.15.2:0/2096744169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe480ad960 0x7fbe480ac6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:54.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.590+0000 7fbe4d600640 1 -- 172.21.15.2:0/2096744169 >> 172.21.15.2:0/2096744169 conn(0x7fbe48066e60 msgr2=0x7fbe48154940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:54.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.590+0000 7fbe4d600640 1 -- 172.21.15.2:0/2096744169 shutdown_connections 2024-08-17T02:23:54.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:54.590+0000 7fbe4d600640 1 -- 172.21.15.2:0/2096744169 wait complete. 2024-08-17T02:23:54.606 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:23:54.606 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:23:54.606 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi145.front.sepia.ceph.com 2024-08-17T02:23:54.606 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:23:54.606 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:23:54.606 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:23:54.606 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:23:54.606 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:23:54.606 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:23:54.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:54.606 DEBUG:teuthology.orchestra.run.smithi145:> ip addr 2024-08-17T02:23:54.647 INFO:teuthology.orchestra.run.smithi145.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:23:54.647 INFO:teuthology.orchestra.run.smithi145.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:23:54.647 INFO:teuthology.orchestra.run.smithi145.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:23:54.647 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:54.647 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 ::1/128 scope host 2024-08-17T02:23:54.647 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:54.647 INFO:teuthology.orchestra.run.smithi145.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:23:54.647 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:d9:38:66 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:54.648 INFO:teuthology.orchestra.run.smithi145.stdout: altname enp7s0f0 2024-08-17T02:23:54.648 INFO:teuthology.orchestra.run.smithi145.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:23:54.648 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:d9:38:67 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:54.648 INFO:teuthology.orchestra.run.smithi145.stdout: altname enp7s0f1 2024-08-17T02:23:54.648 INFO:teuthology.orchestra.run.smithi145.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:23:54.648 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:88:77:90 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:54.648 INFO:teuthology.orchestra.run.smithi145.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:23:54.648 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:88:77:91 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:54.648 INFO:teuthology.orchestra.run.smithi145.stdout: inet 172.21.15.145/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:23:54.648 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft 42625sec preferred_lft 42625sec 2024-08-17T02:23:54.648 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::ec4:7aff:fe88:7791/64 scope link 2024-08-17T02:23:54.648 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:54.649 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:23:54.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:54.649 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2024-08-17T02:23:54.649 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-08-17T02:23:54.649 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:23:54.649 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip addr flush dev ceph-brx 2024-08-17T02:23:54.649 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set ceph-brx up 2024-08-17T02:23:54.649 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:23:54.649 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-08-17T02:23:55.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:55.010 DEBUG:teuthology.orchestra.run.smithi145:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:23:55.068 INFO:teuthology.orchestra.run.smithi145.stdout:1 2024-08-17T02:23:55.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:55.077 DEBUG:teuthology.orchestra.run.smithi145:> route 2024-08-17T02:23:55.145 INFO:teuthology.orchestra.run.smithi145.stdout:Kernel IP routing table 2024-08-17T02:23:55.145 INFO:teuthology.orchestra.run.smithi145.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:23:55.146 INFO:teuthology.orchestra.run.smithi145.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:23:55.146 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:23:55.146 INFO:teuthology.orchestra.run.smithi145.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:23:55.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:55.146 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2024-08-17T02:23:55.146 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-08-17T02:23:55.146 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:23:55.146 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:23:55.146 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:23:55.147 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-08-17T02:23:55.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:55.670 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list 2024-08-17T02:23:55.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:55.707 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list-id 2024-08-17T02:23:55.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:55.784 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2024-08-17T02:23:55.784 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-08-17T02:23:55.784 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:23:55.784 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-17T02:23:55.784 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-08-17T02:23:55.909 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-17T02:23:55.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:55.910 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2024-08-17T02:23:55.910 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-08-17T02:23:55.910 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-17T02:23:55.910 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:23:55.910 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-17T02:23:55.910 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-17T02:23:55.910 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-17T02:23:55.910 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-08-17T02:23:56.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:56.103 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2024-08-17T02:23:56.104 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-08-17T02:23:56.104 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set brx.0 up 2024-08-17T02:23:56.104 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:23:56.104 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-08-17T02:23:56.220 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:23:56.220 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:23:56.255 INFO:teuthology.orchestra.run.smithi145.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:23:56.255 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:23:56.255 DEBUG:teuthology.orchestra.run.smithi145:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:23:56.330 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:23:56.330 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:23:56.330 DEBUG:teuthology.orchestra.run.smithi145:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:23:56.459 INFO:teuthology.orchestra.run.smithi145.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:23:56.459 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:23:57.088 INFO:teuthology.orchestra.run.smithi145.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:23:57.089 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:23:57.089 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.145:3300,172.21.15.145:3301" 2024-08-17T02:23:57.089 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: trying mount with new device syntax: 1@66491975-1283-4d8c-92e2-26a46f113139.cephfs=/ 2024-08-17T02:23:57.089 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.2:3300/172.21.15.145:3300/172.21.15.145:3301" will pass to kernel 2024-08-17T02:23:57.089 INFO:teuthology.orchestra.run.smithi145.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:23:57.089 INFO:teuthology.orchestra.run.smithi145.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:23:57.090 INFO:teuthology.orchestra.run.smithi145.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:23:57.090 INFO:teuthology.orchestra.run.smithi145.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:23:57.090 INFO:teuthology.orchestra.run.smithi145.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:23:57.092 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:23:57.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:57.093 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:23:57.149 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-08-17T02:23:57.149 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:23:57.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.310+0000 7fcf93200640 1 Processor -- start 2024-08-17T02:23:57.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.310+0000 7fcf93200640 1 -- start start 2024-08-17T02:23:57.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.311+0000 7fcf93200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf940cd550 0x7fcf9415ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:57.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.311+0000 7fcf93200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9415c9d0 con 0x7fcf94069840 2024-08-17T02:23:57.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.311+0000 7fcf93200640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9415a200 con 0x7fcf94159cd0 2024-08-17T02:23:57.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.311+0000 7fcf93200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf940cbfe0 con 0x7fcf940cd550 2024-08-17T02:23:57.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.311+0000 7fcf91e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fcf94069840 0x7fcf940cb8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58990/0 (socket says 172.21.15.2:58990) 2024-08-17T02:23:57.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.311+0000 7fcf91e00640 1 -- 172.21.15.2:0/2819362185 learned_addr learned my addr 172.21.15.2:0/2819362185 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:23:57.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.311+0000 7fcf91400640 1 --2- 172.21.15.2:0/2819362185 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf940cd550 0x7fcf9415ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:57.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.312+0000 7fcf90a00640 1 -- 172.21.15.2:0/2819362185 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407087113 0 0) 0x7fcf9415c9d0 con 0x7fcf94069840 2024-08-17T02:23:57.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.312+0000 7fcf90a00640 1 -- 172.21.15.2:0/2819362185 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf780034e0 con 0x7fcf94069840 2024-08-17T02:23:57.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.312+0000 7fcf91400640 1 -- 172.21.15.2:0/2819362185 >> v1:172.21.15.145:6789/0 conn(0x7fcf94159cd0 legacy=0x7fcf940ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:57.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.312+0000 7fcf90a00640 1 -- 172.21.15.2:0/2819362185 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194928655 0 0) 0x7fcf9415a200 con 0x7fcf94159cd0 2024-08-17T02:23:57.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.312+0000 7fcf91400640 1 -- 172.21.15.2:0/2819362185 >> v1:172.21.15.2:6789/0 conn(0x7fcf94069840 legacy=0x7fcf940cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:57.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.312+0000 7fcf91400640 1 -- 172.21.15.2:0/2819362185 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf940b0830 con 0x7fcf940cd550 2024-08-17T02:23:57.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.313+0000 7fcf91400640 1 --2- 172.21.15.2:0/2819362185 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf940cd550 0x7fcf9415ce60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009880 tx=0x7fcf800090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8015434de7d46d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:57.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.313+0000 7fcf90a00640 1 -- 172.21.15.2:0/2819362185 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8002ae10 con 0x7fcf940cd550 2024-08-17T02:23:57.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.313+0000 7fcf90a00640 1 -- 172.21.15.2:0/2819362185 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf80032440 con 0x7fcf940cd550 2024-08-17T02:23:57.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.313+0000 7fcf90a00640 1 -- 172.21.15.2:0/2819362185 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf800327e0 con 0x7fcf940cd550 2024-08-17T02:23:57.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.314+0000 7fcf93200640 1 -- 172.21.15.2:0/2819362185 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf940cd550 msgr2=0x7fcf9415ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:57.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.314+0000 7fcf93200640 1 --2- 172.21.15.2:0/2819362185 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf940cd550 0x7fcf9415ce60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009880 tx=0x7fcf800090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:57.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.314+0000 7fcf93200640 1 -- 172.21.15.2:0/2819362185 shutdown_connections 2024-08-17T02:23:57.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.314+0000 7fcf93200640 1 --2- 172.21.15.2:0/2819362185 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf940cd550 0x7fcf9415ce60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:57.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.314+0000 7fcf93200640 1 -- 172.21.15.2:0/2819362185 >> 172.21.15.2:0/2819362185 conn(0x7fcf94066e60 msgr2=0x7fcf94067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:57.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.314+0000 7fcf93200640 1 -- 172.21.15.2:0/2819362185 shutdown_connections 2024-08-17T02:23:57.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.314+0000 7fcf93200640 1 -- 172.21.15.2:0/2819362185 wait complete. 2024-08-17T02:23:57.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.315+0000 7fcf93200640 1 Processor -- start 2024-08-17T02:23:57.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.316+0000 7fcf93200640 1 -- start start 2024-08-17T02:23:57.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.316+0000 7fcf93200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf94069840 0x7fcf94155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:57.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.316+0000 7fcf93200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf94159cd0 0x7fcf940aa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:57.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.316+0000 7fcf93200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf94153850 0x7fcf94068380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:57.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.316+0000 7fcf93200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf940aaa60 con 0x7fcf94069840 2024-08-17T02:23:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.316+0000 7fcf93200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf940aacc0 con 0x7fcf94159cd0 2024-08-17T02:23:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.316+0000 7fcf93200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf940aafa0 con 0x7fcf94153850 2024-08-17T02:23:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.317+0000 7fcf91e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf94069840 0x7fcf94155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.317+0000 7fcf91e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf94069840 0x7fcf94155330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44258/0 (socket says 172.21.15.2:44258) 2024-08-17T02:23:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.317+0000 7fcf91400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf94159cd0 0x7fcf940aa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.317+0000 7fcf91e00640 1 -- 172.21.15.2:0/3586742720 learned_addr learned my addr 172.21.15.2:0/3586742720 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.317+0000 7fcf92800640 1 --2- 172.21.15.2:0/3586742720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf94153850 0x7fcf94068380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.317+0000 7fcf91e00640 1 -- 172.21.15.2:0/3586742720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf94153850 msgr2=0x7fcf94068380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.317+0000 7fcf91e00640 1 --2- 172.21.15.2:0/3586742720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf94153850 0x7fcf94068380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.317+0000 7fcf91e00640 1 -- 172.21.15.2:0/3586742720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf94159cd0 msgr2=0x7fcf940aa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.317+0000 7fcf91e00640 1 --2- 172.21.15.2:0/3586742720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf94159cd0 0x7fcf940aa520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.317+0000 7fcf91e00640 1 -- 172.21.15.2:0/3586742720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf80009390 con 0x7fcf94069840 2024-08-17T02:23:57.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.317+0000 7fcf91e00640 1 --2- 172.21.15.2:0/3586742720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf94069840 0x7fcf94155330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400c560 tx=0x7fcf84007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:57.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.318+0000 7fcf89600640 1 -- 172.21.15.2:0/3586742720 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf84005aa0 con 0x7fcf94069840 2024-08-17T02:23:57.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.318+0000 7fcf89600640 1 -- 172.21.15.2:0/3586742720 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf84005c00 con 0x7fcf94069840 2024-08-17T02:23:57.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.318+0000 7fcf89600640 1 -- 172.21.15.2:0/3586742720 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf840070d0 con 0x7fcf94069840 2024-08-17T02:23:57.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.318+0000 7fcf93200640 1 -- 172.21.15.2:0/3586742720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf940ab280 con 0x7fcf94069840 2024-08-17T02:23:57.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.318+0000 7fcf93200640 1 -- 172.21.15.2:0/3586742720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf940ad9f0 con 0x7fcf94069840 2024-08-17T02:23:57.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.319+0000 7fcf93200640 1 -- 172.21.15.2:0/3586742720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf94070720 con 0x7fcf94069840 2024-08-17T02:23:57.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.320+0000 7fcf89600640 1 -- 172.21.15.2:0/3586742720 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcf840074c0 con 0x7fcf94069840 2024-08-17T02:23:57.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.320+0000 7fcf89600640 1 --2- 172.21.15.2:0/3586742720 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fcf74065180 0x7fcf74067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:57.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.321+0000 7fcf89600640 1 -- 172.21.15.2:0/3586742720 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcf840818f0 con 0x7fcf94069840 2024-08-17T02:23:57.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.321+0000 7fcf91400640 1 --2- 172.21.15.2:0/3586742720 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fcf74065180 0x7fcf74067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:57.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.322+0000 7fcf91400640 1 --2- 172.21.15.2:0/3586742720 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fcf74065180 0x7fcf74067630 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcf80034000 tx=0x7fcf80032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:57.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.324+0000 7fcf89600640 1 -- 172.21.15.2:0/3586742720 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcf8404f9c0 con 0x7fcf94069840 2024-08-17T02:23:57.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.544+0000 7fcf93200640 1 -- 172.21.15.2:0/3586742720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcf940adca0 con 0x7fcf94069840 2024-08-17T02:23:57.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.545+0000 7fcf89600640 1 -- 172.21.15.2:0/3586742720 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcf84017060 con 0x7fcf94069840 2024-08-17T02:23:57.546 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:23:57.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.547+0000 7fcf93200640 1 -- 172.21.15.2:0/3586742720 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fcf74065180 msgr2=0x7fcf74067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:57.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.547+0000 7fcf93200640 1 --2- 172.21.15.2:0/3586742720 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fcf74065180 0x7fcf74067630 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcf80034000 tx=0x7fcf80032000 comp rx=0 tx=0).stop 2024-08-17T02:23:57.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.547+0000 7fcf93200640 1 -- 172.21.15.2:0/3586742720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf94069840 msgr2=0x7fcf94155330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:57.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.547+0000 7fcf93200640 1 --2- 172.21.15.2:0/3586742720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf94069840 0x7fcf94155330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400c560 tx=0x7fcf84007d60 comp rx=0 tx=0).stop 2024-08-17T02:23:57.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.547+0000 7fcf93200640 1 -- 172.21.15.2:0/3586742720 shutdown_connections 2024-08-17T02:23:57.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.547+0000 7fcf93200640 1 --2- 172.21.15.2:0/3586742720 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fcf74065180 0x7fcf74067630 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:57.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.547+0000 7fcf93200640 1 --2- 172.21.15.2:0/3586742720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf94153850 0x7fcf94068380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:57.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.547+0000 7fcf93200640 1 --2- 172.21.15.2:0/3586742720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf94159cd0 0x7fcf940aa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:57.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.547+0000 7fcf93200640 1 --2- 172.21.15.2:0/3586742720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf94069840 0x7fcf94155330 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:57.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.547+0000 7fcf93200640 1 -- 172.21.15.2:0/3586742720 >> 172.21.15.2:0/3586742720 conn(0x7fcf94066e60 msgr2=0x7fcf940cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:57.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.547+0000 7fcf93200640 1 -- 172.21.15.2:0/3586742720 shutdown_connections 2024-08-17T02:23:57.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:57.547+0000 7fcf93200640 1 -- 172.21.15.2:0/3586742720 wait complete. 2024-08-17T02:23:57.563 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:23:57.563 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:23:57.563 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi145.front.sepia.ceph.com 2024-08-17T02:23:57.563 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-08-17T02:23:57.563 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-17T02:23:57.563 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:23:57.564 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:23:57.564 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:23:57.564 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:23:57.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:57.564 DEBUG:teuthology.orchestra.run.smithi145:> ip addr 2024-08-17T02:23:57.600 INFO:teuthology.orchestra.run.smithi145.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:23:57.600 INFO:teuthology.orchestra.run.smithi145.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:23:57.600 INFO:teuthology.orchestra.run.smithi145.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:23:57.600 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:57.600 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 ::1/128 scope host 2024-08-17T02:23:57.601 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:57.601 INFO:teuthology.orchestra.run.smithi145.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:23:57.601 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:d9:38:66 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:57.601 INFO:teuthology.orchestra.run.smithi145.stdout: altname enp7s0f0 2024-08-17T02:23:57.601 INFO:teuthology.orchestra.run.smithi145.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:23:57.601 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:d9:38:67 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:57.601 INFO:teuthology.orchestra.run.smithi145.stdout: altname enp7s0f1 2024-08-17T02:23:57.601 INFO:teuthology.orchestra.run.smithi145.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:23:57.601 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:88:77:90 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:57.601 INFO:teuthology.orchestra.run.smithi145.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:23:57.601 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:88:77:91 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:57.601 INFO:teuthology.orchestra.run.smithi145.stdout: inet 172.21.15.145/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:23:57.602 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft 42622sec preferred_lft 42622sec 2024-08-17T02:23:57.602 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::ec4:7aff:fe88:7791/64 scope link 2024-08-17T02:23:57.602 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:57.602 INFO:teuthology.orchestra.run.smithi145.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:23:57.602 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 62:2d:db:26:6a:1a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:57.602 INFO:teuthology.orchestra.run.smithi145.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:23:57.602 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:57.602 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::68d8:59ff:fedb:b93e/64 scope link 2024-08-17T02:23:57.602 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:57.602 INFO:teuthology.orchestra.run.smithi145.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:23:57.602 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 62:2d:db:26:6a:1a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:23:57.602 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::602d:dbff:fe26:6a1a/64 scope link tentative 2024-08-17T02:23:57.603 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:57.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:57.603 DEBUG:teuthology.orchestra.run.smithi145:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:23:57.694 INFO:teuthology.orchestra.run.smithi145.stdout:1 2024-08-17T02:23:57.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:57.697 DEBUG:teuthology.orchestra.run.smithi145:> route 2024-08-17T02:23:57.733 INFO:teuthology.orchestra.run.smithi145.stdout:Kernel IP routing table 2024-08-17T02:23:57.734 INFO:teuthology.orchestra.run.smithi145.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:23:57.734 INFO:teuthology.orchestra.run.smithi145.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:23:57.734 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:23:57.734 INFO:teuthology.orchestra.run.smithi145.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:23:57.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:57.734 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2024-08-17T02:23:57.734 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-08-17T02:23:57.734 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:23:57.734 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:23:57.735 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:23:57.735 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-08-17T02:23:57.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:57.879 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list 2024-08-17T02:23:57.915 INFO:teuthology.orchestra.run.smithi145.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:23:57.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:57.915 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list-id 2024-08-17T02:23:57.990 INFO:teuthology.orchestra.run.smithi145.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-08-17T02:23:57.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:57.991 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2024-08-17T02:23:57.991 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-08-17T02:23:57.991 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:23:57.991 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-08-17T02:23:57.991 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-08-17T02:23:58.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:58.117 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:23:58.173 INFO:teuthology.orchestra.run.smithi145.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:23:58.173 INFO:teuthology.orchestra.run.smithi145.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:23:58.173 INFO:teuthology.orchestra.run.smithi145.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:23:58.173 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:58.173 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 ::1/128 scope host 2024-08-17T02:23:58.173 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:58.173 INFO:teuthology.orchestra.run.smithi145.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:23:58.173 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 5a:2d:9a:00:97:ca brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:23:58.173 INFO:teuthology.orchestra.run.smithi145.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:23:58.173 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:58.174 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::582d:9aff:fe00:97ca/64 scope link 2024-08-17T02:23:58.174 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:58.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:58.175 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:23:58.231 INFO:teuthology.orchestra.run.smithi145.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:23:58.231 INFO:teuthology.orchestra.run.smithi145.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:23:58.231 INFO:teuthology.orchestra.run.smithi145.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:23:58.231 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:58.231 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 ::1/128 scope host 2024-08-17T02:23:58.231 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:58.231 INFO:teuthology.orchestra.run.smithi145.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:23:58.231 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 5a:2d:9a:00:97:ca brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:23:58.231 INFO:teuthology.orchestra.run.smithi145.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:23:58.231 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:58.232 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::582d:9aff:fe00:97ca/64 scope link 2024-08-17T02:23:58.232 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:58.233 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-08-17T02:23:58.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:58.234 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2024-08-17T02:23:58.234 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-08-17T02:23:58.234 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-08-17T02:23:58.234 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:23:58.234 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-08-17T02:23:58.234 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-08-17T02:23:58.234 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-08-17T02:23:58.235 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-08-17T02:23:58.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:58.399 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2024-08-17T02:23:58.399 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-08-17T02:23:58.399 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set brx.1 up 2024-08-17T02:23:58.399 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:23:58.399 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-08-17T02:23:58.513 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:23:58.513 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-08-17T02:23:58.548 INFO:teuthology.orchestra.run.smithi145.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:23:58.549 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:23:58.549 DEBUG:teuthology.orchestra.run.smithi145:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:23:58.624 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-08-17T02:23:58.624 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:23:58.624 DEBUG:teuthology.orchestra.run.smithi145:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:23:58.747 INFO:teuthology.orchestra.run.smithi145.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:23:58.747 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:23:58.773 INFO:teuthology.orchestra.run.smithi145.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:23:58.773 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:23:58.773 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.145:3300,172.21.15.145:3301" 2024-08-17T02:23:58.774 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: trying mount with new device syntax: 3@66491975-1283-4d8c-92e2-26a46f113139.cephfs=/ 2024-08-17T02:23:58.774 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.2:3300/172.21.15.145:3300/172.21.15.145:3301" will pass to kernel 2024-08-17T02:23:58.774 INFO:teuthology.orchestra.run.smithi145.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-08-17T02:23:58.774 INFO:teuthology.orchestra.run.smithi145.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:23:58.774 INFO:teuthology.orchestra.run.smithi145.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:23:58.774 INFO:teuthology.orchestra.run.smithi145.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:23:58.775 INFO:teuthology.orchestra.run.smithi145.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:23:58.777 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:23:58.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:58.778 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:23:58.833 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-08-17T02:23:58.850 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:59.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.011+0000 7fcb91c00640 1 Processor -- start 2024-08-17T02:23:59.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.011+0000 7fcb91c00640 1 -- start start 2024-08-17T02:23:59.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.012+0000 7fcb91c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcb8c0afca0 0x7fcb8c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.012+0000 7fcb91c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb8c0acf10 0x7fcb8c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.013+0000 7fcb91c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb8c15a4e0 con 0x7fcb8c1589a0 2024-08-17T02:23:59.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.013+0000 7fcb91c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8c0b0980 con 0x7fcb8c0afca0 2024-08-17T02:23:59.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.013+0000 7fcb91c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c0c92b0 con 0x7fcb8c0acf10 2024-08-17T02:23:59.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.013+0000 7fcb8aa00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcb8c0afca0 0x7fcb8c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.013+0000 7fcb8aa00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcb8c0afca0 0x7fcb8c0b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44264/0 (socket says 172.21.15.2:44264) 2024-08-17T02:23:59.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.013+0000 7fcb8aa00640 1 -- 172.21.15.2:0/2058120137 learned_addr learned my addr 172.21.15.2:0/2058120137 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:59.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.013+0000 7fcb83e00640 1 --2- 172.21.15.2:0/2058120137 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb8c0acf10 0x7fcb8c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.013+0000 7fcb8aa00640 1 -- 172.21.15.2:0/2058120137 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb8c0acf10 msgr2=0x7fcb8c159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:59.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.013+0000 7fcb8aa00640 1 --2- 172.21.15.2:0/2058120137 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb8c0acf10 0x7fcb8c159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.013+0000 7fcb8aa00640 1 -- 172.21.15.2:0/2058120137 >> v1:172.21.15.2:6789/0 conn(0x7fcb8c1589a0 legacy=0x7fcb8c06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:59.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.013+0000 7fcb8aa00640 1 -- 172.21.15.2:0/2058120137 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8c0ad480 con 0x7fcb8c0afca0 2024-08-17T02:23:59.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.014+0000 7fcb8aa00640 1 --2- 172.21.15.2:0/2058120137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb8c0afca0 0x7fcb8c0b0070 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c009940 tx=0x7fcb7c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9202a4c60f17548c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:59.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.015+0000 7fcb8a000640 1 -- 172.21.15.2:0/2058120137 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c02ae40 con 0x7fcb8c0afca0 2024-08-17T02:23:59.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.015+0000 7fcb8a000640 1 -- 172.21.15.2:0/2058120137 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7c032440 con 0x7fcb8c0afca0 2024-08-17T02:23:59.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.015+0000 7fcb8a000640 1 -- 172.21.15.2:0/2058120137 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c032820 con 0x7fcb8c0afca0 2024-08-17T02:23:59.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.015+0000 7fcb91c00640 1 -- 172.21.15.2:0/2058120137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb8c0afca0 msgr2=0x7fcb8c0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:59.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.015+0000 7fcb91c00640 1 --2- 172.21.15.2:0/2058120137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb8c0afca0 0x7fcb8c0b0070 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c009940 tx=0x7fcb7c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.015+0000 7fcb91c00640 1 -- 172.21.15.2:0/2058120137 shutdown_connections 2024-08-17T02:23:59.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.015+0000 7fcb91c00640 1 --2- 172.21.15.2:0/2058120137 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb8c0acf10 0x7fcb8c159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.015+0000 7fcb91c00640 1 --2- 172.21.15.2:0/2058120137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb8c0afca0 0x7fcb8c0b0070 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.015+0000 7fcb91c00640 1 -- 172.21.15.2:0/2058120137 >> 172.21.15.2:0/2058120137 conn(0x7fcb8c066e60 msgr2=0x7fcb8c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:59.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.015+0000 7fcb91c00640 1 -- 172.21.15.2:0/2058120137 shutdown_connections 2024-08-17T02:23:59.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.015+0000 7fcb91c00640 1 -- 172.21.15.2:0/2058120137 wait complete. 2024-08-17T02:23:59.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.017+0000 7fcb91c00640 1 Processor -- start 2024-08-17T02:23:59.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.017+0000 7fcb91c00640 1 -- start start 2024-08-17T02:23:59.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.018+0000 7fcb91c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb8c0acf10 0x7fcb8c0a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.018+0000 7fcb91c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb8c0afca0 0x7fcb8c1482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.018+0000 7fcb91c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb8c1589a0 0x7fcb8c0c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.018+0000 7fcb91c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c0a4ea0 con 0x7fcb8c0acf10 2024-08-17T02:23:59.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.018+0000 7fcb91c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c0a5870 con 0x7fcb8c0afca0 2024-08-17T02:23:59.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.018+0000 7fcb91c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c0a4570 con 0x7fcb8c1589a0 2024-08-17T02:23:59.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.018+0000 7fcb8aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb8c0acf10 0x7fcb8c0a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.018+0000 7fcb8aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb8c0acf10 0x7fcb8c0a5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44268/0 (socket says 172.21.15.2:44268) 2024-08-17T02:23:59.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.018+0000 7fcb8aa00640 1 -- 172.21.15.2:0/4079985058 learned_addr learned my addr 172.21.15.2:0/4079985058 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:59.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.018+0000 7fcb8b400640 1 --2- 172.21.15.2:0/4079985058 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb8c1589a0 0x7fcb8c0c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.018+0000 7fcb83e00640 1 --2- 172.21.15.2:0/4079985058 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb8c0afca0 0x7fcb8c1482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.018+0000 7fcb8aa00640 1 -- 172.21.15.2:0/4079985058 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb8c1589a0 msgr2=0x7fcb8c0c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:59.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.018+0000 7fcb8aa00640 1 --2- 172.21.15.2:0/4079985058 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb8c1589a0 0x7fcb8c0c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.018+0000 7fcb8aa00640 1 -- 172.21.15.2:0/4079985058 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb8c0afca0 msgr2=0x7fcb8c1482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:59.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.018+0000 7fcb8aa00640 1 --2- 172.21.15.2:0/4079985058 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb8c0afca0 0x7fcb8c1482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.018+0000 7fcb8aa00640 1 -- 172.21.15.2:0/4079985058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7c009450 con 0x7fcb8c0acf10 2024-08-17T02:23:59.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.019+0000 7fcb8aa00640 1 --2- 172.21.15.2:0/4079985058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb8c0acf10 0x7fcb8c0a5330 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c035040 tx=0x7fcb7c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:59.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.019+0000 7fcb82000640 1 -- 172.21.15.2:0/4079985058 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c031bb0 con 0x7fcb8c0acf10 2024-08-17T02:23:59.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.019+0000 7fcb82000640 1 -- 172.21.15.2:0/4079985058 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7c031d70 con 0x7fcb8c0acf10 2024-08-17T02:23:59.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.019+0000 7fcb82000640 1 -- 172.21.15.2:0/4079985058 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c03d670 con 0x7fcb8c0acf10 2024-08-17T02:23:59.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.019+0000 7fcb91c00640 1 -- 172.21.15.2:0/4079985058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8c0a4850 con 0x7fcb8c0acf10 2024-08-17T02:23:59.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.019+0000 7fcb91c00640 1 -- 172.21.15.2:0/4079985058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb8c1583a0 con 0x7fcb8c0acf10 2024-08-17T02:23:59.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.020+0000 7fcb91c00640 1 -- 172.21.15.2:0/4079985058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8c063fb0 con 0x7fcb8c0acf10 2024-08-17T02:23:59.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.021+0000 7fcb82000640 1 -- 172.21.15.2:0/4079985058 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcb7c039040 con 0x7fcb8c0acf10 2024-08-17T02:23:59.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.022+0000 7fcb82000640 1 --2- 172.21.15.2:0/4079985058 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fcb68065180 0x7fcb68067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.022+0000 7fcb82000640 1 -- 172.21.15.2:0/4079985058 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcb7c02ae40 con 0x7fcb8c0acf10 2024-08-17T02:23:59.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.022+0000 7fcb83e00640 1 --2- 172.21.15.2:0/4079985058 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fcb68065180 0x7fcb68067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.023+0000 7fcb83e00640 1 --2- 172.21.15.2:0/4079985058 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fcb68065180 0x7fcb68067630 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0ca8f0 tx=0x7fcb74008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:59.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.026+0000 7fcb82000640 1 -- 172.21.15.2:0/4079985058 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcb7c0702d0 con 0x7fcb8c0acf10 2024-08-17T02:23:59.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.210+0000 7fcb91c00640 1 -- 172.21.15.2:0/4079985058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb8c067b70 con 0x7fcb8c0acf10 2024-08-17T02:23:59.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.211+0000 7fcb82000640 1 -- 172.21.15.2:0/4079985058 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fcb7c0738f0 con 0x7fcb8c0acf10 2024-08-17T02:23:59.213 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:23:59.213 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:23:32.955197+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:29.708835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:30.361908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.213+0000 7fcb91c00640 1 -- 172.21.15.2:0/4079985058 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fcb68065180 msgr2=0x7fcb68067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.213+0000 7fcb91c00640 1 --2- 172.21.15.2:0/4079985058 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fcb68065180 0x7fcb68067630 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0ca8f0 tx=0x7fcb74008040 comp rx=0 tx=0).stop 2024-08-17T02:23:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.214+0000 7fcb91c00640 1 -- 172.21.15.2:0/4079985058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb8c0acf10 msgr2=0x7fcb8c0a5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.214+0000 7fcb91c00640 1 --2- 172.21.15.2:0/4079985058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb8c0acf10 0x7fcb8c0a5330 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c035040 tx=0x7fcb7c032000 comp rx=0 tx=0).stop 2024-08-17T02:23:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.214+0000 7fcb91c00640 1 -- 172.21.15.2:0/4079985058 shutdown_connections 2024-08-17T02:23:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.214+0000 7fcb91c00640 1 --2- 172.21.15.2:0/4079985058 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fcb68065180 0x7fcb68067630 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.214+0000 7fcb91c00640 1 --2- 172.21.15.2:0/4079985058 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb8c1589a0 0x7fcb8c0c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.214+0000 7fcb91c00640 1 --2- 172.21.15.2:0/4079985058 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb8c0afca0 0x7fcb8c1482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.214+0000 7fcb91c00640 1 --2- 172.21.15.2:0/4079985058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb8c0acf10 0x7fcb8c0a5330 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.214+0000 7fcb91c00640 1 -- 172.21.15.2:0/4079985058 >> 172.21.15.2:0/4079985058 conn(0x7fcb8c066e60 msgr2=0x7fcb8c0cb700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:59.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.214+0000 7fcb91c00640 1 -- 172.21.15.2:0/4079985058 shutdown_connections 2024-08-17T02:23:59.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.214+0000 7fcb91c00640 1 -- 172.21.15.2:0/4079985058 wait complete. 2024-08-17T02:23:59.230 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:23:26.107978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:23:29.708835+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:23:30.361908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:23:59.231 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:23:59.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.383+0000 7f967de00640 1 Processor -- start 2024-08-17T02:23:59.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.384+0000 7f967de00640 1 -- start start 2024-08-17T02:23:59.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.385+0000 7f967de00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96780b0ac0 0x7f96780add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.385+0000 7f967de00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96780ae860 0x7f96780ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.385+0000 7f967de00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96780ad8a0 con 0x7f9678158e60 2024-08-17T02:23:59.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.385+0000 7f967de00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f967806edf0 con 0x7f96780ae860 2024-08-17T02:23:59.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.385+0000 7f967de00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96780acc90 con 0x7f96780b0ac0 2024-08-17T02:23:59.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.385+0000 7f9677400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96780ae860 0x7f96780ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.385+0000 7f966fe00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96780b0ac0 0x7f96780add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.385+0000 7f9677400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96780ae860 0x7f96780ac5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:52598/0 (socket says 172.21.15.2:52598) 2024-08-17T02:23:59.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.385+0000 7f9677400640 1 -- 172.21.15.2:0/689070424 learned_addr learned my addr 172.21.15.2:0/689070424 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:59.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.385+0000 7f9676a00640 1 --1- 172.21.15.2:0/689070424 >> v1:172.21.15.145:6789/0 conn(0x7f9678158e60 0x7f96780b03b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:52114/0 (socket says 172.21.15.2:52114) 2024-08-17T02:23:59.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.386+0000 7f966fe00640 1 -- 172.21.15.2:0/689070424 >> v2:172.21.15.145:3300/0 conn(0x7f96780ae860 msgr2=0x7f96780ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:59.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.386+0000 7f966fe00640 1 --2- 172.21.15.2:0/689070424 >> v2:172.21.15.145:3300/0 conn(0x7f96780ae860 0x7f96780ac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.386+0000 7f966fe00640 1 -- 172.21.15.2:0/689070424 >> v1:172.21.15.145:6789/0 conn(0x7f9678158e60 legacy=0x7f96780b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:59.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.386+0000 7f966fe00640 1 -- 172.21.15.2:0/689070424 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96780acf70 con 0x7f96780b0ac0 2024-08-17T02:23:59.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.386+0000 7f9677400640 1 --2- 172.21.15.2:0/689070424 >> v2:172.21.15.145:3300/0 conn(0x7f96780ae860 0x7f96780ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:59.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.386+0000 7f9676000640 1 -- 172.21.15.2:0/689070424 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2001146158 0 0) 0x7f96780ad8a0 con 0x7f9678158e60 2024-08-17T02:23:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.387+0000 7f966fe00640 1 --2- 172.21.15.2:0/689070424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96780b0ac0 0x7f96780add30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f966000baf0 tx=0x7f966000b3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5a512ce7a5ae94c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.387+0000 7f9676000640 1 -- 172.21.15.2:0/689070424 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96600325e0 con 0x7f96780b0ac0 2024-08-17T02:23:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.387+0000 7f9676000640 1 -- 172.21.15.2:0/689070424 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9660032740 con 0x7f96780b0ac0 2024-08-17T02:23:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.387+0000 7f9676000640 1 -- 172.21.15.2:0/689070424 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9660032ae0 con 0x7f96780b0ac0 2024-08-17T02:23:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.388+0000 7f967de00640 1 -- 172.21.15.2:0/689070424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96780b0ac0 msgr2=0x7f96780add30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.388+0000 7f967de00640 1 --2- 172.21.15.2:0/689070424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96780b0ac0 0x7f96780add30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f966000baf0 tx=0x7f966000b3b0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.388+0000 7f967de00640 1 -- 172.21.15.2:0/689070424 shutdown_connections 2024-08-17T02:23:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.388+0000 7f967de00640 1 --2- 172.21.15.2:0/689070424 >> v2:172.21.15.145:3300/0 conn(0x7f96780ae860 0x7f96780ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.388+0000 7f967de00640 1 --2- 172.21.15.2:0/689070424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96780b0ac0 0x7f96780add30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.388+0000 7f967de00640 1 -- 172.21.15.2:0/689070424 >> 172.21.15.2:0/689070424 conn(0x7f96780cc390 msgr2=0x7f9678066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.388+0000 7f967de00640 1 -- 172.21.15.2:0/689070424 shutdown_connections 2024-08-17T02:23:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.388+0000 7f967de00640 1 -- 172.21.15.2:0/689070424 wait complete. 2024-08-17T02:23:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.389+0000 7f967de00640 1 Processor -- start 2024-08-17T02:23:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.389+0000 7f967de00640 1 -- start start 2024-08-17T02:23:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.390+0000 7f967de00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96780ae860 0x7f96781410c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.390+0000 7f967de00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96780b0ac0 0x7f96780aa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.390+0000 7f967de00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9678158e60 0x7f9678150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.390+0000 7f967de00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96780c9260 con 0x7f9678158e60 2024-08-17T02:23:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.390+0000 7f967de00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96780c9b00 con 0x7f96780ae860 2024-08-17T02:23:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.390+0000 7f967de00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96780aa850 con 0x7f96780b0ac0 2024-08-17T02:23:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.391+0000 7f9677400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9678158e60 0x7f9678150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.391+0000 7f9677400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9678158e60 0x7f9678150de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44274/0 (socket says 172.21.15.2:44274) 2024-08-17T02:23:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.391+0000 7f966fe00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96780b0ac0 0x7f96780aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.391+0000 7f9677400640 1 -- 172.21.15.2:0/1972933971 learned_addr learned my addr 172.21.15.2:0/1972933971 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.391+0000 7f9676a00640 1 --2- 172.21.15.2:0/1972933971 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96780ae860 0x7f96781410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.391+0000 7f9677400640 1 -- 172.21.15.2:0/1972933971 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96780b0ac0 msgr2=0x7f96780aa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.391+0000 7f9677400640 1 --2- 172.21.15.2:0/1972933971 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96780b0ac0 0x7f96780aa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.391+0000 7f9677400640 1 -- 172.21.15.2:0/1972933971 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96780ae860 msgr2=0x7f96781410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.391+0000 7f9677400640 1 --2- 172.21.15.2:0/1972933971 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96780ae860 0x7f96781410c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.391+0000 7f9677400640 1 -- 172.21.15.2:0/1972933971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9670009ae0 con 0x7f9678158e60 2024-08-17T02:23:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.391+0000 7f9677400640 1 --2- 172.21.15.2:0/1972933971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9678158e60 0x7f9678150de0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f967000c0c0 tx=0x7f967000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.392+0000 7f966e000640 1 -- 172.21.15.2:0/1972933971 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9670018070 con 0x7f9678158e60 2024-08-17T02:23:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.392+0000 7f966e000640 1 -- 172.21.15.2:0/1972933971 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967000f040 con 0x7f9678158e60 2024-08-17T02:23:59.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.392+0000 7f966e000640 1 -- 172.21.15.2:0/1972933971 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96700092e0 con 0x7f9678158e60 2024-08-17T02:23:59.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.392+0000 7f967de00640 1 -- 172.21.15.2:0/1972933971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f966000b630 con 0x7f9678158e60 2024-08-17T02:23:59.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.392+0000 7f967de00640 1 -- 172.21.15.2:0/1972933971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96780c9790 con 0x7f9678158e60 2024-08-17T02:23:59.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.393+0000 7f967de00640 1 -- 172.21.15.2:0/1972933971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96780c9c90 con 0x7f9678158e60 2024-08-17T02:23:59.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.393+0000 7f966e000640 1 -- 172.21.15.2:0/1972933971 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9670003020 con 0x7f9678158e60 2024-08-17T02:23:59.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.394+0000 7f966e000640 1 --2- 172.21.15.2:0/1972933971 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9654065150 0x7f9654067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.394+0000 7f966e000640 1 -- 172.21.15.2:0/1972933971 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9670082a00 con 0x7f9678158e60 2024-08-17T02:23:59.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.395+0000 7f9676a00640 1 --2- 172.21.15.2:0/1972933971 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9654065150 0x7f9654067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.395+0000 7f9676a00640 1 --2- 172.21.15.2:0/1972933971 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9654065150 0x7f9654067600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f96680047f0 tx=0x7f9668007e60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:59.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.398+0000 7f966e000640 1 -- 172.21.15.2:0/1972933971 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9670050ad0 con 0x7f9678158e60 2024-08-17T02:23:59.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.582+0000 7f967de00640 1 -- 172.21.15.2:0/1972933971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9678063fb0 con 0x7f9678158e60 2024-08-17T02:23:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.582+0000 7f966e000640 1 -- 172.21.15.2:0/1972933971 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f967000cea0 con 0x7f9678158e60 2024-08-17T02:23:59.584 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-17T02:23:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.584+0000 7f967de00640 1 -- 172.21.15.2:0/1972933971 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9654065150 msgr2=0x7f9654067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.584+0000 7f967de00640 1 --2- 172.21.15.2:0/1972933971 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9654065150 0x7f9654067600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f96680047f0 tx=0x7f9668007e60 comp rx=0 tx=0).stop 2024-08-17T02:23:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.584+0000 7f967de00640 1 -- 172.21.15.2:0/1972933971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9678158e60 msgr2=0x7f9678150de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.584+0000 7f967de00640 1 --2- 172.21.15.2:0/1972933971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9678158e60 0x7f9678150de0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f967000c0c0 tx=0x7f967000b040 comp rx=0 tx=0).stop 2024-08-17T02:23:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.584+0000 7f967de00640 1 -- 172.21.15.2:0/1972933971 shutdown_connections 2024-08-17T02:23:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.584+0000 7f967de00640 1 --2- 172.21.15.2:0/1972933971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9678158e60 0x7f9678150de0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.584+0000 7f967de00640 1 --2- 172.21.15.2:0/1972933971 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9654065150 0x7f9654067600 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.584+0000 7f967de00640 1 --2- 172.21.15.2:0/1972933971 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96780b0ac0 0x7f96780aa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.584+0000 7f967de00640 1 --2- 172.21.15.2:0/1972933971 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96780ae860 0x7f96781410c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.584+0000 7f967de00640 1 -- 172.21.15.2:0/1972933971 >> 172.21.15.2:0/1972933971 conn(0x7f96780cc390 msgr2=0x7f96780a8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.585+0000 7f967de00640 1 -- 172.21.15.2:0/1972933971 shutdown_connections 2024-08-17T02:23:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.585+0000 7f967de00640 1 -- 172.21.15.2:0/1972933971 wait complete. 2024-08-17T02:23:59.600 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:23:59.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.753+0000 7f7657200640 1 Processor -- start 2024-08-17T02:23:59.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.754+0000 7f7657200640 1 -- start start 2024-08-17T02:23:59.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.755+0000 7f7657200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7658152f60 0x7f7658159b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.755+0000 7f7657200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7658153330 0x7f765806b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.755+0000 7f7657200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76580a9cd0 0x7f765806bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.755+0000 7f7657200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76580a9840 con 0x7f7658153330 2024-08-17T02:23:59.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.755+0000 7f7657200640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76580a8c30 con 0x7f7658152f60 2024-08-17T02:23:59.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.755+0000 7f7657200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76580a8f10 con 0x7f76580a9cd0 2024-08-17T02:23:59.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.755+0000 7f7655400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7658153330 0x7f765806b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.755+0000 7f7656800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76580a9cd0 0x7f765806bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.755+0000 7f7655e00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7658152f60 0x7f7658159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.755+0000 7f7655400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7658153330 0x7f765806b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44278/0 (socket says 172.21.15.2:44278) 2024-08-17T02:23:59.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.755+0000 7f7655400640 1 -- 172.21.15.2:0/4187006286 learned_addr learned my addr 172.21.15.2:0/4187006286 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:59.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.756+0000 7f7655400640 1 -- 172.21.15.2:0/4187006286 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76580a9cd0 msgr2=0x7f765806bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:59.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.756+0000 7f7655400640 1 --2- 172.21.15.2:0/4187006286 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76580a9cd0 0x7f765806bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.756+0000 7f7655400640 1 -- 172.21.15.2:0/4187006286 >> v2:172.21.15.145:3300/0 conn(0x7f7658152f60 msgr2=0x7f7658159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:59.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.756+0000 7f7655400640 1 --2- 172.21.15.2:0/4187006286 >> v2:172.21.15.145:3300/0 conn(0x7f7658152f60 0x7f7658159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.756+0000 7f7655400640 1 -- 172.21.15.2:0/4187006286 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76580a91f0 con 0x7f7658153330 2024-08-17T02:23:59.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.757+0000 7f7655400640 1 --2- 172.21.15.2:0/4187006286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7658153330 0x7f765806b9d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f765806ce20 tx=0x7f76440091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b0ba428c663285 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:59.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.757+0000 7f7654a00640 1 -- 172.21.15.2:0/4187006286 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764402add0 con 0x7f7658153330 2024-08-17T02:23:59.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.757+0000 7f7654a00640 1 -- 172.21.15.2:0/4187006286 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7644032440 con 0x7f7658153330 2024-08-17T02:23:59.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.757+0000 7f7654a00640 1 -- 172.21.15.2:0/4187006286 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644032820 con 0x7f7658153330 2024-08-17T02:23:59.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.757+0000 7f7657200640 1 -- 172.21.15.2:0/4187006286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7658153330 msgr2=0x7f765806b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:59.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.757+0000 7f7657200640 1 --2- 172.21.15.2:0/4187006286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7658153330 0x7f765806b9d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f765806ce20 tx=0x7f76440091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.757+0000 7f7657200640 1 -- 172.21.15.2:0/4187006286 shutdown_connections 2024-08-17T02:23:59.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.757+0000 7f7657200640 1 --2- 172.21.15.2:0/4187006286 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76580a9cd0 0x7f765806bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.757+0000 7f7657200640 1 --2- 172.21.15.2:0/4187006286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7658153330 0x7f765806b9d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.757+0000 7f7657200640 1 --2- 172.21.15.2:0/4187006286 >> v2:172.21.15.145:3300/0 conn(0x7f7658152f60 0x7f7658159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.757+0000 7f7657200640 1 -- 172.21.15.2:0/4187006286 >> 172.21.15.2:0/4187006286 conn(0x7f76580678e0 msgr2=0x7f76580b0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:59.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.758+0000 7f7657200640 1 -- 172.21.15.2:0/4187006286 shutdown_connections 2024-08-17T02:23:59.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.758+0000 7f7657200640 1 -- 172.21.15.2:0/4187006286 wait complete. 2024-08-17T02:23:59.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.759+0000 7f7657200640 1 Processor -- start 2024-08-17T02:23:59.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.759+0000 7f7657200640 1 -- start start 2024-08-17T02:23:59.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.760+0000 7f7657200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76580a9cd0 0x7f765814b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.760+0000 7f7657200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7658152f60 0x7f7658069c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.760+0000 7f7657200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7658153330 0x7f7658146130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.760+0000 7f7657200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7658147d90 con 0x7f7658152f60 2024-08-17T02:23:59.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.760+0000 7f7657200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7658148070 con 0x7f7658153330 2024-08-17T02:23:59.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.760+0000 7f7657200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7658148350 con 0x7f76580a9cd0 2024-08-17T02:23:59.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.760+0000 7f7655400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7658152f60 0x7f7658069c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.760+0000 7f7655400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7658152f60 0x7f7658069c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44282/0 (socket says 172.21.15.2:44282) 2024-08-17T02:23:59.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.760+0000 7f7655400640 1 -- 172.21.15.2:0/1908120720 learned_addr learned my addr 172.21.15.2:0/1908120720 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:23:59.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.760+0000 7f7656800640 1 --2- 172.21.15.2:0/1908120720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7658153330 0x7f7658146130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.760+0000 7f7655400640 1 -- 172.21.15.2:0/1908120720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76580a9cd0 msgr2=0x7f765814b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:59.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.761+0000 7f7655e00640 1 --2- 172.21.15.2:0/1908120720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76580a9cd0 0x7f765814b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.761+0000 7f7655400640 1 --2- 172.21.15.2:0/1908120720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76580a9cd0 0x7f765814b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.761+0000 7f7655400640 1 -- 172.21.15.2:0/1908120720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7658153330 msgr2=0x7f7658146130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.761+0000 7f7655400640 1 --2- 172.21.15.2:0/1908120720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7658153330 0x7f7658146130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.761+0000 7f7655400640 1 -- 172.21.15.2:0/1908120720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7644009450 con 0x7f7658152f60 2024-08-17T02:23:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.761+0000 7f7656800640 1 --2- 172.21.15.2:0/1908120720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7658153330 0x7f7658146130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.761+0000 7f7655e00640 1 --2- 172.21.15.2:0/1908120720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76580a9cd0 0x7f765814b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.761+0000 7f7655400640 1 --2- 172.21.15.2:0/1908120720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7658152f60 0x7f7658069c70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7644035040 tx=0x7f7644032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.761+0000 7f764d600640 1 -- 172.21.15.2:0/1908120720 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644031bb0 con 0x7f7658152f60 2024-08-17T02:23:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.761+0000 7f764d600640 1 -- 172.21.15.2:0/1908120720 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7644031d50 con 0x7f7658152f60 2024-08-17T02:23:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.761+0000 7f764d600640 1 -- 172.21.15.2:0/1908120720 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764403d670 con 0x7f7658152f60 2024-08-17T02:23:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.761+0000 7f7657200640 1 -- 172.21.15.2:0/1908120720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7658148630 con 0x7f7658152f60 2024-08-17T02:23:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.761+0000 7f7657200640 1 -- 172.21.15.2:0/1908120720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76581479d0 con 0x7f7658152f60 2024-08-17T02:23:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.762+0000 7f7657200640 1 -- 172.21.15.2:0/1908120720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7658070720 con 0x7f7658152f60 2024-08-17T02:23:59.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.763+0000 7f764d600640 1 -- 172.21.15.2:0/1908120720 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7644039040 con 0x7f7658152f60 2024-08-17T02:23:59.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.764+0000 7f764d600640 1 --2- 172.21.15.2:0/1908120720 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7638065150 0x7f7638067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.765+0000 7f764d600640 1 -- 172.21.15.2:0/1908120720 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f76440a2340 con 0x7f7658152f60 2024-08-17T02:23:59.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.765+0000 7f7655e00640 1 --2- 172.21.15.2:0/1908120720 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7638065150 0x7f7638067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.766+0000 7f7655e00640 1 --2- 172.21.15.2:0/1908120720 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7638065150 0x7f7638067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7648006e70 tx=0x7f7648008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:59.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.769+0000 7f764d600640 1 -- 172.21.15.2:0/1908120720 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7644070420 con 0x7f7658152f60 2024-08-17T02:23:59.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.955+0000 7f7657200640 1 -- 172.21.15.2:0/1908120720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f765806b7b0 con 0x7f7658152f60 2024-08-17T02:23:59.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.956+0000 7f764d600640 1 -- 172.21.15.2:0/1908120720 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7644073a40 con 0x7f7658152f60 2024-08-17T02:23:59.957 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:23:59.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.958+0000 7f7657200640 1 -- 172.21.15.2:0/1908120720 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7638065150 msgr2=0x7f7638067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:59.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.958+0000 7f7657200640 1 --2- 172.21.15.2:0/1908120720 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7638065150 0x7f7638067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7648006e70 tx=0x7f7648008040 comp rx=0 tx=0).stop 2024-08-17T02:23:59.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.958+0000 7f7657200640 1 -- 172.21.15.2:0/1908120720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7658152f60 msgr2=0x7f7658069c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:59.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.958+0000 7f7657200640 1 --2- 172.21.15.2:0/1908120720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7658152f60 0x7f7658069c70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7644035040 tx=0x7f7644032000 comp rx=0 tx=0).stop 2024-08-17T02:23:59.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.958+0000 7f7657200640 1 -- 172.21.15.2:0/1908120720 shutdown_connections 2024-08-17T02:23:59.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.958+0000 7f7657200640 1 --2- 172.21.15.2:0/1908120720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7658153330 0x7f7658146130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.958+0000 7f7657200640 1 --2- 172.21.15.2:0/1908120720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7658152f60 0x7f7658069c70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.958+0000 7f7657200640 1 --2- 172.21.15.2:0/1908120720 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7638065150 0x7f7638067600 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.958+0000 7f7657200640 1 --2- 172.21.15.2:0/1908120720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76580a9cd0 0x7f765814b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.958+0000 7f7657200640 1 -- 172.21.15.2:0/1908120720 >> 172.21.15.2:0/1908120720 conn(0x7f76580678e0 msgr2=0x7f7658151fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:59.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.958+0000 7f7657200640 1 -- 172.21.15.2:0/1908120720 shutdown_connections 2024-08-17T02:23:59.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:23:59.958+0000 7f7657200640 1 -- 172.21.15.2:0/1908120720 wait complete. 2024-08-17T02:23:59.975 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:24:00.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.128+0000 7f9daf200640 1 Processor -- start 2024-08-17T02:24:00.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.128+0000 7f9daf200640 1 -- start start 2024-08-17T02:24:00.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.130+0000 7f9daf200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9db00d0650 0x7f9db00b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.130+0000 7f9daf200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9db01585a0 0x7f9db0158a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.130+0000 7f9daf200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db00ce770 con 0x7f9db00b1850 2024-08-17T02:24:00.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.130+0000 7f9daf200640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db00ce9b0 con 0x7f9db01585a0 2024-08-17T02:24:00.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.130+0000 7f9daf200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db00cec90 con 0x7f9db00d0650 2024-08-17T02:24:00.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.130+0000 7f9dade00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9db00b1850 0x7f9db00ce060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59004/0 (socket says 172.21.15.2:59004) 2024-08-17T02:24:00.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.130+0000 7f9dade00640 1 -- 172.21.15.2:0/195123702 learned_addr learned my addr 172.21.15.2:0/195123702 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:00.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.130+0000 7f9da7e00640 1 --2- 172.21.15.2:0/195123702 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9db00d0650 0x7f9db00b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.130+0000 7f9dae800640 1 --2- 172.21.15.2:0/195123702 >> v2:172.21.15.145:3300/0 conn(0x7f9db01585a0 0x7f9db0158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.130+0000 7f9dad400640 1 -- 172.21.15.2:0/195123702 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3638978387 0 0) 0x7f9da0001110 con 0x7f9db00b1850 2024-08-17T02:24:00.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.130+0000 7f9dad400640 1 -- 172.21.15.2:0/195123702 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d940034e0 con 0x7f9db00b1850 2024-08-17T02:24:00.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.131+0000 7f9dad400640 1 -- 172.21.15.2:0/195123702 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 414964450 0 0) 0x7f9d940034e0 con 0x7f9db00b1850 2024-08-17T02:24:00.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.131+0000 7f9dad400640 1 -- 172.21.15.2:0/195123702 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9db00d0650 msgr2=0x7f9db00b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:00.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.131+0000 7f9dad400640 1 --2- 172.21.15.2:0/195123702 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9db00d0650 0x7f9db00b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.131+0000 7f9dad400640 1 -- 172.21.15.2:0/195123702 >> v2:172.21.15.145:3300/0 conn(0x7f9db01585a0 msgr2=0x7f9db0158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:00.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.131+0000 7f9dad400640 1 --2- 172.21.15.2:0/195123702 >> v2:172.21.15.145:3300/0 conn(0x7f9db01585a0 0x7f9db0158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.131+0000 7f9dad400640 1 -- 172.21.15.2:0/195123702 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db00cef70 con 0x7f9db00b1850 2024-08-17T02:24:00.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.131+0000 7f9dad400640 1 -- 172.21.15.2:0/195123702 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7f9da0001600 con 0x7f9db00b1850 2024-08-17T02:24:00.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.131+0000 7f9dad400640 1 -- 172.21.15.2:0/195123702 >> v1:172.21.15.2:6789/0 conn(0x7f9db00b1850 legacy=0x7f9db00ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:00.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.131+0000 7f9dad400640 1 --2- 172.21.15.2:0/195123702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d940039d0 0x7f9d94003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.131+0000 7f9dad400640 1 --2- 172.21.15.2:0/195123702 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d94004780 0x7f9d94004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.131+0000 7f9dad400640 1 --2- 172.21.15.2:0/195123702 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9db00d0650 0x7f9d94005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.131+0000 7f9dad400640 1 -- 172.21.15.2:0/195123702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db00ce9b0 con 0x7f9d940039d0 2024-08-17T02:24:00.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.131+0000 7f9dad400640 1 -- 172.21.15.2:0/195123702 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db00cec90 con 0x7f9d94004780 2024-08-17T02:24:00.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.131+0000 7f9dad400640 1 -- 172.21.15.2:0/195123702 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9400b9d0 con 0x7f9db00d0650 2024-08-17T02:24:00.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.131+0000 7f9dade00640 1 --2- 172.21.15.2:0/195123702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d940039d0 0x7f9d94003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.131+0000 7f9da7e00640 1 --2- 172.21.15.2:0/195123702 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d94004780 0x7f9d94004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.131+0000 7f9dae800640 1 --2- 172.21.15.2:0/195123702 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9db00d0650 0x7f9d94005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.131+0000 7f9dade00640 1 -- 172.21.15.2:0/195123702 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9db00d0650 msgr2=0x7f9d94005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:00.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.131+0000 7f9dade00640 1 --2- 172.21.15.2:0/195123702 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9db00d0650 0x7f9d94005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.131+0000 7f9dade00640 1 -- 172.21.15.2:0/195123702 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d94004780 msgr2=0x7f9d94004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:00.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.131+0000 7f9dade00640 1 --2- 172.21.15.2:0/195123702 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d94004780 0x7f9d94004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.131+0000 7f9dade00640 1 -- 172.21.15.2:0/195123702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d940034e0 con 0x7f9d940039d0 2024-08-17T02:24:00.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.132+0000 7f9dade00640 1 --2- 172.21.15.2:0/195123702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d940039d0 0x7f9d94003de0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9da000c470 tx=0x7f9da00079f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd9f08a1b1673b1e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:00.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.133+0000 7f9dad400640 1 -- 172.21.15.2:0/195123702 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da0005890 con 0x7f9d940039d0 2024-08-17T02:24:00.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.133+0000 7f9dad400640 1 -- 172.21.15.2:0/195123702 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da0005a10 con 0x7f9d940039d0 2024-08-17T02:24:00.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.133+0000 7f9dad400640 1 -- 172.21.15.2:0/195123702 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da0005e10 con 0x7f9d940039d0 2024-08-17T02:24:00.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.133+0000 7f9daf200640 1 -- 172.21.15.2:0/195123702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d940039d0 msgr2=0x7f9d94003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:00.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.133+0000 7f9daf200640 1 --2- 172.21.15.2:0/195123702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d940039d0 0x7f9d94003de0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9da000c470 tx=0x7f9da00079f0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.133+0000 7f9dae800640 1 -- 172.21.15.2:0/195123702 reap_dead start 2024-08-17T02:24:00.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.133+0000 7f9daf200640 1 -- 172.21.15.2:0/195123702 shutdown_connections 2024-08-17T02:24:00.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.133+0000 7f9daf200640 1 -- 172.21.15.2:0/195123702 >> 172.21.15.2:0/195123702 conn(0x7f9db006e590 msgr2=0x7f9db006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:00.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.133+0000 7f9daf200640 1 -- 172.21.15.2:0/195123702 shutdown_connections 2024-08-17T02:24:00.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.133+0000 7f9daf200640 1 -- 172.21.15.2:0/195123702 wait complete. 2024-08-17T02:24:00.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.135+0000 7f9daf200640 1 Processor -- start 2024-08-17T02:24:00.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.135+0000 7f9daf200640 1 -- start start 2024-08-17T02:24:00.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.136+0000 7f9daf200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d940039d0 0x7f9db00aa310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.136+0000 7f9daf200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9db00c4950 0x7f9db00c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.136+0000 7f9daf200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9db00aace0 0x7f9db00ab180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.136+0000 7f9daf200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db00ac670 con 0x7f9db00aace0 2024-08-17T02:24:00.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.136+0000 7f9daf200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db00c5300 con 0x7f9db00c4950 2024-08-17T02:24:00.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.136+0000 7f9daf200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db00ab9f0 con 0x7f9d940039d0 2024-08-17T02:24:00.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.136+0000 7f9dae800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9db00aace0 0x7f9db00ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.136+0000 7f9dae800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9db00aace0 0x7f9db00ab180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44300/0 (socket says 172.21.15.2:44300) 2024-08-17T02:24:00.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.136+0000 7f9dae800640 1 -- 172.21.15.2:0/3019231239 learned_addr learned my addr 172.21.15.2:0/3019231239 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:00.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.136+0000 7f9da7e00640 1 --2- 172.21.15.2:0/3019231239 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9db00c4950 0x7f9db00c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.136+0000 7f9dade00640 1 --2- 172.21.15.2:0/3019231239 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d940039d0 0x7f9db00aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.136+0000 7f9dae800640 1 -- 172.21.15.2:0/3019231239 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d940039d0 msgr2=0x7f9db00aa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:00.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.136+0000 7f9dae800640 1 --2- 172.21.15.2:0/3019231239 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d940039d0 0x7f9db00aa310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.136+0000 7f9dae800640 1 -- 172.21.15.2:0/3019231239 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9db00c4950 msgr2=0x7f9db00c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:00.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.136+0000 7f9dae800640 1 --2- 172.21.15.2:0/3019231239 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9db00c4950 0x7f9db00c4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.136+0000 7f9dae800640 1 -- 172.21.15.2:0/3019231239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db00abcd0 con 0x7f9db00aace0 2024-08-17T02:24:00.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.136+0000 7f9dade00640 1 --2- 172.21.15.2:0/3019231239 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d940039d0 0x7f9db00aa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:00.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.137+0000 7f9dae800640 1 --2- 172.21.15.2:0/3019231239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9db00aace0 0x7f9db00ab180 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9db00ae850 tx=0x7f9da800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:00.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.137+0000 7f9da5600640 1 -- 172.21.15.2:0/3019231239 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da800e040 con 0x7f9db00aace0 2024-08-17T02:24:00.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.137+0000 7f9da5600640 1 -- 172.21.15.2:0/3019231239 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da800f040 con 0x7f9db00aace0 2024-08-17T02:24:00.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.137+0000 7f9daf200640 1 -- 172.21.15.2:0/3019231239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db00abfb0 con 0x7f9db00aace0 2024-08-17T02:24:00.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.137+0000 7f9da5600640 1 -- 172.21.15.2:0/3019231239 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da8015920 con 0x7f9db00aace0 2024-08-17T02:24:00.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.137+0000 7f9daf200640 1 -- 172.21.15.2:0/3019231239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db00ab6c0 con 0x7f9db00aace0 2024-08-17T02:24:00.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.138+0000 7f9daf200640 1 -- 172.21.15.2:0/3019231239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db0070720 con 0x7f9db00aace0 2024-08-17T02:24:00.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.139+0000 7f9da5600640 1 -- 172.21.15.2:0/3019231239 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9da8015d10 con 0x7f9db00aace0 2024-08-17T02:24:00.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.140+0000 7f9da5600640 1 --2- 172.21.15.2:0/3019231239 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9d8c065150 0x7f9d8c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.140+0000 7f9da5600640 1 -- 172.21.15.2:0/3019231239 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9da8082650 con 0x7f9db00aace0 2024-08-17T02:24:00.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.140+0000 7f9dade00640 1 --2- 172.21.15.2:0/3019231239 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9d8c065150 0x7f9d8c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.141+0000 7f9dade00640 1 --2- 172.21.15.2:0/3019231239 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9d8c065150 0x7f9d8c067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9da0033000 tx=0x7f9da0034000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:00.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.144+0000 7f9da5600640 1 -- 172.21.15.2:0/3019231239 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9da8050720 con 0x7f9db00aace0 2024-08-17T02:24:00.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.325+0000 7f9daf200640 1 -- 172.21.15.2:0/3019231239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9db0068140 con 0x7f9db00aace0 2024-08-17T02:24:00.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.326+0000 7f9da5600640 1 -- 172.21.15.2:0/3019231239 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9da8053d40 con 0x7f9db00aace0 2024-08-17T02:24:00.327 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-08-17T02:24:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.327+0000 7f9daf200640 1 -- 172.21.15.2:0/3019231239 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9d8c065150 msgr2=0x7f9d8c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.327+0000 7f9daf200640 1 --2- 172.21.15.2:0/3019231239 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9d8c065150 0x7f9d8c067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9da0033000 tx=0x7f9da0034000 comp rx=0 tx=0).stop 2024-08-17T02:24:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.328+0000 7f9daf200640 1 -- 172.21.15.2:0/3019231239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9db00aace0 msgr2=0x7f9db00ab180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.328+0000 7f9daf200640 1 --2- 172.21.15.2:0/3019231239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9db00aace0 0x7f9db00ab180 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9db00ae850 tx=0x7f9da800b040 comp rx=0 tx=0).stop 2024-08-17T02:24:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.328+0000 7f9daf200640 1 -- 172.21.15.2:0/3019231239 shutdown_connections 2024-08-17T02:24:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.328+0000 7f9daf200640 1 --2- 172.21.15.2:0/3019231239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9db00aace0 0x7f9db00ab180 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.328+0000 7f9daf200640 1 --2- 172.21.15.2:0/3019231239 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9db00c4950 0x7f9db00c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.328+0000 7f9daf200640 1 --2- 172.21.15.2:0/3019231239 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9d8c065150 0x7f9d8c067600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.328+0000 7f9daf200640 1 --2- 172.21.15.2:0/3019231239 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d940039d0 0x7f9db00aa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.328+0000 7f9daf200640 1 -- 172.21.15.2:0/3019231239 >> 172.21.15.2:0/3019231239 conn(0x7f9db006e590 msgr2=0x7f9db0068500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:00.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.328+0000 7f9daf200640 1 -- 172.21.15.2:0/3019231239 shutdown_connections 2024-08-17T02:24:00.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.328+0000 7f9daf200640 1 -- 172.21.15.2:0/3019231239 wait complete. 2024-08-17T02:24:00.344 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:00.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.496+0000 7f1fdbe00640 1 Processor -- start 2024-08-17T02:24:00.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.496+0000 7f1fdbe00640 1 -- start start 2024-08-17T02:24:00.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.497+0000 7f1fdbe00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fdc0b0e30 0x7f1fdc0b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.497+0000 7f1fdbe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1fdc15a590 0x7f1fdc13fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.497+0000 7f1fdbe00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fdc06d7c0 con 0x7f1fdc156f90 2024-08-17T02:24:00.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.497+0000 7f1fdbe00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fdc15ab30 con 0x7f1fdc15a590 2024-08-17T02:24:00.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.497+0000 7f1fdbe00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc15ae10 con 0x7f1fdc0b0e30 2024-08-17T02:24:00.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.497+0000 7f1fdb400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1fdc15a590 0x7f1fdc13fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.497+0000 7f1fdb400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1fdc15a590 0x7f1fdc13fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44302/0 (socket says 172.21.15.2:44302) 2024-08-17T02:24:00.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.497+0000 7f1fdb400640 1 -- 172.21.15.2:0/3368908827 learned_addr learned my addr 172.21.15.2:0/3368908827 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:00.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.497+0000 7f1fd3e00640 1 --1- 172.21.15.2:0/3368908827 >> v1:172.21.15.2:6789/0 conn(0x7f1fdc156f90 0x7f1fdc0cb070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59020/0 (socket says 172.21.15.2:59020) 2024-08-17T02:24:00.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.497+0000 7f1fdaa00640 1 --2- 172.21.15.2:0/3368908827 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fdc0b0e30 0x7f1fdc0b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.498+0000 7f1fdb400640 1 -- 172.21.15.2:0/3368908827 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fdc0b0e30 msgr2=0x7f1fdc0b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:00.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.498+0000 7f1fdb400640 1 --2- 172.21.15.2:0/3368908827 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fdc0b0e30 0x7f1fdc0b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.498+0000 7f1fdb400640 1 -- 172.21.15.2:0/3368908827 >> v1:172.21.15.2:6789/0 conn(0x7f1fdc156f90 legacy=0x7f1fdc0cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:00.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.498+0000 7f1fdb400640 1 -- 172.21.15.2:0/3368908827 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc15b0f0 con 0x7f1fdc15a590 2024-08-17T02:24:00.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.498+0000 7f1fdaa00640 1 --2- 172.21.15.2:0/3368908827 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fdc0b0e30 0x7f1fdc0b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:00.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.499+0000 7f1fdb400640 1 --2- 172.21.15.2:0/3368908827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fdc15a590 0x7f1fdc13fcc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4009f20 tx=0x7f1fd4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ea88e82ddd568d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:00.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.499+0000 7f1fda000640 1 -- 172.21.15.2:0/3368908827 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4031400 con 0x7f1fdc15a590 2024-08-17T02:24:00.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.499+0000 7f1fda000640 1 -- 172.21.15.2:0/3368908827 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd402d050 con 0x7f1fdc15a590 2024-08-17T02:24:00.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.499+0000 7f1fda000640 1 -- 172.21.15.2:0/3368908827 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd40317d0 con 0x7f1fdc15a590 2024-08-17T02:24:00.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.499+0000 7f1fdbe00640 1 -- 172.21.15.2:0/3368908827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fdc15a590 msgr2=0x7f1fdc13fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:00.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.499+0000 7f1fdbe00640 1 --2- 172.21.15.2:0/3368908827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fdc15a590 0x7f1fdc13fcc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4009f20 tx=0x7f1fd4009840 comp rx=0 tx=0).stop 2024-08-17T02:24:00.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.500+0000 7f1fdbe00640 1 -- 172.21.15.2:0/3368908827 shutdown_connections 2024-08-17T02:24:00.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.500+0000 7f1fdbe00640 1 --2- 172.21.15.2:0/3368908827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fdc15a590 0x7f1fdc13fcc0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.500+0000 7f1fdbe00640 1 --2- 172.21.15.2:0/3368908827 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fdc0b0e30 0x7f1fdc0b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.500+0000 7f1fdbe00640 1 -- 172.21.15.2:0/3368908827 >> 172.21.15.2:0/3368908827 conn(0x7f1fdc062af0 msgr2=0x7f1fdc062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:00.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.500+0000 7f1fdbe00640 1 -- 172.21.15.2:0/3368908827 shutdown_connections 2024-08-17T02:24:00.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.500+0000 7f1fdbe00640 1 -- 172.21.15.2:0/3368908827 wait complete. 2024-08-17T02:24:00.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.501+0000 7f1fdbe00640 1 Processor -- start 2024-08-17T02:24:00.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.501+0000 7f1fdbe00640 1 -- start start 2024-08-17T02:24:00.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.502+0000 7f1fdbe00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fdc0b0e30 0x7f1fdc0c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.502+0000 7f1fdbe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fdc156f90 0x7f1fdc1369f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.502+0000 7f1fdbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fdc15a590 0x7f1fdc147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.502+0000 7f1fdbe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc1373d0 con 0x7f1fdc15a590 2024-08-17T02:24:00.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.502+0000 7f1fdbe00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc1376b0 con 0x7f1fdc156f90 2024-08-17T02:24:00.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.502+0000 7f1fdbe00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc137990 con 0x7f1fdc0b0e30 2024-08-17T02:24:00.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.503+0000 7f1fdb400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fdc15a590 0x7f1fdc147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.503+0000 7f1fdb400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fdc15a590 0x7f1fdc147ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44308/0 (socket says 172.21.15.2:44308) 2024-08-17T02:24:00.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.503+0000 7f1fdb400640 1 -- 172.21.15.2:0/868035427 learned_addr learned my addr 172.21.15.2:0/868035427 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:00.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.503+0000 7f1fdaa00640 1 --2- 172.21.15.2:0/868035427 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fdc0b0e30 0x7f1fdc0c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.503+0000 7f1fd3e00640 1 --2- 172.21.15.2:0/868035427 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fdc156f90 0x7f1fdc1369f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.503+0000 7f1fdb400640 1 -- 172.21.15.2:0/868035427 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fdc0b0e30 msgr2=0x7f1fdc0c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:00.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.503+0000 7f1fdb400640 1 --2- 172.21.15.2:0/868035427 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fdc0b0e30 0x7f1fdc0c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.503+0000 7f1fdb400640 1 -- 172.21.15.2:0/868035427 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fdc156f90 msgr2=0x7f1fdc1369f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:00.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.503+0000 7f1fdb400640 1 --2- 172.21.15.2:0/868035427 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fdc156f90 0x7f1fdc1369f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.503+0000 7f1fdb400640 1 -- 172.21.15.2:0/868035427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd4009ae0 con 0x7f1fdc15a590 2024-08-17T02:24:00.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.503+0000 7f1fdb400640 1 --2- 172.21.15.2:0/868035427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fdc15a590 0x7f1fdc147ac0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4009f80 tx=0x7f1fd4036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:00.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.504+0000 7f1fd2000640 1 -- 172.21.15.2:0/868035427 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4007170 con 0x7f1fdc15a590 2024-08-17T02:24:00.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.504+0000 7f1fd2000640 1 -- 172.21.15.2:0/868035427 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd4008e50 con 0x7f1fdc15a590 2024-08-17T02:24:00.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.504+0000 7f1fdbe00640 1 -- 172.21.15.2:0/868035427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fdc137c70 con 0x7f1fdc15a590 2024-08-17T02:24:00.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.504+0000 7f1fd2000640 1 -- 172.21.15.2:0/868035427 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd403b640 con 0x7f1fdc15a590 2024-08-17T02:24:00.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.504+0000 7f1fdbe00640 1 -- 172.21.15.2:0/868035427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fdc13e700 con 0x7f1fdc15a590 2024-08-17T02:24:00.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.505+0000 7f1fdbe00640 1 -- 172.21.15.2:0/868035427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fdc13e8f0 con 0x7f1fdc15a590 2024-08-17T02:24:00.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.506+0000 7f1fd2000640 1 -- 172.21.15.2:0/868035427 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1fd4038050 con 0x7f1fdc15a590 2024-08-17T02:24:00.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.506+0000 7f1fd2000640 1 --2- 172.21.15.2:0/868035427 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1fb8065180 0x7f1fb8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.507+0000 7f1fd2000640 1 -- 172.21.15.2:0/868035427 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1fd40a30f0 con 0x7f1fdc15a590 2024-08-17T02:24:00.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.507+0000 7f1fdaa00640 1 --2- 172.21.15.2:0/868035427 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1fb8065180 0x7f1fb8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.508+0000 7f1fdaa00640 1 --2- 172.21.15.2:0/868035427 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1fb8065180 0x7f1fb8067630 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc006e70 tx=0x7f1fcc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:00.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.511+0000 7f1fd2000640 1 -- 172.21.15.2:0/868035427 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1fdc13e8f0 con 0x7f1fdc15a590 2024-08-17T02:24:00.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.699+0000 7f1fdbe00640 1 -- 172.21.15.2:0/868035427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fdc13e8f0 con 0x7f1fdc15a590 2024-08-17T02:24:00.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.700+0000 7f1fd2000640 1 -- 172.21.15.2:0/868035427 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f1fdc13e8f0 con 0x7f1fdc15a590 2024-08-17T02:24:00.701 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:24:00.702 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:23:32.955197+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:29.708835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:30.361908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.703+0000 7f1fdbe00640 1 -- 172.21.15.2:0/868035427 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1fb8065180 msgr2=0x7f1fb8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.703+0000 7f1fdbe00640 1 --2- 172.21.15.2:0/868035427 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1fb8065180 0x7f1fb8067630 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc006e70 tx=0x7f1fcc008040 comp rx=0 tx=0).stop 2024-08-17T02:24:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.703+0000 7f1fdbe00640 1 -- 172.21.15.2:0/868035427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fdc15a590 msgr2=0x7f1fdc147ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.703+0000 7f1fdbe00640 1 --2- 172.21.15.2:0/868035427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fdc15a590 0x7f1fdc147ac0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4009f80 tx=0x7f1fd4036000 comp rx=0 tx=0).stop 2024-08-17T02:24:00.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.703+0000 7f1fdbe00640 1 -- 172.21.15.2:0/868035427 shutdown_connections 2024-08-17T02:24:00.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.703+0000 7f1fdbe00640 1 --2- 172.21.15.2:0/868035427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fdc15a590 0x7f1fdc147ac0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.703+0000 7f1fdbe00640 1 --2- 172.21.15.2:0/868035427 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fdc156f90 0x7f1fdc1369f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.703+0000 7f1fdbe00640 1 --2- 172.21.15.2:0/868035427 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1fb8065180 0x7f1fb8067630 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.703+0000 7f1fdbe00640 1 --2- 172.21.15.2:0/868035427 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fdc0b0e30 0x7f1fdc0c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.703+0000 7f1fdbe00640 1 -- 172.21.15.2:0/868035427 >> 172.21.15.2:0/868035427 conn(0x7f1fdc062af0 msgr2=0x7f1fdc0c81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:00.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.703+0000 7f1fdbe00640 1 -- 172.21.15.2:0/868035427 shutdown_connections 2024-08-17T02:24:00.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.703+0000 7f1fdbe00640 1 -- 172.21.15.2:0/868035427 wait complete. 2024-08-17T02:24:00.719 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:23:26.107978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:23:29.708835+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:23:30.361908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:24:00.720 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:24:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.872+0000 7fe41d400640 1 Processor -- start 2024-08-17T02:24:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.873+0000 7fe41d400640 1 -- start start 2024-08-17T02:24:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.874+0000 7fe41d400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe4180cc7e0 0x7fe4180ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.874+0000 7fe41d400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4180cd780 0x7fe4180cab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.874+0000 7fe41d400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4180cdc60 con 0x7fe41815bbd0 2024-08-17T02:24:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.874+0000 7fe41d400640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4180cdf40 con 0x7fe4180cc7e0 2024-08-17T02:24:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.874+0000 7fe41d400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4180ce220 con 0x7fe4180cd780 2024-08-17T02:24:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.874+0000 7fe41ca00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe41815bbd0 0x7fe41815c050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59024/0 (socket says 172.21.15.2:59024) 2024-08-17T02:24:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.874+0000 7fe41ca00640 1 -- 172.21.15.2:0/4207952611 learned_addr learned my addr 172.21.15.2:0/4207952611 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.874+0000 7fe417e00640 1 --2- 172.21.15.2:0/4207952611 >> v2:172.21.15.145:3300/0 conn(0x7fe4180cc7e0 0x7fe4180ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.874+0000 7fe40fe00640 1 --2- 172.21.15.2:0/4207952611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4180cd780 0x7fe4180cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.875+0000 7fe417400640 1 -- 172.21.15.2:0/4207952611 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3489972687 0 0) 0x7fe4180cdc60 con 0x7fe41815bbd0 2024-08-17T02:24:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.875+0000 7fe417400640 1 -- 172.21.15.2:0/4207952611 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3fc0034e0 con 0x7fe41815bbd0 2024-08-17T02:24:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.875+0000 7fe417400640 1 -- 172.21.15.2:0/4207952611 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 932022782 0 0) 0x7fe3fc0034e0 con 0x7fe41815bbd0 2024-08-17T02:24:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.875+0000 7fe417400640 1 -- 172.21.15.2:0/4207952611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4180cd780 msgr2=0x7fe4180cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.875+0000 7fe417400640 1 --2- 172.21.15.2:0/4207952611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4180cd780 0x7fe4180cab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.875+0000 7fe417400640 1 -- 172.21.15.2:0/4207952611 >> v2:172.21.15.145:3300/0 conn(0x7fe4180cc7e0 msgr2=0x7fe4180ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.875+0000 7fe417400640 1 --2- 172.21.15.2:0/4207952611 >> v2:172.21.15.145:3300/0 conn(0x7fe4180cc7e0 0x7fe4180ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.875+0000 7fe417400640 1 -- 172.21.15.2:0/4207952611 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4180ce500 con 0x7fe41815bbd0 2024-08-17T02:24:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.875+0000 7fe417400640 1 -- 172.21.15.2:0/4207952611 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7fe4100017f0 con 0x7fe41815bbd0 2024-08-17T02:24:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.875+0000 7fe417400640 1 -- 172.21.15.2:0/4207952611 >> v1:172.21.15.2:6789/0 conn(0x7fe41815bbd0 legacy=0x7fe41815c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.875+0000 7fe417400640 1 --2- 172.21.15.2:0/4207952611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4180cd780 0x7fe3fc003ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.875+0000 7fe417400640 1 --2- 172.21.15.2:0/4207952611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe3fc004090 0x7fe3fc004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.875+0000 7fe417400640 1 --2- 172.21.15.2:0/4207952611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3fc004cc0 0x7fe3fc005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.875+0000 7fe417400640 1 -- 172.21.15.2:0/4207952611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4180cdf40 con 0x7fe3fc004cc0 2024-08-17T02:24:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.875+0000 7fe417400640 1 -- 172.21.15.2:0/4207952611 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4180ce220 con 0x7fe3fc004090 2024-08-17T02:24:00.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.875+0000 7fe417400640 1 -- 172.21.15.2:0/4207952611 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc00bb60 con 0x7fe4180cd780 2024-08-17T02:24:00.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.875+0000 7fe41ca00640 1 --2- 172.21.15.2:0/4207952611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3fc004cc0 0x7fe3fc005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.875+0000 7fe417e00640 1 --2- 172.21.15.2:0/4207952611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4180cd780 0x7fe3fc003ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.875+0000 7fe40fe00640 1 --2- 172.21.15.2:0/4207952611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe3fc004090 0x7fe3fc004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.876+0000 7fe41ca00640 1 -- 172.21.15.2:0/4207952611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4180cd780 msgr2=0x7fe3fc003ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:00.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.876+0000 7fe41ca00640 1 --2- 172.21.15.2:0/4207952611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4180cd780 0x7fe3fc003ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.876+0000 7fe41ca00640 1 -- 172.21.15.2:0/4207952611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe3fc004090 msgr2=0x7fe3fc004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:00.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.876+0000 7fe41ca00640 1 --2- 172.21.15.2:0/4207952611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe3fc004090 0x7fe3fc004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.876+0000 7fe41ca00640 1 -- 172.21.15.2:0/4207952611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc0034e0 con 0x7fe3fc004cc0 2024-08-17T02:24:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.877+0000 7fe41ca00640 1 --2- 172.21.15.2:0/4207952611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3fc004cc0 0x7fe3fc005130 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe41000a8a0 tx=0x7fe410002140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa5a5b467ad631cf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.877+0000 7fe417400640 1 -- 172.21.15.2:0/4207952611 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4100070f0 con 0x7fe3fc004cc0 2024-08-17T02:24:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.877+0000 7fe417400640 1 -- 172.21.15.2:0/4207952611 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe410007270 con 0x7fe3fc004cc0 2024-08-17T02:24:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.877+0000 7fe417400640 1 -- 172.21.15.2:0/4207952611 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4100076b0 con 0x7fe3fc004cc0 2024-08-17T02:24:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.877+0000 7fe41d400640 1 -- 172.21.15.2:0/4207952611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3fc004cc0 msgr2=0x7fe3fc005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.877+0000 7fe41d400640 1 --2- 172.21.15.2:0/4207952611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3fc004cc0 0x7fe3fc005130 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe41000a8a0 tx=0x7fe410002140 comp rx=0 tx=0).stop 2024-08-17T02:24:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.877+0000 7fe41ca00640 1 -- 172.21.15.2:0/4207952611 reap_dead start 2024-08-17T02:24:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.878+0000 7fe41d400640 1 -- 172.21.15.2:0/4207952611 shutdown_connections 2024-08-17T02:24:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.878+0000 7fe41d400640 1 -- 172.21.15.2:0/4207952611 >> 172.21.15.2:0/4207952611 conn(0x7fe418087a80 msgr2=0x7fe41806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.878+0000 7fe41d400640 1 -- 172.21.15.2:0/4207952611 shutdown_connections 2024-08-17T02:24:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.878+0000 7fe41d400640 1 -- 172.21.15.2:0/4207952611 wait complete. 2024-08-17T02:24:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.879+0000 7fe41d400640 1 Processor -- start 2024-08-17T02:24:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.879+0000 7fe41d400640 1 -- start start 2024-08-17T02:24:00.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.880+0000 7fe41d400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe3fc004cc0 0x7fe4180aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.880+0000 7fe41d400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4180a77b0 0x7fe4181694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.880+0000 7fe41d400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4180a9790 0x7fe4180a9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.880+0000 7fe41d400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4180af400 con 0x7fe4180a9790 2024-08-17T02:24:00.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.880+0000 7fe41d400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe418169a30 con 0x7fe3fc004cc0 2024-08-17T02:24:00.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.880+0000 7fe41d400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4180aa150 con 0x7fe4180a77b0 2024-08-17T02:24:00.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.880+0000 7fe41ca00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4180a9790 0x7fe4180a9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.880+0000 7fe41ca00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4180a9790 0x7fe4180a9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44326/0 (socket says 172.21.15.2:44326) 2024-08-17T02:24:00.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.880+0000 7fe41ca00640 1 -- 172.21.15.2:0/991399704 learned_addr learned my addr 172.21.15.2:0/991399704 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:00.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.881+0000 7fe40fe00640 1 --2- 172.21.15.2:0/991399704 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4180a77b0 0x7fe4181694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.881+0000 7fe417e00640 1 --2- 172.21.15.2:0/991399704 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe3fc004cc0 0x7fe4180aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.881+0000 7fe41ca00640 1 -- 172.21.15.2:0/991399704 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4180a77b0 msgr2=0x7fe4181694f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:00.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.881+0000 7fe41ca00640 1 --2- 172.21.15.2:0/991399704 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4180a77b0 0x7fe4181694f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.881+0000 7fe41ca00640 1 -- 172.21.15.2:0/991399704 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe3fc004cc0 msgr2=0x7fe4180aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:00.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.881+0000 7fe41ca00640 1 --2- 172.21.15.2:0/991399704 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe3fc004cc0 0x7fe4180aeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.881+0000 7fe41ca00640 1 -- 172.21.15.2:0/991399704 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41815b050 con 0x7fe4180a9790 2024-08-17T02:24:00.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.881+0000 7fe41ca00640 1 --2- 172.21.15.2:0/991399704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4180a9790 0x7fe4180a9c10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe41000a900 tx=0x7fe410034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:00.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.881+0000 7fe40f400640 1 -- 172.21.15.2:0/991399704 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe410001730 con 0x7fe4180a9790 2024-08-17T02:24:00.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.881+0000 7fe40f400640 1 -- 172.21.15.2:0/991399704 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe410036450 con 0x7fe4180a9790 2024-08-17T02:24:00.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.881+0000 7fe40f400640 1 -- 172.21.15.2:0/991399704 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe410036810 con 0x7fe4180a9790 2024-08-17T02:24:00.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.881+0000 7fe41d400640 1 -- 172.21.15.2:0/991399704 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4180a8af0 con 0x7fe4180a9790 2024-08-17T02:24:00.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.881+0000 7fe41d400640 1 -- 172.21.15.2:0/991399704 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4180a7ee0 con 0x7fe4180a9790 2024-08-17T02:24:00.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.882+0000 7fe41d400640 1 -- 172.21.15.2:0/991399704 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe418070720 con 0x7fe4180a9790 2024-08-17T02:24:00.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.883+0000 7fe40f400640 1 -- 172.21.15.2:0/991399704 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe410036b80 con 0x7fe4180a9790 2024-08-17T02:24:00.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.884+0000 7fe40f400640 1 --2- 172.21.15.2:0/991399704 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe3f4065150 0x7fe3f4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.884+0000 7fe40f400640 1 -- 172.21.15.2:0/991399704 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe4100a2b70 con 0x7fe4180a9790 2024-08-17T02:24:00.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.884+0000 7fe417e00640 1 --2- 172.21.15.2:0/991399704 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe3f4065150 0x7fe3f4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.885+0000 7fe417e00640 1 --2- 172.21.15.2:0/991399704 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe3f4065150 0x7fe3f4067600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe4180b5390 tx=0x7fe408008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:00.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:00.888+0000 7fe40f400640 1 -- 172.21.15.2:0/991399704 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe410070b90 con 0x7fe4180a9790 2024-08-17T02:24:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.073+0000 7fe41d400640 1 -- 172.21.15.2:0/991399704 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4180c4fb0 con 0x7fe4180a9790 2024-08-17T02:24:01.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.074+0000 7fe40f400640 1 -- 172.21.15.2:0/991399704 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe410048020 con 0x7fe4180a9790 2024-08-17T02:24:01.075 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-17T02:24:01.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.076+0000 7fe41d400640 1 -- 172.21.15.2:0/991399704 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe3f4065150 msgr2=0x7fe3f4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.076+0000 7fe41d400640 1 --2- 172.21.15.2:0/991399704 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe3f4065150 0x7fe3f4067600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe4180b5390 tx=0x7fe408008040 comp rx=0 tx=0).stop 2024-08-17T02:24:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.076+0000 7fe41d400640 1 -- 172.21.15.2:0/991399704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4180a9790 msgr2=0x7fe4180a9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.076+0000 7fe41d400640 1 --2- 172.21.15.2:0/991399704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4180a9790 0x7fe4180a9c10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe41000a900 tx=0x7fe410034000 comp rx=0 tx=0).stop 2024-08-17T02:24:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.076+0000 7fe41d400640 1 -- 172.21.15.2:0/991399704 shutdown_connections 2024-08-17T02:24:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.076+0000 7fe41d400640 1 --2- 172.21.15.2:0/991399704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4180a9790 0x7fe4180a9c10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.076+0000 7fe41d400640 1 --2- 172.21.15.2:0/991399704 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe3f4065150 0x7fe3f4067600 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.076+0000 7fe41d400640 1 --2- 172.21.15.2:0/991399704 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe4180a77b0 0x7fe4181694f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.076+0000 7fe41d400640 1 --2- 172.21.15.2:0/991399704 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe3fc004cc0 0x7fe4180aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.076+0000 7fe41d400640 1 -- 172.21.15.2:0/991399704 >> 172.21.15.2:0/991399704 conn(0x7fe418087a80 msgr2=0x7fe4180b1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.076+0000 7fe41d400640 1 -- 172.21.15.2:0/991399704 shutdown_connections 2024-08-17T02:24:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.076+0000 7fe41d400640 1 -- 172.21.15.2:0/991399704 wait complete. 2024-08-17T02:24:01.093 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:24:01.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.248+0000 7fc603200640 1 Processor -- start 2024-08-17T02:24:01.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.248+0000 7fc603200640 1 -- start start 2024-08-17T02:24:01.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.249+0000 7fc603200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc604158f50 0x7fc60406c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.249+0000 7fc603200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6040b00c0 con 0x7fc6040af040 2024-08-17T02:24:01.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.249+0000 7fc603200640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6040af7d0 con 0x7fc604158b80 2024-08-17T02:24:01.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.249+0000 7fc603200640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6040afa70 con 0x7fc604158f50 2024-08-17T02:24:01.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.249+0000 7fc5fbe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc6040af040 0x7fc6040b0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59032/0 (socket says 172.21.15.2:59032) 2024-08-17T02:24:01.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.249+0000 7fc5fbe00640 1 -- 172.21.15.2:0/2250665160 learned_addr learned my addr 172.21.15.2:0/2250665160 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:01.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.249+0000 7fc602800640 1 --2- 172.21.15.2:0/2250665160 >> v2:172.21.15.145:3300/0 conn(0x7fc604158f50 0x7fc60406c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.250+0000 7fc601400640 1 -- 172.21.15.2:0/2250665160 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2069696203 0 0) 0x7fc6040b00c0 con 0x7fc6040af040 2024-08-17T02:24:01.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.250+0000 7fc601400640 1 -- 172.21.15.2:0/2250665160 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5e80034e0 con 0x7fc6040af040 2024-08-17T02:24:01.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.250+0000 7fc601400640 1 -- 172.21.15.2:0/2250665160 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 774308027 0 0) 0x7fc5e80034e0 con 0x7fc6040af040 2024-08-17T02:24:01.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.250+0000 7fc601400640 1 -- 172.21.15.2:0/2250665160 >> v2:172.21.15.145:3300/0 conn(0x7fc604158f50 msgr2=0x7fc60406c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:01.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.250+0000 7fc601400640 1 --2- 172.21.15.2:0/2250665160 >> v2:172.21.15.145:3300/0 conn(0x7fc604158f50 0x7fc60406c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.250+0000 7fc601400640 1 -- 172.21.15.2:0/2250665160 >> v1:172.21.15.145:6789/0 conn(0x7fc604158b80 legacy=0x7fc6040ae930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.250+0000 7fc601400640 1 -- 172.21.15.2:0/2250665160 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6040afd50 con 0x7fc6040af040 2024-08-17T02:24:01.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.250+0000 7fc601400640 1 -- 172.21.15.2:0/2250665160 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7fc5ec001470 con 0x7fc6040af040 2024-08-17T02:24:01.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.250+0000 7fc601400640 1 -- 172.21.15.2:0/2250665160 >> v1:172.21.15.2:6789/0 conn(0x7fc6040af040 legacy=0x7fc6040b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.250+0000 7fc601400640 1 --2- 172.21.15.2:0/2250665160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5e8003a20 0x7fc5e8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.250+0000 7fc601400640 1 --2- 172.21.15.2:0/2250665160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5e8004780 0x7fc5e8004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.250+0000 7fc601400640 1 --2- 172.21.15.2:0/2250665160 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5e8005180 0x7fc5e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.250+0000 7fc601400640 1 -- 172.21.15.2:0/2250665160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040afa70 con 0x7fc5e8003a20 2024-08-17T02:24:01.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.250+0000 7fc601400640 1 -- 172.21.15.2:0/2250665160 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e800c120 con 0x7fc5e8004780 2024-08-17T02:24:01.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.250+0000 7fc601400640 1 -- 172.21.15.2:0/2250665160 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e800c2e0 con 0x7fc5e8005180 2024-08-17T02:24:01.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.250+0000 7fc601e00640 1 --2- 172.21.15.2:0/2250665160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5e8003a20 0x7fc5e8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.250+0000 7fc5fbe00640 1 --2- 172.21.15.2:0/2250665160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5e8004780 0x7fc5e8004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.251+0000 7fc602800640 1 --2- 172.21.15.2:0/2250665160 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5e8005180 0x7fc5e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.251+0000 7fc601e00640 1 -- 172.21.15.2:0/2250665160 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5e8005180 msgr2=0x7fc5e800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:01.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.251+0000 7fc601e00640 1 --2- 172.21.15.2:0/2250665160 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5e8005180 0x7fc5e800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.251+0000 7fc601e00640 1 -- 172.21.15.2:0/2250665160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5e8004780 msgr2=0x7fc5e8004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:01.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.251+0000 7fc601e00640 1 --2- 172.21.15.2:0/2250665160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5e8004780 0x7fc5e8004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.251+0000 7fc601e00640 1 -- 172.21.15.2:0/2250665160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e80034e0 con 0x7fc5e8003a20 2024-08-17T02:24:01.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.251+0000 7fc602800640 1 -- 172.21.15.2:0/2250665160 reap_dead start 2024-08-17T02:24:01.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.252+0000 7fc601e00640 1 --2- 172.21.15.2:0/2250665160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5e8003a20 0x7fc5e8003e30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4001800 tx=0x7fc5f4007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c03ee0fbbf67605 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:01.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.252+0000 7fc601400640 1 -- 172.21.15.2:0/2250665160 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f402a8e0 con 0x7fc5e8003a20 2024-08-17T02:24:01.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.252+0000 7fc601400640 1 -- 172.21.15.2:0/2250665160 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f402aa60 con 0x7fc5e8003a20 2024-08-17T02:24:01.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.252+0000 7fc601400640 1 -- 172.21.15.2:0/2250665160 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f402ae20 con 0x7fc5e8003a20 2024-08-17T02:24:01.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.252+0000 7fc603200640 1 -- 172.21.15.2:0/2250665160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5e8003a20 msgr2=0x7fc5e8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.252+0000 7fc603200640 1 --2- 172.21.15.2:0/2250665160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5e8003a20 0x7fc5e8003e30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4001800 tx=0x7fc5f4007ca0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.253+0000 7fc603200640 1 -- 172.21.15.2:0/2250665160 shutdown_connections 2024-08-17T02:24:01.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.253+0000 7fc603200640 1 --2- 172.21.15.2:0/2250665160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5e8003a20 0x7fc5e8003e30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.253+0000 7fc603200640 1 -- 172.21.15.2:0/2250665160 >> 172.21.15.2:0/2250665160 conn(0x7fc604095a70 msgr2=0x7fc604095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:01.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.253+0000 7fc603200640 1 -- 172.21.15.2:0/2250665160 shutdown_connections 2024-08-17T02:24:01.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.253+0000 7fc603200640 1 -- 172.21.15.2:0/2250665160 wait complete. 2024-08-17T02:24:01.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.254+0000 7fc603200640 1 Processor -- start 2024-08-17T02:24:01.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.254+0000 7fc603200640 1 -- start start 2024-08-17T02:24:01.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.255+0000 7fc603200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5e8003a20 0x7fc60415bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.255+0000 7fc603200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc60415d8b0 0x7fc60415f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.255+0000 7fc603200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6041525f0 0x7fc604150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.255+0000 7fc603200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60415eca0 con 0x7fc6041525f0 2024-08-17T02:24:01.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.255+0000 7fc603200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60415e090 con 0x7fc60415d8b0 2024-08-17T02:24:01.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.255+0000 7fc603200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60415e370 con 0x7fc5e8003a20 2024-08-17T02:24:01.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.255+0000 7fc602800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6041525f0 0x7fc604150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.255+0000 7fc602800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6041525f0 0x7fc604150ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44346/0 (socket says 172.21.15.2:44346) 2024-08-17T02:24:01.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.255+0000 7fc602800640 1 -- 172.21.15.2:0/2283370980 learned_addr learned my addr 172.21.15.2:0/2283370980 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:01.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.255+0000 7fc5fbe00640 1 --2- 172.21.15.2:0/2283370980 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc60415d8b0 0x7fc60415f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.255+0000 7fc601e00640 1 --2- 172.21.15.2:0/2283370980 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5e8003a20 0x7fc60415bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.256+0000 7fc602800640 1 -- 172.21.15.2:0/2283370980 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5e8003a20 msgr2=0x7fc60415bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.256+0000 7fc602800640 1 --2- 172.21.15.2:0/2283370980 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5e8003a20 0x7fc60415bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.256+0000 7fc602800640 1 -- 172.21.15.2:0/2283370980 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc60415d8b0 msgr2=0x7fc60415f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.256+0000 7fc602800640 1 --2- 172.21.15.2:0/2283370980 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc60415d8b0 0x7fc60415f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.256+0000 7fc602800640 1 -- 172.21.15.2:0/2283370980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60415e650 con 0x7fc6041525f0 2024-08-17T02:24:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.256+0000 7fc602800640 1 --2- 172.21.15.2:0/2283370980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6041525f0 0x7fc604150ff0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc60406dc30 tx=0x7fc5fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.256+0000 7fc5f9600640 1 -- 172.21.15.2:0/2283370980 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc00e070 con 0x7fc6041525f0 2024-08-17T02:24:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.256+0000 7fc5f9600640 1 -- 172.21.15.2:0/2283370980 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5fc0156b0 con 0x7fc6041525f0 2024-08-17T02:24:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.256+0000 7fc5f9600640 1 -- 172.21.15.2:0/2283370980 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc015a90 con 0x7fc6041525f0 2024-08-17T02:24:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.256+0000 7fc603200640 1 -- 172.21.15.2:0/2283370980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc60415e930 con 0x7fc6041525f0 2024-08-17T02:24:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.257+0000 7fc603200640 1 -- 172.21.15.2:0/2283370980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60415f670 con 0x7fc6041525f0 2024-08-17T02:24:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.258+0000 7fc603200640 1 -- 172.21.15.2:0/2283370980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc60415ee50 con 0x7fc6041525f0 2024-08-17T02:24:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.258+0000 7fc5f9600640 1 -- 172.21.15.2:0/2283370980 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc5fc016470 con 0x7fc6041525f0 2024-08-17T02:24:01.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.259+0000 7fc5f9600640 1 --2- 172.21.15.2:0/2283370980 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc5e0065180 0x7fc5e0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.259+0000 7fc5f9600640 1 -- 172.21.15.2:0/2283370980 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc5fc0826f0 con 0x7fc6041525f0 2024-08-17T02:24:01.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.259+0000 7fc601e00640 1 --2- 172.21.15.2:0/2283370980 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc5e0065180 0x7fc5e0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.260+0000 7fc601e00640 1 --2- 172.21.15.2:0/2283370980 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc5e0065180 0x7fc5e0067630 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4032000 tx=0x7fc5f4003000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:01.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.263+0000 7fc5f9600640 1 -- 172.21.15.2:0/2283370980 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc60415ee50 con 0x7fc6041525f0 2024-08-17T02:24:01.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.447+0000 7fc603200640 1 -- 172.21.15.2:0/2283370980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc604070720 con 0x7fc6041525f0 2024-08-17T02:24:01.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.448+0000 7fc5f9600640 1 -- 172.21.15.2:0/2283370980 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc5fc0507c0 con 0x7fc6041525f0 2024-08-17T02:24:01.449 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:24:01.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.450+0000 7fc603200640 1 -- 172.21.15.2:0/2283370980 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc5e0065180 msgr2=0x7fc5e0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.450+0000 7fc603200640 1 --2- 172.21.15.2:0/2283370980 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc5e0065180 0x7fc5e0067630 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4032000 tx=0x7fc5f4003000 comp rx=0 tx=0).stop 2024-08-17T02:24:01.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.450+0000 7fc603200640 1 -- 172.21.15.2:0/2283370980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6041525f0 msgr2=0x7fc604150ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.450+0000 7fc603200640 1 --2- 172.21.15.2:0/2283370980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6041525f0 0x7fc604150ff0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc60406dc30 tx=0x7fc5fc00b040 comp rx=0 tx=0).stop 2024-08-17T02:24:01.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.450+0000 7fc603200640 1 -- 172.21.15.2:0/2283370980 shutdown_connections 2024-08-17T02:24:01.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.450+0000 7fc603200640 1 --2- 172.21.15.2:0/2283370980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6041525f0 0x7fc604150ff0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.450+0000 7fc603200640 1 --2- 172.21.15.2:0/2283370980 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc60415d8b0 0x7fc60415f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.450+0000 7fc603200640 1 --2- 172.21.15.2:0/2283370980 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc5e0065180 0x7fc5e0067630 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.450+0000 7fc603200640 1 --2- 172.21.15.2:0/2283370980 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5e8003a20 0x7fc60415bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.450+0000 7fc603200640 1 -- 172.21.15.2:0/2283370980 >> 172.21.15.2:0/2283370980 conn(0x7fc604095a70 msgr2=0x7fc604066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:01.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.450+0000 7fc603200640 1 -- 172.21.15.2:0/2283370980 shutdown_connections 2024-08-17T02:24:01.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.450+0000 7fc603200640 1 -- 172.21.15.2:0/2283370980 wait complete. 2024-08-17T02:24:01.466 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:24:01.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.624+0000 7f5d3ea00640 1 Processor -- start 2024-08-17T02:24:01.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.624+0000 7f5d3ea00640 1 -- start start 2024-08-17T02:24:01.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.625+0000 7f5d3ea00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5d38155040 0x7f5d38158c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.625+0000 7f5d3ea00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f5d3806e770 0x7f5d380af340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.625+0000 7f5d3ea00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d380aeeb0 con 0x7f5d381591c0 2024-08-17T02:24:01.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.625+0000 7f5d3ea00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d38159610 con 0x7f5d38155040 2024-08-17T02:24:01.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.625+0000 7f5d3ea00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d380aadd0 con 0x7f5d3806e770 2024-08-17T02:24:01.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.626+0000 7f5d37e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5d38155040 0x7f5d38158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.626+0000 7f5d37e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5d38155040 0x7f5d38158c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44354/0 (socket says 172.21.15.2:44354) 2024-08-17T02:24:01.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.626+0000 7f5d37e00640 1 -- 172.21.15.2:0/2815852392 learned_addr learned my addr 172.21.15.2:0/2815852392 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:01.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.626+0000 7f5d3ca00640 1 --2- 172.21.15.2:0/2815852392 >> v2:172.21.15.145:3300/0 conn(0x7f5d3806e770 0x7f5d380af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.626+0000 7f5d37e00640 1 -- 172.21.15.2:0/2815852392 >> v2:172.21.15.145:3300/0 conn(0x7f5d3806e770 msgr2=0x7f5d380af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:01.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.626+0000 7f5d37e00640 1 --2- 172.21.15.2:0/2815852392 >> v2:172.21.15.145:3300/0 conn(0x7f5d3806e770 0x7f5d380af340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.626+0000 7f5d37e00640 1 -- 172.21.15.2:0/2815852392 >> v1:172.21.15.145:6789/0 conn(0x7f5d381591c0 legacy=0x7f5d3806e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:01.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.626+0000 7f5d37e00640 1 -- 172.21.15.2:0/2815852392 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d381597f0 con 0x7f5d38155040 2024-08-17T02:24:01.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.627+0000 7f5d37e00640 1 --2- 172.21.15.2:0/2815852392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d38155040 0x7f5d38158c80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5d380ad790 tx=0x7f5d2800a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aba45bc0b89c699 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:01.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.627+0000 7f5d37400640 1 -- 172.21.15.2:0/2815852392 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d28030510 con 0x7f5d38155040 2024-08-17T02:24:01.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.628+0000 7f5d37400640 1 -- 172.21.15.2:0/2815852392 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2802e050 con 0x7f5d38155040 2024-08-17T02:24:01.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.628+0000 7f5d37400640 1 -- 172.21.15.2:0/2815852392 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d280308e0 con 0x7f5d38155040 2024-08-17T02:24:01.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.628+0000 7f5d3ea00640 1 -- 172.21.15.2:0/2815852392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d38155040 msgr2=0x7f5d38158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.628+0000 7f5d3ea00640 1 --2- 172.21.15.2:0/2815852392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d38155040 0x7f5d38158c80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5d380ad790 tx=0x7f5d2800a360 comp rx=0 tx=0).stop 2024-08-17T02:24:01.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.628+0000 7f5d3ea00640 1 -- 172.21.15.2:0/2815852392 shutdown_connections 2024-08-17T02:24:01.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.628+0000 7f5d3ea00640 1 --2- 172.21.15.2:0/2815852392 >> v2:172.21.15.145:3300/0 conn(0x7f5d3806e770 0x7f5d380af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.628+0000 7f5d3ea00640 1 --2- 172.21.15.2:0/2815852392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d38155040 0x7f5d38158c80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.628+0000 7f5d3ea00640 1 -- 172.21.15.2:0/2815852392 >> 172.21.15.2:0/2815852392 conn(0x7f5d38066e60 msgr2=0x7f5d38067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:01.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.628+0000 7f5d3ea00640 1 -- 172.21.15.2:0/2815852392 shutdown_connections 2024-08-17T02:24:01.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.628+0000 7f5d3ea00640 1 -- 172.21.15.2:0/2815852392 wait complete. 2024-08-17T02:24:01.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.630+0000 7f5d3ea00640 1 Processor -- start 2024-08-17T02:24:01.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.630+0000 7f5d3ea00640 1 -- start start 2024-08-17T02:24:01.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.631+0000 7f5d3ea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5d3806e770 0x7f5d380c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.631+0000 7f5d3ea00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5d38155040 0x7f5d381569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.631+0000 7f5d3ea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d381591c0 0x7f5d38155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.631+0000 7f5d3ea00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d38157450 con 0x7f5d381591c0 2024-08-17T02:24:01.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.631+0000 7f5d3ea00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d38157730 con 0x7f5d3806e770 2024-08-17T02:24:01.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.631+0000 7f5d3ea00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d38157a10 con 0x7f5d38155040 2024-08-17T02:24:01.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.631+0000 7f5d3ca00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d381591c0 0x7f5d38155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.631+0000 7f5d3ca00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d381591c0 0x7f5d38155410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44360/0 (socket says 172.21.15.2:44360) 2024-08-17T02:24:01.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.631+0000 7f5d3ca00640 1 -- 172.21.15.2:0/713695787 learned_addr learned my addr 172.21.15.2:0/713695787 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:01.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.631+0000 7f5d37e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5d3806e770 0x7f5d380c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.631+0000 7f5d2fe00640 1 --2- 172.21.15.2:0/713695787 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5d38155040 0x7f5d381569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.631+0000 7f5d3ca00640 1 -- 172.21.15.2:0/713695787 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5d38155040 msgr2=0x7f5d381569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.631+0000 7f5d3ca00640 1 --2- 172.21.15.2:0/713695787 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5d38155040 0x7f5d381569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.631+0000 7f5d3ca00640 1 -- 172.21.15.2:0/713695787 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5d3806e770 msgr2=0x7f5d380c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.631+0000 7f5d3ca00640 1 --2- 172.21.15.2:0/713695787 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5d3806e770 0x7f5d380c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.631+0000 7f5d3ca00640 1 -- 172.21.15.2:0/713695787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2800a600 con 0x7f5d381591c0 2024-08-17T02:24:01.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.632+0000 7f5d3ca00640 1 --2- 172.21.15.2:0/713695787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d381591c0 0x7f5d38155410 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5d30007f30 tx=0x7f5d300098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:01.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.632+0000 7f5d2f400640 1 -- 172.21.15.2:0/713695787 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3000ee30 con 0x7f5d381591c0 2024-08-17T02:24:01.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.632+0000 7f5d2f400640 1 -- 172.21.15.2:0/713695787 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d30014420 con 0x7f5d381591c0 2024-08-17T02:24:01.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.632+0000 7f5d3ea00640 1 -- 172.21.15.2:0/713695787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d38157cf0 con 0x7f5d381591c0 2024-08-17T02:24:01.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.632+0000 7f5d2f400640 1 -- 172.21.15.2:0/713695787 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d300147e0 con 0x7f5d381591c0 2024-08-17T02:24:01.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.632+0000 7f5d3ea00640 1 -- 172.21.15.2:0/713695787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d381508a0 con 0x7f5d381591c0 2024-08-17T02:24:01.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.633+0000 7f5d3ea00640 1 -- 172.21.15.2:0/713695787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d38063fb0 con 0x7f5d381591c0 2024-08-17T02:24:01.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.634+0000 7f5d2f400640 1 -- 172.21.15.2:0/713695787 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5d30014b90 con 0x7f5d381591c0 2024-08-17T02:24:01.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.635+0000 7f5d2f400640 1 --2- 172.21.15.2:0/713695787 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5d14065150 0x7f5d14067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.635+0000 7f5d2f400640 1 -- 172.21.15.2:0/713695787 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5d30082bb0 con 0x7f5d381591c0 2024-08-17T02:24:01.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.635+0000 7f5d37e00640 1 --2- 172.21.15.2:0/713695787 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5d14065150 0x7f5d14067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.636+0000 7f5d37e00640 1 --2- 172.21.15.2:0/713695787 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5d14065150 0x7f5d14067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5d28035000 tx=0x7f5d28038000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:01.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.639+0000 7f5d2f400640 1 -- 172.21.15.2:0/713695787 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5d30050c80 con 0x7f5d381591c0 2024-08-17T02:24:01.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.822+0000 7f5d3ea00640 1 -- 172.21.15.2:0/713695787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5d3806db50 con 0x7f5d381591c0 2024-08-17T02:24:01.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.822+0000 7f5d2f400640 1 -- 172.21.15.2:0/713695787 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5d30009a20 con 0x7f5d381591c0 2024-08-17T02:24:01.823 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-08-17T02:24:01.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.825+0000 7f5d3ea00640 1 -- 172.21.15.2:0/713695787 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5d14065150 msgr2=0x7f5d14067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.825+0000 7f5d3ea00640 1 --2- 172.21.15.2:0/713695787 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5d14065150 0x7f5d14067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5d28035000 tx=0x7f5d28038000 comp rx=0 tx=0).stop 2024-08-17T02:24:01.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.825+0000 7f5d3ea00640 1 -- 172.21.15.2:0/713695787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d381591c0 msgr2=0x7f5d38155410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.825+0000 7f5d3ea00640 1 --2- 172.21.15.2:0/713695787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d381591c0 0x7f5d38155410 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5d30007f30 tx=0x7f5d300098e0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.825+0000 7f5d3ea00640 1 -- 172.21.15.2:0/713695787 shutdown_connections 2024-08-17T02:24:01.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.825+0000 7f5d3ea00640 1 --2- 172.21.15.2:0/713695787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d381591c0 0x7f5d38155410 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.825+0000 7f5d3ea00640 1 --2- 172.21.15.2:0/713695787 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5d14065150 0x7f5d14067600 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.825+0000 7f5d3ea00640 1 --2- 172.21.15.2:0/713695787 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5d38155040 0x7f5d381569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.825+0000 7f5d3ea00640 1 --2- 172.21.15.2:0/713695787 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5d3806e770 0x7f5d380c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.825+0000 7f5d3ea00640 1 -- 172.21.15.2:0/713695787 >> 172.21.15.2:0/713695787 conn(0x7f5d38066e60 msgr2=0x7f5d380cb870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:01.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.825+0000 7f5d3ea00640 1 -- 172.21.15.2:0/713695787 shutdown_connections 2024-08-17T02:24:01.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.825+0000 7f5d3ea00640 1 -- 172.21.15.2:0/713695787 wait complete. 2024-08-17T02:24:01.841 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:01.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.991+0000 7fcf64a00640 1 Processor -- start 2024-08-17T02:24:01.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.991+0000 7fcf64a00640 1 -- start start 2024-08-17T02:24:01.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.993+0000 7fcf64a00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fcf600ad960 0x7fcf6015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.993+0000 7fcf64a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcf600ca050 0x7fcf60156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.993+0000 7fcf64a00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf6015b5e0 con 0x7fcf600add30 2024-08-17T02:24:01.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.993+0000 7fcf64a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf600cb160 con 0x7fcf600ca050 2024-08-17T02:24:01.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.993+0000 7fcf64a00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf600b0d10 con 0x7fcf600ad960 2024-08-17T02:24:01.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.993+0000 7fcf55400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcf600ca050 0x7fcf60156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.993+0000 7fcf55400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcf600ca050 0x7fcf60156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44374/0 (socket says 172.21.15.2:44374) 2024-08-17T02:24:01.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.993+0000 7fcf55400640 1 -- 172.21.15.2:0/199037019 learned_addr learned my addr 172.21.15.2:0/199037019 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:01.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.993+0000 7fcf5de00640 1 --2- 172.21.15.2:0/199037019 >> v2:172.21.15.145:3300/0 conn(0x7fcf600ad960 0x7fcf6015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.993+0000 7fcf55400640 1 -- 172.21.15.2:0/199037019 >> v2:172.21.15.145:3300/0 conn(0x7fcf600ad960 msgr2=0x7fcf6015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:01.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.993+0000 7fcf55400640 1 --2- 172.21.15.2:0/199037019 >> v2:172.21.15.145:3300/0 conn(0x7fcf600ad960 0x7fcf6015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.993+0000 7fcf55400640 1 -- 172.21.15.2:0/199037019 >> v1:172.21.15.145:6789/0 conn(0x7fcf600add30 legacy=0x7fcf60156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.993+0000 7fcf55400640 1 -- 172.21.15.2:0/199037019 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf600ca550 con 0x7fcf600ca050 2024-08-17T02:24:01.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.994+0000 7fcf55400640 1 --2- 172.21.15.2:0/199037019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf600ca050 0x7fcf60156420 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcf600cc910 tx=0x7fcf480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4e4c5815b4cfc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:01.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.995+0000 7fcf5d400640 1 -- 172.21.15.2:0/199037019 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf48032440 con 0x7fcf600ca050 2024-08-17T02:24:01.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.995+0000 7fcf5d400640 1 -- 172.21.15.2:0/199037019 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf480325a0 con 0x7fcf600ca050 2024-08-17T02:24:01.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.995+0000 7fcf5d400640 1 -- 172.21.15.2:0/199037019 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf48032980 con 0x7fcf600ca050 2024-08-17T02:24:01.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.995+0000 7fcf64a00640 1 -- 172.21.15.2:0/199037019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf600ca050 msgr2=0x7fcf60156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.995+0000 7fcf64a00640 1 --2- 172.21.15.2:0/199037019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf600ca050 0x7fcf60156420 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcf600cc910 tx=0x7fcf480091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.995+0000 7fcf64a00640 1 -- 172.21.15.2:0/199037019 shutdown_connections 2024-08-17T02:24:01.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.995+0000 7fcf64a00640 1 --2- 172.21.15.2:0/199037019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf600ca050 0x7fcf60156420 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.995+0000 7fcf64a00640 1 --2- 172.21.15.2:0/199037019 >> v2:172.21.15.145:3300/0 conn(0x7fcf600ad960 0x7fcf6015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.995+0000 7fcf64a00640 1 -- 172.21.15.2:0/199037019 >> 172.21.15.2:0/199037019 conn(0x7fcf60066e60 msgr2=0x7fcf60067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:01.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.995+0000 7fcf64a00640 1 -- 172.21.15.2:0/199037019 shutdown_connections 2024-08-17T02:24:01.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.996+0000 7fcf64a00640 1 -- 172.21.15.2:0/199037019 wait complete. 2024-08-17T02:24:01.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.997+0000 7fcf64a00640 1 Processor -- start 2024-08-17T02:24:01.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.997+0000 7fcf64a00640 1 -- start start 2024-08-17T02:24:02.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.998+0000 7fcf64a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf600ad960 0x7fcf60148740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.998+0000 7fcf64a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf600add30 0x7fcf600a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.998+0000 7fcf64a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf600ca050 0x7fcf60158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.998+0000 7fcf64a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf60148c80 con 0x7fcf600ad960 2024-08-17T02:24:02.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.998+0000 7fcf64a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf600aa400 con 0x7fcf600add30 2024-08-17T02:24:02.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.998+0000 7fcf64a00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf600a9360 con 0x7fcf600ca050 2024-08-17T02:24:02.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.998+0000 7fcf5de00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf600ad960 0x7fcf60148740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.998+0000 7fcf5de00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf600ad960 0x7fcf60148740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44378/0 (socket says 172.21.15.2:44378) 2024-08-17T02:24:02.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.998+0000 7fcf5de00640 1 -- 172.21.15.2:0/3347454595 learned_addr learned my addr 172.21.15.2:0/3347454595 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:02.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.998+0000 7fcf55400640 1 --2- 172.21.15.2:0/3347454595 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf600add30 0x7fcf600a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.998+0000 7fcf5e800640 1 --2- 172.21.15.2:0/3347454595 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf600ca050 0x7fcf60158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.999+0000 7fcf5de00640 1 -- 172.21.15.2:0/3347454595 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf600ca050 msgr2=0x7fcf60158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.999+0000 7fcf5de00640 1 --2- 172.21.15.2:0/3347454595 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf600ca050 0x7fcf60158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.999+0000 7fcf5de00640 1 -- 172.21.15.2:0/3347454595 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf600add30 msgr2=0x7fcf600a88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.999+0000 7fcf5de00640 1 --2- 172.21.15.2:0/3347454595 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf600add30 0x7fcf600a88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.999+0000 7fcf5de00640 1 -- 172.21.15.2:0/3347454595 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf48009450 con 0x7fcf600ad960 2024-08-17T02:24:02.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.999+0000 7fcf5de00640 1 --2- 172.21.15.2:0/3347454595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf600ad960 0x7fcf60148740 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000e900 tx=0x7fcf500090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:02.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.999+0000 7fcf56000640 1 -- 172.21.15.2:0/3347454595 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5000c8e0 con 0x7fcf600ad960 2024-08-17T02:24:02.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.999+0000 7fcf56000640 1 -- 172.21.15.2:0/3347454595 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5000ca40 con 0x7fcf600ad960 2024-08-17T02:24:02.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.999+0000 7fcf56000640 1 -- 172.21.15.2:0/3347454595 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5000cde0 con 0x7fcf600ad960 2024-08-17T02:24:02.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.999+0000 7fcf64a00640 1 -- 172.21.15.2:0/3347454595 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf600a9640 con 0x7fcf600ad960 2024-08-17T02:24:02.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:01.999+0000 7fcf64a00640 1 -- 172.21.15.2:0/3347454595 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf600a9c00 con 0x7fcf600ad960 2024-08-17T02:24:02.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.000+0000 7fcf64a00640 1 -- 172.21.15.2:0/3347454595 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf60063fb0 con 0x7fcf600ad960 2024-08-17T02:24:02.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.001+0000 7fcf56000640 1 -- 172.21.15.2:0/3347454595 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcf50013680 con 0x7fcf600ad960 2024-08-17T02:24:02.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.002+0000 7fcf56000640 1 --2- 172.21.15.2:0/3347454595 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fcf3c065180 0x7fcf3c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.002+0000 7fcf56000640 1 -- 172.21.15.2:0/3347454595 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcf500825a0 con 0x7fcf600ad960 2024-08-17T02:24:02.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.002+0000 7fcf55400640 1 --2- 172.21.15.2:0/3347454595 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fcf3c065180 0x7fcf3c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.003+0000 7fcf55400640 1 --2- 172.21.15.2:0/3347454595 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fcf3c065180 0x7fcf3c067630 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcf48034000 tx=0x7fcf48032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:02.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.006+0000 7fcf56000640 1 -- 172.21.15.2:0/3347454595 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcf50050730 con 0x7fcf600ad960 2024-08-17T02:24:02.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.192+0000 7fcf64a00640 1 -- 172.21.15.2:0/3347454595 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf6006ba30 con 0x7fcf600ad960 2024-08-17T02:24:02.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.193+0000 7fcf56000640 1 -- 172.21.15.2:0/3347454595 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fcf50053d50 con 0x7fcf600ad960 2024-08-17T02:24:02.194 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:24:02.195 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:23:32.955197+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:29.708835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:30.361908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:02.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.195+0000 7fcf64a00640 1 -- 172.21.15.2:0/3347454595 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fcf3c065180 msgr2=0x7fcf3c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.195+0000 7fcf64a00640 1 --2- 172.21.15.2:0/3347454595 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fcf3c065180 0x7fcf3c067630 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcf48034000 tx=0x7fcf48032000 comp rx=0 tx=0).stop 2024-08-17T02:24:02.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.195+0000 7fcf64a00640 1 -- 172.21.15.2:0/3347454595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf600ad960 msgr2=0x7fcf60148740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.195+0000 7fcf64a00640 1 --2- 172.21.15.2:0/3347454595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf600ad960 0x7fcf60148740 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000e900 tx=0x7fcf500090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.195+0000 7fcf64a00640 1 -- 172.21.15.2:0/3347454595 shutdown_connections 2024-08-17T02:24:02.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.195+0000 7fcf64a00640 1 --2- 172.21.15.2:0/3347454595 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fcf3c065180 0x7fcf3c067630 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.195+0000 7fcf64a00640 1 --2- 172.21.15.2:0/3347454595 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf600ca050 0x7fcf60158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.195+0000 7fcf64a00640 1 --2- 172.21.15.2:0/3347454595 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf600add30 0x7fcf600a88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.195+0000 7fcf64a00640 1 --2- 172.21.15.2:0/3347454595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf600ad960 0x7fcf60148740 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.196+0000 7fcf64a00640 1 -- 172.21.15.2:0/3347454595 >> 172.21.15.2:0/3347454595 conn(0x7fcf60066e60 msgr2=0x7fcf601532c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:02.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.196+0000 7fcf64a00640 1 -- 172.21.15.2:0/3347454595 shutdown_connections 2024-08-17T02:24:02.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.196+0000 7fcf64a00640 1 -- 172.21.15.2:0/3347454595 wait complete. 2024-08-17T02:24:02.212 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:23:26.107978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:23:29.708835+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:23:30.361908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:24:02.213 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:24:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.366+0000 7efdc4a00640 1 Processor -- start 2024-08-17T02:24:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.366+0000 7efdc4a00640 1 -- start start 2024-08-17T02:24:02.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.367+0000 7efdc4a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efdc0158b60 0x7efdc00aa640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.368+0000 7efdc4a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc00a8dd0 con 0x7efdc0067aa0 2024-08-17T02:24:02.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.368+0000 7efdc4a00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc00abbc0 con 0x7efdc0158f30 2024-08-17T02:24:02.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.368+0000 7efdc4a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc00abe60 con 0x7efdc0158b60 2024-08-17T02:24:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.368+0000 7efdbde00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efdc0158b60 0x7efdc00aa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.368+0000 7efdbde00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efdc0158b60 0x7efdc00aa640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44384/0 (socket says 172.21.15.2:44384) 2024-08-17T02:24:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.368+0000 7efdbde00640 1 -- 172.21.15.2:0/516425575 learned_addr learned my addr 172.21.15.2:0/516425575 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.368+0000 7efdbde00640 1 -- 172.21.15.2:0/516425575 >> v1:172.21.15.145:6789/0 conn(0x7efdc0158f30 legacy=0x7efdc00ac420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.368+0000 7efdbde00640 1 -- 172.21.15.2:0/516425575 >> v1:172.21.15.2:6789/0 conn(0x7efdc0067aa0 legacy=0x7efdc00a9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.368+0000 7efdbde00640 1 -- 172.21.15.2:0/516425575 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc00ac140 con 0x7efdc0158b60 2024-08-17T02:24:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.369+0000 7efdbde00640 1 --2- 172.21.15.2:0/516425575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdc0158b60 0x7efdc00aa640 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009910 tx=0x7efdb00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a72ebfed3fbbf6f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.370+0000 7efdbca00640 1 -- 172.21.15.2:0/516425575 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb0032440 con 0x7efdc0158b60 2024-08-17T02:24:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.370+0000 7efdbca00640 1 -- 172.21.15.2:0/516425575 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb00325a0 con 0x7efdc0158b60 2024-08-17T02:24:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.370+0000 7efdbca00640 1 -- 172.21.15.2:0/516425575 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb0032980 con 0x7efdc0158b60 2024-08-17T02:24:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.370+0000 7efdc4a00640 1 -- 172.21.15.2:0/516425575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdc0158b60 msgr2=0x7efdc00aa640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.370+0000 7efdc4a00640 1 --2- 172.21.15.2:0/516425575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdc0158b60 0x7efdc00aa640 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009910 tx=0x7efdb00091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.370+0000 7efdc4a00640 1 -- 172.21.15.2:0/516425575 shutdown_connections 2024-08-17T02:24:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.370+0000 7efdc4a00640 1 --2- 172.21.15.2:0/516425575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdc0158b60 0x7efdc00aa640 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.370+0000 7efdc4a00640 1 -- 172.21.15.2:0/516425575 >> 172.21.15.2:0/516425575 conn(0x7efdc00cc390 msgr2=0x7efdc0066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.370+0000 7efdc4a00640 1 -- 172.21.15.2:0/516425575 shutdown_connections 2024-08-17T02:24:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.370+0000 7efdc4a00640 1 -- 172.21.15.2:0/516425575 wait complete. 2024-08-17T02:24:02.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.372+0000 7efdc4a00640 1 Processor -- start 2024-08-17T02:24:02.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.372+0000 7efdc4a00640 1 -- start start 2024-08-17T02:24:02.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.373+0000 7efdc4a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efdc0067aa0 0x7efdc016c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.373+0000 7efdc4a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdc0158b60 0x7efdc01695f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.373+0000 7efdc4a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efdc0158f30 0x7efdc006a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.373+0000 7efdc4a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc016aaf0 con 0x7efdc0158b60 2024-08-17T02:24:02.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.373+0000 7efdc4a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc016a550 con 0x7efdc0158f30 2024-08-17T02:24:02.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.373+0000 7efdc4a00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc0169f90 con 0x7efdc0067aa0 2024-08-17T02:24:02.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.373+0000 7efdbd400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdc0158b60 0x7efdc01695f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.373+0000 7efdbd400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdc0158b60 0x7efdc01695f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44388/0 (socket says 172.21.15.2:44388) 2024-08-17T02:24:02.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.373+0000 7efdbd400640 1 -- 172.21.15.2:0/3695420636 learned_addr learned my addr 172.21.15.2:0/3695420636 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:02.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.373+0000 7efdbde00640 1 --2- 172.21.15.2:0/3695420636 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efdc0067aa0 0x7efdc016c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.373+0000 7efdbe800640 1 --2- 172.21.15.2:0/3695420636 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efdc0158f30 0x7efdc006a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.373+0000 7efdbd400640 1 -- 172.21.15.2:0/3695420636 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efdc0067aa0 msgr2=0x7efdc016c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.373+0000 7efdbd400640 1 --2- 172.21.15.2:0/3695420636 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efdc0067aa0 0x7efdc016c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.373+0000 7efdbd400640 1 -- 172.21.15.2:0/3695420636 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efdc0158f30 msgr2=0x7efdc006a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.373+0000 7efdbd400640 1 --2- 172.21.15.2:0/3695420636 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efdc0158f30 0x7efdc006a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.373+0000 7efdbd400640 1 -- 172.21.15.2:0/3695420636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb0009450 con 0x7efdc0158b60 2024-08-17T02:24:02.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.374+0000 7efdbd400640 1 --2- 172.21.15.2:0/3695420636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdc0158b60 0x7efdc01695f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efdac00c4c0 tx=0x7efdac007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:02.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.374+0000 7efdb5600640 1 -- 172.21.15.2:0/3695420636 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac011590 con 0x7efdc0158b60 2024-08-17T02:24:02.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.374+0000 7efdb5600640 1 -- 172.21.15.2:0/3695420636 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac011710 con 0x7efdc0158b60 2024-08-17T02:24:02.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.374+0000 7efdb5600640 1 -- 172.21.15.2:0/3695420636 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac011ad0 con 0x7efdc0158b60 2024-08-17T02:24:02.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.374+0000 7efdc4a00640 1 -- 172.21.15.2:0/3695420636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc016a270 con 0x7efdc0158b60 2024-08-17T02:24:02.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.374+0000 7efdc4a00640 1 -- 172.21.15.2:0/3695420636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc0155ae0 con 0x7efdc0158b60 2024-08-17T02:24:02.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.375+0000 7efdc4a00640 1 -- 172.21.15.2:0/3695420636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc0155650 con 0x7efdc0158b60 2024-08-17T02:24:02.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.376+0000 7efdb5600640 1 -- 172.21.15.2:0/3695420636 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efdac01b3b0 con 0x7efdc0158b60 2024-08-17T02:24:02.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.377+0000 7efdb5600640 1 --2- 172.21.15.2:0/3695420636 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7efda0065150 0x7efda0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.377+0000 7efdb5600640 1 -- 172.21.15.2:0/3695420636 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efdac0819b0 con 0x7efdc0158b60 2024-08-17T02:24:02.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.378+0000 7efdbde00640 1 --2- 172.21.15.2:0/3695420636 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7efda0065150 0x7efda0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.378+0000 7efdbde00640 1 --2- 172.21.15.2:0/3695420636 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7efda0065150 0x7efda0067600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efdb0034000 tx=0x7efdb0032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:02.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.380+0000 7efdb5600640 1 -- 172.21.15.2:0/3695420636 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efdac04f9d0 con 0x7efdc0158b60 2024-08-17T02:24:02.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.561+0000 7efdc4a00640 1 -- 172.21.15.2:0/3695420636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efdc0063fb0 con 0x7efdc0158b60 2024-08-17T02:24:02.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.561+0000 7efdb5600640 1 -- 172.21.15.2:0/3695420636 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7efdac017070 con 0x7efdc0158b60 2024-08-17T02:24:02.563 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-17T02:24:02.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.564+0000 7efdc4a00640 1 -- 172.21.15.2:0/3695420636 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7efda0065150 msgr2=0x7efda0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.564+0000 7efdc4a00640 1 --2- 172.21.15.2:0/3695420636 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7efda0065150 0x7efda0067600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efdb0034000 tx=0x7efdb0032000 comp rx=0 tx=0).stop 2024-08-17T02:24:02.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.564+0000 7efdc4a00640 1 -- 172.21.15.2:0/3695420636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdc0158b60 msgr2=0x7efdc01695f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.564+0000 7efdc4a00640 1 --2- 172.21.15.2:0/3695420636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdc0158b60 0x7efdc01695f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efdac00c4c0 tx=0x7efdac007ef0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.564+0000 7efdc4a00640 1 -- 172.21.15.2:0/3695420636 shutdown_connections 2024-08-17T02:24:02.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.564+0000 7efdc4a00640 1 --2- 172.21.15.2:0/3695420636 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efdc0158f30 0x7efdc006a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.564+0000 7efdc4a00640 1 --2- 172.21.15.2:0/3695420636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdc0158b60 0x7efdc01695f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.564+0000 7efdc4a00640 1 --2- 172.21.15.2:0/3695420636 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7efda0065150 0x7efda0067600 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.564+0000 7efdc4a00640 1 --2- 172.21.15.2:0/3695420636 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efdc0067aa0 0x7efdc016c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.564+0000 7efdc4a00640 1 -- 172.21.15.2:0/3695420636 >> 172.21.15.2:0/3695420636 conn(0x7efdc00cc390 msgr2=0x7efdc0157800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:02.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.564+0000 7efdc4a00640 1 -- 172.21.15.2:0/3695420636 shutdown_connections 2024-08-17T02:24:02.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.564+0000 7efdc4a00640 1 -- 172.21.15.2:0/3695420636 wait complete. 2024-08-17T02:24:02.580 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:24:02.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.734+0000 7f5c4ec00640 1 Processor -- start 2024-08-17T02:24:02.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.734+0000 7f5c4ec00640 1 -- start start 2024-08-17T02:24:02.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.735+0000 7f5c4ec00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5c480afca0 0x7f5c480b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.735+0000 7f5c4ec00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c480acf10 0x7f5c48159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.735+0000 7f5c4ec00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4815a4e0 con 0x7f5c481589a0 2024-08-17T02:24:02.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.735+0000 7f5c4ec00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c480b0980 con 0x7f5c480afca0 2024-08-17T02:24:02.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.735+0000 7f5c4ec00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c480c92b0 con 0x7f5c480acf10 2024-08-17T02:24:02.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.736+0000 7f5c47e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5c480afca0 0x7f5c480b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.736+0000 7f5c47e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5c480afca0 0x7f5c480b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44398/0 (socket says 172.21.15.2:44398) 2024-08-17T02:24:02.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.736+0000 7f5c47e00640 1 -- 172.21.15.2:0/2292840193 learned_addr learned my addr 172.21.15.2:0/2292840193 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:02.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.736+0000 7f5c47400640 1 --2- 172.21.15.2:0/2292840193 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c480acf10 0x7f5c48159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.736+0000 7f5c47e00640 1 -- 172.21.15.2:0/2292840193 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c480acf10 msgr2=0x7f5c48159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:02.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.736+0000 7f5c47e00640 1 --2- 172.21.15.2:0/2292840193 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c480acf10 0x7f5c48159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.736+0000 7f5c47e00640 1 -- 172.21.15.2:0/2292840193 >> v1:172.21.15.145:6789/0 conn(0x7f5c481589a0 legacy=0x7f5c4806d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.736+0000 7f5c47e00640 1 -- 172.21.15.2:0/2292840193 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c480ad480 con 0x7f5c480afca0 2024-08-17T02:24:02.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.737+0000 7f5c47e00640 1 --2- 172.21.15.2:0/2292840193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c480afca0 0x7f5c480b0070 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009940 tx=0x7f5c380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b59b86f517d19a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:02.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.737+0000 7f5c46a00640 1 -- 172.21.15.2:0/2292840193 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3802ae40 con 0x7f5c480afca0 2024-08-17T02:24:02.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.737+0000 7f5c46a00640 1 -- 172.21.15.2:0/2292840193 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c38032440 con 0x7f5c480afca0 2024-08-17T02:24:02.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.737+0000 7f5c46a00640 1 -- 172.21.15.2:0/2292840193 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c38032820 con 0x7f5c480afca0 2024-08-17T02:24:02.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.738+0000 7f5c4ec00640 1 -- 172.21.15.2:0/2292840193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c480afca0 msgr2=0x7f5c480b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.738+0000 7f5c4ec00640 1 --2- 172.21.15.2:0/2292840193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c480afca0 0x7f5c480b0070 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009940 tx=0x7f5c380091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.738+0000 7f5c4ec00640 1 -- 172.21.15.2:0/2292840193 shutdown_connections 2024-08-17T02:24:02.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.738+0000 7f5c4ec00640 1 --2- 172.21.15.2:0/2292840193 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c480acf10 0x7f5c48159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.738+0000 7f5c4ec00640 1 --2- 172.21.15.2:0/2292840193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c480afca0 0x7f5c480b0070 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.738+0000 7f5c4ec00640 1 -- 172.21.15.2:0/2292840193 >> 172.21.15.2:0/2292840193 conn(0x7f5c48066e60 msgr2=0x7f5c48067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:02.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.738+0000 7f5c4ec00640 1 -- 172.21.15.2:0/2292840193 shutdown_connections 2024-08-17T02:24:02.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.738+0000 7f5c4ec00640 1 -- 172.21.15.2:0/2292840193 wait complete. 2024-08-17T02:24:02.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.740+0000 7f5c4ec00640 1 Processor -- start 2024-08-17T02:24:02.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.740+0000 7f5c4ec00640 1 -- start start 2024-08-17T02:24:02.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.740+0000 7f5c4ec00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c480acf10 0x7f5c48152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.740+0000 7f5c4ec00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c480afca0 0x7f5c48168f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.741+0000 7f5c4ec00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c481589a0 0x7f5c4815ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.741+0000 7f5c4ec00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4815c710 con 0x7f5c481589a0 2024-08-17T02:24:02.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.741+0000 7f5c4ec00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4815c9f0 con 0x7f5c480acf10 2024-08-17T02:24:02.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.741+0000 7f5c4ec00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c48169840 con 0x7f5c480afca0 2024-08-17T02:24:02.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.741+0000 7f5c4cc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c481589a0 0x7f5c4815ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.741+0000 7f5c4cc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c481589a0 0x7f5c4815ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44404/0 (socket says 172.21.15.2:44404) 2024-08-17T02:24:02.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.741+0000 7f5c4cc00640 1 -- 172.21.15.2:0/563234555 learned_addr learned my addr 172.21.15.2:0/563234555 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:02.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.741+0000 7f5c47e00640 1 --2- 172.21.15.2:0/563234555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c480acf10 0x7f5c48152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.741+0000 7f5c47400640 1 --2- 172.21.15.2:0/563234555 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c480afca0 0x7f5c48168f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.741+0000 7f5c4cc00640 1 -- 172.21.15.2:0/563234555 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c480afca0 msgr2=0x7f5c48168f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.741+0000 7f5c4cc00640 1 --2- 172.21.15.2:0/563234555 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c480afca0 0x7f5c48168f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.741+0000 7f5c4cc00640 1 -- 172.21.15.2:0/563234555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c480acf10 msgr2=0x7f5c48152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.741+0000 7f5c4cc00640 1 --2- 172.21.15.2:0/563234555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c480acf10 0x7f5c48152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.741+0000 7f5c4cc00640 1 -- 172.21.15.2:0/563234555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c38009450 con 0x7f5c481589a0 2024-08-17T02:24:02.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.742+0000 7f5c4cc00640 1 --2- 172.21.15.2:0/563234555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c481589a0 0x7f5c4815ce80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5c4000c7f0 tx=0x7f5c400015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:02.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.742+0000 7f5c3f400640 1 -- 172.21.15.2:0/563234555 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4000a640 con 0x7f5c481589a0 2024-08-17T02:24:02.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.742+0000 7f5c3f400640 1 -- 172.21.15.2:0/563234555 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4000a7c0 con 0x7f5c481589a0 2024-08-17T02:24:02.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.742+0000 7f5c3f400640 1 -- 172.21.15.2:0/563234555 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4000ab80 con 0x7f5c481589a0 2024-08-17T02:24:02.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.742+0000 7f5c4ec00640 1 -- 172.21.15.2:0/563234555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c48169b20 con 0x7f5c481589a0 2024-08-17T02:24:02.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.742+0000 7f5c4ec00640 1 -- 172.21.15.2:0/563234555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c48153340 con 0x7f5c481589a0 2024-08-17T02:24:02.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.743+0000 7f5c4ec00640 1 -- 172.21.15.2:0/563234555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4815cb80 con 0x7f5c481589a0 2024-08-17T02:24:02.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.744+0000 7f5c3f400640 1 -- 172.21.15.2:0/563234555 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5c40003030 con 0x7f5c481589a0 2024-08-17T02:24:02.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.745+0000 7f5c3f400640 1 --2- 172.21.15.2:0/563234555 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5c28065150 0x7f5c28067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.745+0000 7f5c3f400640 1 -- 172.21.15.2:0/563234555 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5c40082340 con 0x7f5c481589a0 2024-08-17T02:24:02.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.745+0000 7f5c47e00640 1 --2- 172.21.15.2:0/563234555 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5c28065150 0x7f5c28067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.746+0000 7f5c47e00640 1 --2- 172.21.15.2:0/563234555 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5c28065150 0x7f5c28067600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5c38034000 tx=0x7f5c38032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:02.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.748+0000 7f5c3f400640 1 -- 172.21.15.2:0/563234555 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5c40050410 con 0x7f5c481589a0 2024-08-17T02:24:02.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.930+0000 7f5c4ec00640 1 -- 172.21.15.2:0/563234555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5c4815a4e0 con 0x7f5c481589a0 2024-08-17T02:24:02.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.930+0000 7f5c3f400640 1 -- 172.21.15.2:0/563234555 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5c4815a4e0 con 0x7f5c481589a0 2024-08-17T02:24:02.932 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:24:02.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.932+0000 7f5c4ec00640 1 -- 172.21.15.2:0/563234555 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5c28065150 msgr2=0x7f5c28067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.932+0000 7f5c4ec00640 1 --2- 172.21.15.2:0/563234555 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5c28065150 0x7f5c28067600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5c38034000 tx=0x7f5c38032000 comp rx=0 tx=0).stop 2024-08-17T02:24:02.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.932+0000 7f5c4ec00640 1 -- 172.21.15.2:0/563234555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c481589a0 msgr2=0x7f5c4815ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.932+0000 7f5c4ec00640 1 --2- 172.21.15.2:0/563234555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c481589a0 0x7f5c4815ce80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5c4000c7f0 tx=0x7f5c400015f0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.932+0000 7f5c4ec00640 1 -- 172.21.15.2:0/563234555 shutdown_connections 2024-08-17T02:24:02.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.932+0000 7f5c4ec00640 1 --2- 172.21.15.2:0/563234555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c481589a0 0x7f5c4815ce80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.932+0000 7f5c4ec00640 1 --2- 172.21.15.2:0/563234555 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5c28065150 0x7f5c28067600 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.932+0000 7f5c4ec00640 1 --2- 172.21.15.2:0/563234555 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c480afca0 0x7f5c48168f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.932+0000 7f5c4ec00640 1 --2- 172.21.15.2:0/563234555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c480acf10 0x7f5c48152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.932+0000 7f5c4ec00640 1 -- 172.21.15.2:0/563234555 >> 172.21.15.2:0/563234555 conn(0x7f5c48066e60 msgr2=0x7f5c480cb700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:02.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.933+0000 7f5c4ec00640 1 -- 172.21.15.2:0/563234555 shutdown_connections 2024-08-17T02:24:02.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:02.933+0000 7f5c4ec00640 1 -- 172.21.15.2:0/563234555 wait complete. 2024-08-17T02:24:02.949 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:24:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.103+0000 7f7a52c00640 1 Processor -- start 2024-08-17T02:24:03.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.103+0000 7f7a52c00640 1 -- start start 2024-08-17T02:24:03.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.104+0000 7f7a52c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a4c0ad960 0x7f7a4c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.104+0000 7f7a52c00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7a4c0add30 0x7f7a4c156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.104+0000 7f7a52c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4c15b5e0 con 0x7f7a4c0ca050 2024-08-17T02:24:03.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.104+0000 7f7a52c00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4c0cb160 con 0x7f7a4c0add30 2024-08-17T02:24:03.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.104+0000 7f7a52c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c0b0d10 con 0x7f7a4c0ad960 2024-08-17T02:24:03.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.105+0000 7f7a43e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7a4c0ca050 0x7f7a4c156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59046/0 (socket says 172.21.15.2:59046) 2024-08-17T02:24:03.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.105+0000 7f7a43e00640 1 -- 172.21.15.2:0/465326892 learned_addr learned my addr 172.21.15.2:0/465326892 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:03.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.105+0000 7f7a4be00640 1 --2- 172.21.15.2:0/465326892 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a4c0ad960 0x7f7a4c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.105+0000 7f7a50c00640 1 --2- 172.21.15.2:0/465326892 >> v2:172.21.15.145:3300/0 conn(0x7f7a4c0add30 0x7f7a4c156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.105+0000 7f7a4b400640 1 -- 172.21.15.2:0/465326892 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2772034791 0 0) 0x7f7a34001110 con 0x7f7a4c0ca050 2024-08-17T02:24:03.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.105+0000 7f7a4b400640 1 -- 172.21.15.2:0/465326892 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a300034e0 con 0x7f7a4c0ca050 2024-08-17T02:24:03.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.106+0000 7f7a4b400640 1 -- 172.21.15.2:0/465326892 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2374646168 0 0) 0x7f7a300034e0 con 0x7f7a4c0ca050 2024-08-17T02:24:03.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.106+0000 7f7a4be00640 1 -- 172.21.15.2:0/465326892 >> v2:172.21.15.145:3300/0 conn(0x7f7a4c0add30 msgr2=0x7f7a4c156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:03.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.106+0000 7f7a4be00640 1 --2- 172.21.15.2:0/465326892 >> v2:172.21.15.145:3300/0 conn(0x7f7a4c0add30 0x7f7a4c156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.106+0000 7f7a4be00640 1 -- 172.21.15.2:0/465326892 >> v1:172.21.15.2:6789/0 conn(0x7f7a4c0ca050 legacy=0x7f7a4c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.106+0000 7f7a4be00640 1 -- 172.21.15.2:0/465326892 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c0ca550 con 0x7f7a4c0ad960 2024-08-17T02:24:03.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.106+0000 7f7a50c00640 1 --2- 172.21.15.2:0/465326892 >> v2:172.21.15.145:3300/0 conn(0x7f7a4c0add30 0x7f7a4c156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:03.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.107+0000 7f7a4be00640 1 --2- 172.21.15.2:0/465326892 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a4c0ad960 0x7f7a4c15b0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009850 tx=0x7f7a3c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea1dd2fb6f99717b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:03.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.107+0000 7f7a4b400640 1 -- 172.21.15.2:0/465326892 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34001600 con 0x7f7a4c0ad960 2024-08-17T02:24:03.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.107+0000 7f7a4b400640 1 -- 172.21.15.2:0/465326892 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3c02aae0 con 0x7f7a4c0ad960 2024-08-17T02:24:03.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.107+0000 7f7a4b400640 1 -- 172.21.15.2:0/465326892 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c02ae80 con 0x7f7a4c0ad960 2024-08-17T02:24:03.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.108+0000 7f7a52c00640 1 -- 172.21.15.2:0/465326892 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a4c0ad960 msgr2=0x7f7a4c15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.108+0000 7f7a52c00640 1 --2- 172.21.15.2:0/465326892 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a4c0ad960 0x7f7a4c15b0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009850 tx=0x7f7a3c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.108+0000 7f7a52c00640 1 -- 172.21.15.2:0/465326892 shutdown_connections 2024-08-17T02:24:03.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.108+0000 7f7a52c00640 1 --2- 172.21.15.2:0/465326892 >> v2:172.21.15.145:3300/0 conn(0x7f7a4c0add30 0x7f7a4c156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.108+0000 7f7a52c00640 1 --2- 172.21.15.2:0/465326892 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a4c0ad960 0x7f7a4c15b0a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.108+0000 7f7a52c00640 1 -- 172.21.15.2:0/465326892 >> 172.21.15.2:0/465326892 conn(0x7f7a4c066e60 msgr2=0x7f7a4c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:03.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.108+0000 7f7a52c00640 1 -- 172.21.15.2:0/465326892 shutdown_connections 2024-08-17T02:24:03.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.108+0000 7f7a52c00640 1 -- 172.21.15.2:0/465326892 wait complete. 2024-08-17T02:24:03.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.109+0000 7f7a52c00640 1 Processor -- start 2024-08-17T02:24:03.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.110+0000 7f7a52c00640 1 -- start start 2024-08-17T02:24:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.110+0000 7f7a52c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a4c0ad960 0x7f7a4c157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.110+0000 7f7a52c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a4c0add30 0x7f7a4c159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.111+0000 7f7a52c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a4c0ca050 0x7f7a4c152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.111+0000 7f7a52c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c1584d0 con 0x7f7a4c0ca050 2024-08-17T02:24:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.111+0000 7f7a52c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c158000 con 0x7f7a4c0ad960 2024-08-17T02:24:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.111+0000 7f7a52c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c167030 con 0x7f7a4c0add30 2024-08-17T02:24:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.111+0000 7f7a50c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a4c0ca050 0x7f7a4c152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.111+0000 7f7a50c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a4c0ca050 0x7f7a4c152060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44408/0 (socket says 172.21.15.2:44408) 2024-08-17T02:24:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.111+0000 7f7a50c00640 1 -- 172.21.15.2:0/762841026 learned_addr learned my addr 172.21.15.2:0/762841026 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:03.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.111+0000 7f7a50c00640 1 -- 172.21.15.2:0/762841026 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a4c0add30 msgr2=0x7f7a4c159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.111+0000 7f7a50c00640 1 --2- 172.21.15.2:0/762841026 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a4c0add30 0x7f7a4c159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.111+0000 7f7a4be00640 1 --2- 172.21.15.2:0/762841026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a4c0ad960 0x7f7a4c157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.111+0000 7f7a50c00640 1 -- 172.21.15.2:0/762841026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a4c0ad960 msgr2=0x7f7a4c157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.111+0000 7f7a50c00640 1 --2- 172.21.15.2:0/762841026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a4c0ad960 0x7f7a4c157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.111+0000 7f7a50c00640 1 -- 172.21.15.2:0/762841026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a44009a20 con 0x7f7a4c0ca050 2024-08-17T02:24:03.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.111+0000 7f7a4be00640 1 --2- 172.21.15.2:0/762841026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a4c0ad960 0x7f7a4c157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:03.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.112+0000 7f7a50c00640 1 --2- 172.21.15.2:0/762841026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a4c0ca050 0x7f7a4c152060 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7a44009fc0 tx=0x7f7a4400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:03.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.112+0000 7f7a43400640 1 -- 172.21.15.2:0/762841026 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4400ce70 con 0x7f7a4c0ca050 2024-08-17T02:24:03.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.112+0000 7f7a43400640 1 -- 172.21.15.2:0/762841026 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4400f040 con 0x7f7a4c0ca050 2024-08-17T02:24:03.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.112+0000 7f7a43400640 1 -- 172.21.15.2:0/762841026 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a440146d0 con 0x7f7a4c0ca050 2024-08-17T02:24:03.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.112+0000 7f7a52c00640 1 -- 172.21.15.2:0/762841026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a3c009390 con 0x7f7a4c0ca050 2024-08-17T02:24:03.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.112+0000 7f7a52c00640 1 -- 172.21.15.2:0/762841026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a4c167590 con 0x7f7a4c0ca050 2024-08-17T02:24:03.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.113+0000 7f7a52c00640 1 -- 172.21.15.2:0/762841026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4c063fb0 con 0x7f7a4c0ca050 2024-08-17T02:24:03.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.114+0000 7f7a43400640 1 -- 172.21.15.2:0/762841026 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7a44003020 con 0x7f7a4c0ca050 2024-08-17T02:24:03.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.115+0000 7f7a43400640 1 --2- 172.21.15.2:0/762841026 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7a28065150 0x7f7a28067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.115+0000 7f7a43400640 1 -- 172.21.15.2:0/762841026 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7a44082ff0 con 0x7f7a4c0ca050 2024-08-17T02:24:03.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.115+0000 7f7a4be00640 1 --2- 172.21.15.2:0/762841026 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7a28065150 0x7f7a28067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.116+0000 7f7a4be00640 1 --2- 172.21.15.2:0/762841026 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7a28065150 0x7f7a28067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c034000 tx=0x7f7a3c032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:03.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.119+0000 7f7a43400640 1 -- 172.21.15.2:0/762841026 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7a44051030 con 0x7f7a4c0ca050 2024-08-17T02:24:03.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.302+0000 7f7a52c00640 1 -- 172.21.15.2:0/762841026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7a4c156440 con 0x7f7a4c0ca050 2024-08-17T02:24:03.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.303+0000 7f7a43400640 1 -- 172.21.15.2:0/762841026 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7a44054650 con 0x7f7a4c0ca050 2024-08-17T02:24:03.304 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-08-17T02:24:03.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.305+0000 7f7a52c00640 1 -- 172.21.15.2:0/762841026 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7a28065150 msgr2=0x7f7a28067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.305+0000 7f7a52c00640 1 --2- 172.21.15.2:0/762841026 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7a28065150 0x7f7a28067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c034000 tx=0x7f7a3c032000 comp rx=0 tx=0).stop 2024-08-17T02:24:03.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.305+0000 7f7a52c00640 1 -- 172.21.15.2:0/762841026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a4c0ca050 msgr2=0x7f7a4c152060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.305+0000 7f7a52c00640 1 --2- 172.21.15.2:0/762841026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a4c0ca050 0x7f7a4c152060 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7a44009fc0 tx=0x7f7a4400b040 comp rx=0 tx=0).stop 2024-08-17T02:24:03.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.305+0000 7f7a52c00640 1 -- 172.21.15.2:0/762841026 shutdown_connections 2024-08-17T02:24:03.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.305+0000 7f7a52c00640 1 --2- 172.21.15.2:0/762841026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a4c0ca050 0x7f7a4c152060 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.305+0000 7f7a52c00640 1 --2- 172.21.15.2:0/762841026 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7a28065150 0x7f7a28067600 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.305+0000 7f7a52c00640 1 --2- 172.21.15.2:0/762841026 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a4c0add30 0x7f7a4c159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.305+0000 7f7a52c00640 1 --2- 172.21.15.2:0/762841026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a4c0ad960 0x7f7a4c157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.305+0000 7f7a52c00640 1 -- 172.21.15.2:0/762841026 >> 172.21.15.2:0/762841026 conn(0x7f7a4c066e60 msgr2=0x7f7a4c154bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:03.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.305+0000 7f7a52c00640 1 -- 172.21.15.2:0/762841026 shutdown_connections 2024-08-17T02:24:03.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.305+0000 7f7a52c00640 1 -- 172.21.15.2:0/762841026 wait complete. 2024-08-17T02:24:03.321 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:03.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.471+0000 7fc813e00640 1 Processor -- start 2024-08-17T02:24:03.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.472+0000 7fc813e00640 1 -- start start 2024-08-17T02:24:03.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.473+0000 7fc813e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8140ad790 0x7fc8140adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.473+0000 7fc813e00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc8141559e0 0x7fc8140ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.473+0000 7fc813e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8140ca6b0 con 0x7fc8140c9d20 2024-08-17T02:24:03.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.473+0000 7fc813e00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8140cb180 con 0x7fc8141559e0 2024-08-17T02:24:03.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.473+0000 7fc813e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8140af530 con 0x7fc8140ad790 2024-08-17T02:24:03.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.473+0000 7fc80be00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc8140c9d20 0x7fc8141552d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59056/0 (socket says 172.21.15.2:59056) 2024-08-17T02:24:03.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.473+0000 7fc80be00640 1 -- 172.21.15.2:0/580284890 learned_addr learned my addr 172.21.15.2:0/580284890 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:03.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.473+0000 7fc812a00640 1 --2- 172.21.15.2:0/580284890 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8140ad790 0x7fc8140adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.473+0000 7fc813400640 1 --2- 172.21.15.2:0/580284890 >> v2:172.21.15.145:3300/0 conn(0x7fc8141559e0 0x7fc8140ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.474+0000 7fc812000640 1 -- 172.21.15.2:0/580284890 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537482618 0 0) 0x7fc8140ca6b0 con 0x7fc8140c9d20 2024-08-17T02:24:03.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.474+0000 7fc812000640 1 -- 172.21.15.2:0/580284890 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7f80034e0 con 0x7fc8140c9d20 2024-08-17T02:24:03.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.474+0000 7fc812000640 1 -- 172.21.15.2:0/580284890 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1189561498 0 0) 0x7fc7f80034e0 con 0x7fc8140c9d20 2024-08-17T02:24:03.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.474+0000 7fc812a00640 1 -- 172.21.15.2:0/580284890 >> v2:172.21.15.145:3300/0 conn(0x7fc8141559e0 msgr2=0x7fc8140ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:03.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.474+0000 7fc812a00640 1 --2- 172.21.15.2:0/580284890 >> v2:172.21.15.145:3300/0 conn(0x7fc8141559e0 0x7fc8140ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.474+0000 7fc812a00640 1 -- 172.21.15.2:0/580284890 >> v1:172.21.15.2:6789/0 conn(0x7fc8140c9d20 legacy=0x7fc8141552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.474+0000 7fc812a00640 1 -- 172.21.15.2:0/580284890 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8140ca8e0 con 0x7fc8140ad790 2024-08-17T02:24:03.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.475+0000 7fc812a00640 1 --2- 172.21.15.2:0/580284890 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8140ad790 0x7fc8140adb60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc804009850 tx=0x7fc8040090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c17ae2c2cf926aac server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:03.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.476+0000 7fc812000640 1 -- 172.21.15.2:0/580284890 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc001470 con 0x7fc8140ad790 2024-08-17T02:24:03.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.476+0000 7fc812000640 1 -- 172.21.15.2:0/580284890 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80402a9b0 con 0x7fc8140ad790 2024-08-17T02:24:03.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.476+0000 7fc812000640 1 -- 172.21.15.2:0/580284890 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80402ad50 con 0x7fc8140ad790 2024-08-17T02:24:03.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.476+0000 7fc813e00640 1 -- 172.21.15.2:0/580284890 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8140ad790 msgr2=0x7fc8140adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.476+0000 7fc813e00640 1 --2- 172.21.15.2:0/580284890 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8140ad790 0x7fc8140adb60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc804009850 tx=0x7fc8040090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.476+0000 7fc813e00640 1 -- 172.21.15.2:0/580284890 shutdown_connections 2024-08-17T02:24:03.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.476+0000 7fc813e00640 1 --2- 172.21.15.2:0/580284890 >> v2:172.21.15.145:3300/0 conn(0x7fc8141559e0 0x7fc8140ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.476+0000 7fc813e00640 1 --2- 172.21.15.2:0/580284890 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8140ad790 0x7fc8140adb60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.476+0000 7fc813e00640 1 -- 172.21.15.2:0/580284890 >> 172.21.15.2:0/580284890 conn(0x7fc814062af0 msgr2=0x7fc814062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:03.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.476+0000 7fc813e00640 1 -- 172.21.15.2:0/580284890 shutdown_connections 2024-08-17T02:24:03.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.476+0000 7fc813e00640 1 -- 172.21.15.2:0/580284890 wait complete. 2024-08-17T02:24:03.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.478+0000 7fc813e00640 1 Processor -- start 2024-08-17T02:24:03.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.478+0000 7fc813e00640 1 -- start start 2024-08-17T02:24:03.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.479+0000 7fc813e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8140ad790 0x7fc814158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.479+0000 7fc813e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8140c9d20 0x7fc814153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.479+0000 7fc813e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8141559e0 0x7fc814157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.479+0000 7fc813e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc814153850 con 0x7fc8140c9d20 2024-08-17T02:24:03.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.479+0000 7fc813e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc814157980 con 0x7fc8141559e0 2024-08-17T02:24:03.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.479+0000 7fc813e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc814157c40 con 0x7fc8140ad790 2024-08-17T02:24:03.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.479+0000 7fc80be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8140c9d20 0x7fc814153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.479+0000 7fc80be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8140c9d20 0x7fc814153310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44410/0 (socket says 172.21.15.2:44410) 2024-08-17T02:24:03.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.479+0000 7fc80be00640 1 -- 172.21.15.2:0/4164571204 learned_addr learned my addr 172.21.15.2:0/4164571204 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:03.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.479+0000 7fc813400640 1 --2- 172.21.15.2:0/4164571204 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8141559e0 0x7fc814157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.479+0000 7fc812a00640 1 --2- 172.21.15.2:0/4164571204 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8140ad790 0x7fc814158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.479+0000 7fc80be00640 1 -- 172.21.15.2:0/4164571204 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8140ad790 msgr2=0x7fc814158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.479+0000 7fc80be00640 1 --2- 172.21.15.2:0/4164571204 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8140ad790 0x7fc814158ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.479+0000 7fc80be00640 1 -- 172.21.15.2:0/4164571204 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8141559e0 msgr2=0x7fc814157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.479+0000 7fc80be00640 1 --2- 172.21.15.2:0/4164571204 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8141559e0 0x7fc814157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.479+0000 7fc80be00640 1 -- 172.21.15.2:0/4164571204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc804009390 con 0x7fc8140c9d20 2024-08-17T02:24:03.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.479+0000 7fc812a00640 1 --2- 172.21.15.2:0/4164571204 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8140ad790 0x7fc814158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:03.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.480+0000 7fc80be00640 1 --2- 172.21.15.2:0/4164571204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8140c9d20 0x7fc814153310 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00cb90 tx=0x7fc7fc001bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:03.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.480+0000 7fc80a000640 1 -- 172.21.15.2:0/4164571204 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc007360 con 0x7fc8140c9d20 2024-08-17T02:24:03.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.480+0000 7fc80a000640 1 -- 172.21.15.2:0/4164571204 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7fc0074e0 con 0x7fc8140c9d20 2024-08-17T02:24:03.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.480+0000 7fc80a000640 1 -- 172.21.15.2:0/4164571204 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc0049f0 con 0x7fc8140c9d20 2024-08-17T02:24:03.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.480+0000 7fc813e00640 1 -- 172.21.15.2:0/4164571204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc814157f20 con 0x7fc8140c9d20 2024-08-17T02:24:03.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.480+0000 7fc813e00640 1 -- 172.21.15.2:0/4164571204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8141584e0 con 0x7fc8140c9d20 2024-08-17T02:24:03.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.481+0000 7fc813e00640 1 -- 172.21.15.2:0/4164571204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc814070720 con 0x7fc8140c9d20 2024-08-17T02:24:03.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.482+0000 7fc80a000640 1 -- 172.21.15.2:0/4164571204 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc7fc00a640 con 0x7fc8140c9d20 2024-08-17T02:24:03.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.483+0000 7fc80a000640 1 --2- 172.21.15.2:0/4164571204 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc7f0065150 0x7fc7f0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.483+0000 7fc80a000640 1 -- 172.21.15.2:0/4164571204 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc7fc081b30 con 0x7fc8140c9d20 2024-08-17T02:24:03.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.484+0000 7fc812a00640 1 --2- 172.21.15.2:0/4164571204 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc7f0065150 0x7fc7f0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.484+0000 7fc812a00640 1 --2- 172.21.15.2:0/4164571204 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc7f0065150 0x7fc7f0067600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc804034000 tx=0x7fc804032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:03.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.488+0000 7fc80a000640 1 -- 172.21.15.2:0/4164571204 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc7fc04fb50 con 0x7fc8140c9d20 2024-08-17T02:24:03.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.672+0000 7fc813e00640 1 -- 172.21.15.2:0/4164571204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc81415e780 con 0x7fc8140c9d20 2024-08-17T02:24:03.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.673+0000 7fc80a000640 1 -- 172.21.15.2:0/4164571204 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fc7fc018070 con 0x7fc8140c9d20 2024-08-17T02:24:03.675 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:24:03.675 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:23:32.955197+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:29.708835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:30.361908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.676+0000 7fc813e00640 1 -- 172.21.15.2:0/4164571204 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc7f0065150 msgr2=0x7fc7f0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.676+0000 7fc813e00640 1 --2- 172.21.15.2:0/4164571204 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc7f0065150 0x7fc7f0067600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc804034000 tx=0x7fc804032000 comp rx=0 tx=0).stop 2024-08-17T02:24:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.676+0000 7fc813e00640 1 -- 172.21.15.2:0/4164571204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8140c9d20 msgr2=0x7fc814153310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.676+0000 7fc813e00640 1 --2- 172.21.15.2:0/4164571204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8140c9d20 0x7fc814153310 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00cb90 tx=0x7fc7fc001bd0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.676+0000 7fc813e00640 1 -- 172.21.15.2:0/4164571204 shutdown_connections 2024-08-17T02:24:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.676+0000 7fc813e00640 1 --2- 172.21.15.2:0/4164571204 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8141559e0 0x7fc814157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.676+0000 7fc813e00640 1 --2- 172.21.15.2:0/4164571204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8140c9d20 0x7fc814153310 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.676+0000 7fc813e00640 1 --2- 172.21.15.2:0/4164571204 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc7f0065150 0x7fc7f0067600 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.676+0000 7fc813e00640 1 --2- 172.21.15.2:0/4164571204 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8140ad790 0x7fc814158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.676+0000 7fc813e00640 1 -- 172.21.15.2:0/4164571204 >> 172.21.15.2:0/4164571204 conn(0x7fc814062af0 msgr2=0x7fc8140afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.676+0000 7fc813e00640 1 -- 172.21.15.2:0/4164571204 shutdown_connections 2024-08-17T02:24:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.676+0000 7fc813e00640 1 -- 172.21.15.2:0/4164571204 wait complete. 2024-08-17T02:24:03.692 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:23:26.107978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:23:29.708835+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:23:30.361908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:24:03.693 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:24:03.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.846+0000 7fdd39400640 1 Processor -- start 2024-08-17T02:24:03.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.846+0000 7fdd39400640 1 -- start start 2024-08-17T02:24:03.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.847+0000 7fdd39400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdd34158e60 0x7fdd340add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.847+0000 7fdd39400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fdd340b0ac0 0x7fdd340ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.847+0000 7fdd39400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd340ad8a0 con 0x7fdd340ae860 2024-08-17T02:24:03.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.847+0000 7fdd39400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd3406edf0 con 0x7fdd34158e60 2024-08-17T02:24:03.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.847+0000 7fdd39400640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd340acc90 con 0x7fdd340b0ac0 2024-08-17T02:24:03.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.847+0000 7fdd32800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdd34158e60 0x7fdd340add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.848+0000 7fdd32800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdd34158e60 0x7fdd340add30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44418/0 (socket says 172.21.15.2:44418) 2024-08-17T02:24:03.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.848+0000 7fdd32800640 1 -- 172.21.15.2:0/4102248248 learned_addr learned my addr 172.21.15.2:0/4102248248 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:03.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.848+0000 7fdd33200640 1 --2- 172.21.15.2:0/4102248248 >> v2:172.21.15.145:3300/0 conn(0x7fdd340b0ac0 0x7fdd340ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.848+0000 7fdd32800640 1 -- 172.21.15.2:0/4102248248 >> v2:172.21.15.145:3300/0 conn(0x7fdd340b0ac0 msgr2=0x7fdd340ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:03.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.848+0000 7fdd32800640 1 --2- 172.21.15.2:0/4102248248 >> v2:172.21.15.145:3300/0 conn(0x7fdd340b0ac0 0x7fdd340ac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.848+0000 7fdd32800640 1 -- 172.21.15.2:0/4102248248 >> v1:172.21.15.2:6789/0 conn(0x7fdd340ae860 legacy=0x7fdd340b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.848+0000 7fdd32800640 1 -- 172.21.15.2:0/4102248248 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd340acf70 con 0x7fdd34158e60 2024-08-17T02:24:03.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.849+0000 7fdd32800640 1 --2- 172.21.15.2:0/4102248248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd34158e60 0x7fdd340add30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdd340c80c0 tx=0x7fdd240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95f8bb57a1f0e4d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:03.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.849+0000 7fdd31400640 1 -- 172.21.15.2:0/4102248248 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2402ae80 con 0x7fdd34158e60 2024-08-17T02:24:03.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.849+0000 7fdd31400640 1 -- 172.21.15.2:0/4102248248 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd24032440 con 0x7fdd34158e60 2024-08-17T02:24:03.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.849+0000 7fdd31400640 1 -- 172.21.15.2:0/4102248248 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd24032800 con 0x7fdd34158e60 2024-08-17T02:24:03.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.850+0000 7fdd39400640 1 -- 172.21.15.2:0/4102248248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd34158e60 msgr2=0x7fdd340add30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.850+0000 7fdd39400640 1 --2- 172.21.15.2:0/4102248248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd34158e60 0x7fdd340add30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdd340c80c0 tx=0x7fdd240091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.850+0000 7fdd39400640 1 -- 172.21.15.2:0/4102248248 shutdown_connections 2024-08-17T02:24:03.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.850+0000 7fdd39400640 1 --2- 172.21.15.2:0/4102248248 >> v2:172.21.15.145:3300/0 conn(0x7fdd340b0ac0 0x7fdd340ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.850+0000 7fdd39400640 1 --2- 172.21.15.2:0/4102248248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd34158e60 0x7fdd340add30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.850+0000 7fdd39400640 1 -- 172.21.15.2:0/4102248248 >> 172.21.15.2:0/4102248248 conn(0x7fdd340cc390 msgr2=0x7fdd34066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:03.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.850+0000 7fdd39400640 1 -- 172.21.15.2:0/4102248248 shutdown_connections 2024-08-17T02:24:03.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.850+0000 7fdd39400640 1 -- 172.21.15.2:0/4102248248 wait complete. 2024-08-17T02:24:03.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.851+0000 7fdd39400640 1 Processor -- start 2024-08-17T02:24:03.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.852+0000 7fdd39400640 1 -- start start 2024-08-17T02:24:03.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.852+0000 7fdd39400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd340ae860 0x7fdd34146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.852+0000 7fdd39400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd340b0ac0 0x7fdd34156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.852+0000 7fdd39400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd34158e60 0x7fdd340c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.852+0000 7fdd39400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd340ca770 con 0x7fdd340ae860 2024-08-17T02:24:03.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.852+0000 7fdd39400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd340ca470 con 0x7fdd34158e60 2024-08-17T02:24:03.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.852+0000 7fdd39400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd341474f0 con 0x7fdd340b0ac0 2024-08-17T02:24:03.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.853+0000 7fdd32800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd340ae860 0x7fdd34146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.853+0000 7fdd32800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd340ae860 0x7fdd34146ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44428/0 (socket says 172.21.15.2:44428) 2024-08-17T02:24:03.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.853+0000 7fdd32800640 1 -- 172.21.15.2:0/8017288 learned_addr learned my addr 172.21.15.2:0/8017288 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:03.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.853+0000 7fdd31e00640 1 --2- 172.21.15.2:0/8017288 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd340b0ac0 0x7fdd34156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.853+0000 7fdd33200640 1 --2- 172.21.15.2:0/8017288 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd34158e60 0x7fdd340c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.853+0000 7fdd32800640 1 -- 172.21.15.2:0/8017288 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd340b0ac0 msgr2=0x7fdd34156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.853+0000 7fdd32800640 1 --2- 172.21.15.2:0/8017288 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd340b0ac0 0x7fdd34156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.853+0000 7fdd32800640 1 -- 172.21.15.2:0/8017288 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd34158e60 msgr2=0x7fdd340c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.853+0000 7fdd32800640 1 --2- 172.21.15.2:0/8017288 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd34158e60 0x7fdd340c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.853+0000 7fdd32800640 1 -- 172.21.15.2:0/8017288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd24009450 con 0x7fdd340ae860 2024-08-17T02:24:03.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.853+0000 7fdd31e00640 1 --2- 172.21.15.2:0/8017288 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd340b0ac0 0x7fdd34156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:03.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.853+0000 7fdd33200640 1 --2- 172.21.15.2:0/8017288 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd34158e60 0x7fdd340c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:03.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.853+0000 7fdd32800640 1 --2- 172.21.15.2:0/8017288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd340ae860 0x7fdd34146ca0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdd24009210 tx=0x7fdd24032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:03.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.854+0000 7fdd2a000640 1 -- 172.21.15.2:0/8017288 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd24031bb0 con 0x7fdd340ae860 2024-08-17T02:24:03.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.854+0000 7fdd2a000640 1 -- 172.21.15.2:0/8017288 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd24031d30 con 0x7fdd340ae860 2024-08-17T02:24:03.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.854+0000 7fdd2a000640 1 -- 172.21.15.2:0/8017288 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2403d670 con 0x7fdd340ae860 2024-08-17T02:24:03.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.854+0000 7fdd39400640 1 -- 172.21.15.2:0/8017288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd341477d0 con 0x7fdd340ae860 2024-08-17T02:24:03.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.854+0000 7fdd39400640 1 -- 172.21.15.2:0/8017288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd34147ab0 con 0x7fdd340ae860 2024-08-17T02:24:03.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.855+0000 7fdd39400640 1 -- 172.21.15.2:0/8017288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd34063fb0 con 0x7fdd340ae860 2024-08-17T02:24:03.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.856+0000 7fdd2a000640 1 -- 172.21.15.2:0/8017288 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdd24039040 con 0x7fdd340ae860 2024-08-17T02:24:03.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.856+0000 7fdd2a000640 1 --2- 172.21.15.2:0/8017288 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fdd14065180 0x7fdd14067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.857+0000 7fdd2a000640 1 -- 172.21.15.2:0/8017288 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdd240a2340 con 0x7fdd340ae860 2024-08-17T02:24:03.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.857+0000 7fdd31e00640 1 --2- 172.21.15.2:0/8017288 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fdd14065180 0x7fdd14067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.858+0000 7fdd31e00640 1 --2- 172.21.15.2:0/8017288 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fdd14065180 0x7fdd14067630 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdd34157d00 tx=0x7fdd20009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:03.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:03.861+0000 7fdd2a000640 1 -- 172.21.15.2:0/8017288 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdd24070360 con 0x7fdd340ae860 2024-08-17T02:24:04.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.045+0000 7fdd39400640 1 -- 172.21.15.2:0/8017288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdd34068940 con 0x7fdd340ae860 2024-08-17T02:24:04.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.045+0000 7fdd2a000640 1 -- 172.21.15.2:0/8017288 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdd24073980 con 0x7fdd340ae860 2024-08-17T02:24:04.047 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-17T02:24:04.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.048+0000 7fdd39400640 1 -- 172.21.15.2:0/8017288 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fdd14065180 msgr2=0x7fdd14067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.048+0000 7fdd39400640 1 --2- 172.21.15.2:0/8017288 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fdd14065180 0x7fdd14067630 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdd34157d00 tx=0x7fdd20009040 comp rx=0 tx=0).stop 2024-08-17T02:24:04.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.048+0000 7fdd39400640 1 -- 172.21.15.2:0/8017288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd340ae860 msgr2=0x7fdd34146ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.048+0000 7fdd39400640 1 --2- 172.21.15.2:0/8017288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd340ae860 0x7fdd34146ca0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdd24009210 tx=0x7fdd24032000 comp rx=0 tx=0).stop 2024-08-17T02:24:04.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.048+0000 7fdd39400640 1 -- 172.21.15.2:0/8017288 shutdown_connections 2024-08-17T02:24:04.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.048+0000 7fdd39400640 1 --2- 172.21.15.2:0/8017288 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd34158e60 0x7fdd340c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.048+0000 7fdd39400640 1 --2- 172.21.15.2:0/8017288 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fdd14065180 0x7fdd14067630 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.048+0000 7fdd39400640 1 --2- 172.21.15.2:0/8017288 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd340b0ac0 0x7fdd34156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.048+0000 7fdd39400640 1 --2- 172.21.15.2:0/8017288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd340ae860 0x7fdd34146ca0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.048+0000 7fdd39400640 1 -- 172.21.15.2:0/8017288 >> 172.21.15.2:0/8017288 conn(0x7fdd340cc390 msgr2=0x7fdd3406ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:04.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.048+0000 7fdd39400640 1 -- 172.21.15.2:0/8017288 shutdown_connections 2024-08-17T02:24:04.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.048+0000 7fdd39400640 1 -- 172.21.15.2:0/8017288 wait complete. 2024-08-17T02:24:04.065 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:24:04.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.220+0000 7f2b8ce00640 1 Processor -- start 2024-08-17T02:24:04.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.220+0000 7f2b8ce00640 1 -- start start 2024-08-17T02:24:04.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.221+0000 7f2b8ce00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2b880ad960 0x7f2b8815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.221+0000 7f2b8ce00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2b880add30 0x7f2b88156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.221+0000 7f2b8ce00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8815b5e0 con 0x7f2b880ca050 2024-08-17T02:24:04.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.221+0000 7f2b8ce00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b880cb160 con 0x7f2b880add30 2024-08-17T02:24:04.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.221+0000 7f2b8ce00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b880b0d10 con 0x7f2b880ad960 2024-08-17T02:24:04.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.222+0000 7f2b86800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2b880add30 0x7f2b88156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.222+0000 7f2b86800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2b880add30 0x7f2b88156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44440/0 (socket says 172.21.15.2:44440) 2024-08-17T02:24:04.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.222+0000 7f2b86800640 1 -- 172.21.15.2:0/4287636234 learned_addr learned my addr 172.21.15.2:0/4287636234 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:04.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.222+0000 7f2b85e00640 1 --2- 172.21.15.2:0/4287636234 >> v2:172.21.15.145:3300/0 conn(0x7f2b880ad960 0x7f2b8815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.222+0000 7f2b86800640 1 -- 172.21.15.2:0/4287636234 >> v2:172.21.15.145:3300/0 conn(0x7f2b880ad960 msgr2=0x7f2b8815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:04.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.222+0000 7f2b86800640 1 --2- 172.21.15.2:0/4287636234 >> v2:172.21.15.145:3300/0 conn(0x7f2b880ad960 0x7f2b8815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.222+0000 7f2b86800640 1 -- 172.21.15.2:0/4287636234 >> v1:172.21.15.2:6789/0 conn(0x7f2b880ca050 legacy=0x7f2b88156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.222+0000 7f2b86800640 1 -- 172.21.15.2:0/4287636234 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b880ca550 con 0x7f2b880add30 2024-08-17T02:24:04.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.223+0000 7f2b86800640 1 --2- 172.21.15.2:0/4287636234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b880add30 0x7f2b88156b30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2b880cc910 tx=0x7f2b80009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a1546c14d5c8960 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:04.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.224+0000 7f2b84a00640 1 -- 172.21.15.2:0/4287636234 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80032470 con 0x7f2b880add30 2024-08-17T02:24:04.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.224+0000 7f2b84a00640 1 -- 172.21.15.2:0/4287636234 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b800325d0 con 0x7f2b880add30 2024-08-17T02:24:04.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.224+0000 7f2b84a00640 1 -- 172.21.15.2:0/4287636234 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b800329b0 con 0x7f2b880add30 2024-08-17T02:24:04.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.224+0000 7f2b8ce00640 1 -- 172.21.15.2:0/4287636234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b880add30 msgr2=0x7f2b88156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.224+0000 7f2b8ce00640 1 --2- 172.21.15.2:0/4287636234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b880add30 0x7f2b88156b30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2b880cc910 tx=0x7f2b80009840 comp rx=0 tx=0).stop 2024-08-17T02:24:04.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.224+0000 7f2b8ce00640 1 -- 172.21.15.2:0/4287636234 shutdown_connections 2024-08-17T02:24:04.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.224+0000 7f2b8ce00640 1 --2- 172.21.15.2:0/4287636234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b880add30 0x7f2b88156b30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.224+0000 7f2b8ce00640 1 --2- 172.21.15.2:0/4287636234 >> v2:172.21.15.145:3300/0 conn(0x7f2b880ad960 0x7f2b8815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.224+0000 7f2b8ce00640 1 -- 172.21.15.2:0/4287636234 >> 172.21.15.2:0/4287636234 conn(0x7f2b88066e60 msgr2=0x7f2b88067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:04.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.224+0000 7f2b8ce00640 1 -- 172.21.15.2:0/4287636234 shutdown_connections 2024-08-17T02:24:04.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.224+0000 7f2b8ce00640 1 -- 172.21.15.2:0/4287636234 wait complete. 2024-08-17T02:24:04.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.226+0000 7f2b8ce00640 1 Processor -- start 2024-08-17T02:24:04.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.226+0000 7f2b8ce00640 1 -- start start 2024-08-17T02:24:04.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.227+0000 7f2b8ce00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b880ad960 0x7f2b88169390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.227+0000 7f2b8ce00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2b880add30 0x7f2b8815ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.227+0000 7f2b8ce00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2b880ca050 0x7f2b880ac850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.227+0000 7f2b8ce00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b88157230 con 0x7f2b880ad960 2024-08-17T02:24:04.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.227+0000 7f2b8ce00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8815d230 con 0x7f2b880add30 2024-08-17T02:24:04.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.227+0000 7f2b8ce00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b881699e0 con 0x7f2b880ca050 2024-08-17T02:24:04.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.227+0000 7f2b85e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b880ad960 0x7f2b88169390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.227+0000 7f2b85e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b880ad960 0x7f2b88169390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44452/0 (socket says 172.21.15.2:44452) 2024-08-17T02:24:04.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.227+0000 7f2b85e00640 1 -- 172.21.15.2:0/1150949469 learned_addr learned my addr 172.21.15.2:0/1150949469 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:04.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.227+0000 7f2b86800640 1 --2- 172.21.15.2:0/1150949469 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2b880ca050 0x7f2b880ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.227+0000 7f2b85400640 1 --2- 172.21.15.2:0/1150949469 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2b880add30 0x7f2b8815ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.227+0000 7f2b85e00640 1 -- 172.21.15.2:0/1150949469 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2b880ca050 msgr2=0x7f2b880ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.227+0000 7f2b85e00640 1 --2- 172.21.15.2:0/1150949469 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2b880ca050 0x7f2b880ac850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.227+0000 7f2b85e00640 1 -- 172.21.15.2:0/1150949469 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2b880add30 msgr2=0x7f2b8815ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.227+0000 7f2b85e00640 1 --2- 172.21.15.2:0/1150949469 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2b880add30 0x7f2b8815ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.227+0000 7f2b85e00640 1 -- 172.21.15.2:0/1150949469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b80009ae0 con 0x7f2b880ad960 2024-08-17T02:24:04.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.227+0000 7f2b86800640 1 --2- 172.21.15.2:0/1150949469 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2b880ca050 0x7f2b880ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:04.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.228+0000 7f2b85e00640 1 --2- 172.21.15.2:0/1150949469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b880ad960 0x7f2b88169390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800d890 tx=0x7f2b78008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:04.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.228+0000 7f2b7d600640 1 -- 172.21.15.2:0/1150949469 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7800de20 con 0x7f2b880ad960 2024-08-17T02:24:04.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.228+0000 7f2b7d600640 1 -- 172.21.15.2:0/1150949469 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b780098b0 con 0x7f2b880ad960 2024-08-17T02:24:04.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.228+0000 7f2b8ce00640 1 -- 172.21.15.2:0/1150949469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b88169cc0 con 0x7f2b880ad960 2024-08-17T02:24:04.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.228+0000 7f2b7d600640 1 -- 172.21.15.2:0/1150949469 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b78009c50 con 0x7f2b880ad960 2024-08-17T02:24:04.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.228+0000 7f2b8ce00640 1 -- 172.21.15.2:0/1150949469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8816a300 con 0x7f2b880ad960 2024-08-17T02:24:04.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.229+0000 7f2b8ce00640 1 -- 172.21.15.2:0/1150949469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b880ace50 con 0x7f2b880ad960 2024-08-17T02:24:04.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.230+0000 7f2b7d600640 1 -- 172.21.15.2:0/1150949469 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2b78014620 con 0x7f2b880ad960 2024-08-17T02:24:04.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.231+0000 7f2b7d600640 1 --2- 172.21.15.2:0/1150949469 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2b68065150 0x7f2b68067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.231+0000 7f2b7d600640 1 -- 172.21.15.2:0/1150949469 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2b78082cf0 con 0x7f2b880ad960 2024-08-17T02:24:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.231+0000 7f2b85400640 1 --2- 172.21.15.2:0/1150949469 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2b68065150 0x7f2b68067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.232+0000 7f2b85400640 1 --2- 172.21.15.2:0/1150949469 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2b68065150 0x7f2b68067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2b88158aa0 tx=0x7f2b74009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:04.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.235+0000 7f2b7d600640 1 -- 172.21.15.2:0/1150949469 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2b78050dc0 con 0x7f2b880ad960 2024-08-17T02:24:04.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.419+0000 7f2b8ce00640 1 -- 172.21.15.2:0/1150949469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2b88063fb0 con 0x7f2b880ad960 2024-08-17T02:24:04.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.420+0000 7f2b7d600640 1 -- 172.21.15.2:0/1150949469 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2b78009db0 con 0x7f2b880ad960 2024-08-17T02:24:04.421 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:24:04.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.422+0000 7f2b8ce00640 1 -- 172.21.15.2:0/1150949469 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2b68065150 msgr2=0x7f2b68067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.422+0000 7f2b8ce00640 1 --2- 172.21.15.2:0/1150949469 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2b68065150 0x7f2b68067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2b88158aa0 tx=0x7f2b74009040 comp rx=0 tx=0).stop 2024-08-17T02:24:04.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.422+0000 7f2b8ce00640 1 -- 172.21.15.2:0/1150949469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b880ad960 msgr2=0x7f2b88169390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.422+0000 7f2b8ce00640 1 --2- 172.21.15.2:0/1150949469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b880ad960 0x7f2b88169390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800d890 tx=0x7f2b78008040 comp rx=0 tx=0).stop 2024-08-17T02:24:04.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.422+0000 7f2b8ce00640 1 -- 172.21.15.2:0/1150949469 shutdown_connections 2024-08-17T02:24:04.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.422+0000 7f2b8ce00640 1 --2- 172.21.15.2:0/1150949469 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2b68065150 0x7f2b68067600 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.422+0000 7f2b8ce00640 1 --2- 172.21.15.2:0/1150949469 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2b880ca050 0x7f2b880ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.422+0000 7f2b8ce00640 1 --2- 172.21.15.2:0/1150949469 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2b880add30 0x7f2b8815ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.422+0000 7f2b8ce00640 1 --2- 172.21.15.2:0/1150949469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b880ad960 0x7f2b88169390 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.422+0000 7f2b8ce00640 1 -- 172.21.15.2:0/1150949469 >> 172.21.15.2:0/1150949469 conn(0x7f2b88066e60 msgr2=0x7f2b8806dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:04.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.422+0000 7f2b8ce00640 1 -- 172.21.15.2:0/1150949469 shutdown_connections 2024-08-17T02:24:04.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.422+0000 7f2b8ce00640 1 -- 172.21.15.2:0/1150949469 wait complete. 2024-08-17T02:24:04.439 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:24:04.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.594+0000 7f41d3400640 1 Processor -- start 2024-08-17T02:24:04.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.594+0000 7f41d3400640 1 -- start start 2024-08-17T02:24:04.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.595+0000 7f41d3400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41cc158c60 0x7f41cc0b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.595+0000 7f41d3400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f41cc0cc450 0x7f41cc0b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.595+0000 7f41d3400640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41cc0b2ae0 con 0x7f41cc159030 2024-08-17T02:24:04.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.595+0000 7f41d3400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41cc0b2dc0 con 0x7f41cc0cc450 2024-08-17T02:24:04.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.595+0000 7f41d3400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc0b25f0 con 0x7f41cc158c60 2024-08-17T02:24:04.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.595+0000 7f41d1400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f41cc0cc450 0x7f41cc0b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.595+0000 7f41d1400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f41cc0cc450 0x7f41cc0b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44464/0 (socket says 172.21.15.2:44464) 2024-08-17T02:24:04.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.595+0000 7f41d1400640 1 -- 172.21.15.2:0/1496667219 learned_addr learned my addr 172.21.15.2:0/1496667219 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:04.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.596+0000 7f41d1400640 1 -- 172.21.15.2:0/1496667219 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41cc158c60 msgr2=0x7f41cc0b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:04.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.596+0000 7f41d1400640 1 --2- 172.21.15.2:0/1496667219 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41cc158c60 0x7f41cc0b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.596+0000 7f41d1400640 1 -- 172.21.15.2:0/1496667219 >> v1:172.21.15.145:6789/0 conn(0x7f41cc159030 legacy=0x7f41cc0cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:04.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.596+0000 7f41d1400640 1 -- 172.21.15.2:0/1496667219 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc0cca80 con 0x7f41cc0cc450 2024-08-17T02:24:04.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.597+0000 7f41d1400640 1 --2- 172.21.15.2:0/1496667219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41cc0cc450 0x7f41cc0b20b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009f20 tx=0x7f41c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea09803483785a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.597+0000 7f41cb400640 1 -- 172.21.15.2:0/1496667219 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c4031400 con 0x7f41cc0cc450 2024-08-17T02:24:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.597+0000 7f41cb400640 1 -- 172.21.15.2:0/1496667219 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c402d050 con 0x7f41cc0cc450 2024-08-17T02:24:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.597+0000 7f41cb400640 1 -- 172.21.15.2:0/1496667219 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c40317d0 con 0x7f41cc0cc450 2024-08-17T02:24:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.597+0000 7f41d3400640 1 -- 172.21.15.2:0/1496667219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41cc0cc450 msgr2=0x7f41cc0b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.597+0000 7f41d3400640 1 --2- 172.21.15.2:0/1496667219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41cc0cc450 0x7f41cc0b20b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009f20 tx=0x7f41c4009840 comp rx=0 tx=0).stop 2024-08-17T02:24:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.597+0000 7f41d3400640 1 -- 172.21.15.2:0/1496667219 shutdown_connections 2024-08-17T02:24:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.597+0000 7f41d3400640 1 --2- 172.21.15.2:0/1496667219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41cc0cc450 0x7f41cc0b20b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.597+0000 7f41d3400640 1 --2- 172.21.15.2:0/1496667219 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41cc158c60 0x7f41cc0b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.598+0000 7f41d3400640 1 -- 172.21.15.2:0/1496667219 >> 172.21.15.2:0/1496667219 conn(0x7f41cc06e590 msgr2=0x7f41cc06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.598+0000 7f41d3400640 1 -- 172.21.15.2:0/1496667219 shutdown_connections 2024-08-17T02:24:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.598+0000 7f41d3400640 1 -- 172.21.15.2:0/1496667219 wait complete. 2024-08-17T02:24:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.599+0000 7f41d3400640 1 Processor -- start 2024-08-17T02:24:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.599+0000 7f41d3400640 1 -- start start 2024-08-17T02:24:04.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.600+0000 7f41d3400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41cc0cc450 0x7f41cc1697b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.600+0000 7f41d3400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41cc158c60 0x7f41cc1480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.600+0000 7f41d3400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41cc159030 0x7f41cc156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.600+0000 7f41d3400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc169cf0 con 0x7f41cc158c60 2024-08-17T02:24:04.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.600+0000 7f41d3400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc0ca100 con 0x7f41cc0cc450 2024-08-17T02:24:04.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.600+0000 7f41d3400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc0cfa30 con 0x7f41cc159030 2024-08-17T02:24:04.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.600+0000 7f41cbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41cc158c60 0x7f41cc1480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.600+0000 7f41d1400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41cc159030 0x7f41cc156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.600+0000 7f41cbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41cc158c60 0x7f41cc1480a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44476/0 (socket says 172.21.15.2:44476) 2024-08-17T02:24:04.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.600+0000 7f41cbe00640 1 -- 172.21.15.2:0/3549285491 learned_addr learned my addr 172.21.15.2:0/3549285491 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:04.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.600+0000 7f41d0a00640 1 --2- 172.21.15.2:0/3549285491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41cc0cc450 0x7f41cc1697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.601+0000 7f41cbe00640 1 -- 172.21.15.2:0/3549285491 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41cc159030 msgr2=0x7f41cc156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.601+0000 7f41cbe00640 1 --2- 172.21.15.2:0/3549285491 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41cc159030 0x7f41cc156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.601+0000 7f41cbe00640 1 -- 172.21.15.2:0/3549285491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41cc0cc450 msgr2=0x7f41cc1697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.601+0000 7f41cbe00640 1 --2- 172.21.15.2:0/3549285491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41cc0cc450 0x7f41cc1697b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.601+0000 7f41cbe00640 1 -- 172.21.15.2:0/3549285491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c4009ae0 con 0x7f41cc158c60 2024-08-17T02:24:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.601+0000 7f41d1400640 1 --2- 172.21.15.2:0/3549285491 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41cc159030 0x7f41cc156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.601+0000 7f41cbe00640 1 --2- 172.21.15.2:0/3549285491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41cc158c60 0x7f41cc1480a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f41b800b5e0 tx=0x7f41b80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.601+0000 7f41bfe00640 1 -- 172.21.15.2:0/3549285491 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b800f590 con 0x7f41cc158c60 2024-08-17T02:24:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.601+0000 7f41bfe00640 1 -- 172.21.15.2:0/3549285491 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b800f710 con 0x7f41cc158c60 2024-08-17T02:24:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.601+0000 7f41bfe00640 1 -- 172.21.15.2:0/3549285491 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b800fad0 con 0x7f41cc158c60 2024-08-17T02:24:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.601+0000 7f41d3400640 1 -- 172.21.15.2:0/3549285491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41cc0cfd10 con 0x7f41cc158c60 2024-08-17T02:24:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.602+0000 7f41d3400640 1 -- 172.21.15.2:0/3549285491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41cc0d02d0 con 0x7f41cc158c60 2024-08-17T02:24:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.603+0000 7f41d3400640 1 -- 172.21.15.2:0/3549285491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41cc0d04f0 con 0x7f41cc158c60 2024-08-17T02:24:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.603+0000 7f41bfe00640 1 -- 172.21.15.2:0/3549285491 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f41b801a460 con 0x7f41cc158c60 2024-08-17T02:24:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.604+0000 7f41bfe00640 1 --2- 172.21.15.2:0/3549285491 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f41ac065150 0x7f41ac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.604+0000 7f41bfe00640 1 -- 172.21.15.2:0/3549285491 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f41b8081fb0 con 0x7f41cc158c60 2024-08-17T02:24:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.605+0000 7f41d0a00640 1 --2- 172.21.15.2:0/3549285491 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f41ac065150 0x7f41ac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.605+0000 7f41d0a00640 1 --2- 172.21.15.2:0/3549285491 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f41ac065150 0x7f41ac067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009ab0 tx=0x7f41c0009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:04.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.608+0000 7f41bfe00640 1 -- 172.21.15.2:0/3549285491 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f41b8050100 con 0x7f41cc158c60 2024-08-17T02:24:04.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.787+0000 7f41d3400640 1 -- 172.21.15.2:0/3549285491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f41cc063fb0 con 0x7f41cc158c60 2024-08-17T02:24:04.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.787+0000 7f41bfe00640 1 -- 172.21.15.2:0/3549285491 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f41b8053720 con 0x7f41cc158c60 2024-08-17T02:24:04.789 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-08-17T02:24:04.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.789+0000 7f41d3400640 1 -- 172.21.15.2:0/3549285491 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f41ac065150 msgr2=0x7f41ac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.789+0000 7f41d3400640 1 --2- 172.21.15.2:0/3549285491 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f41ac065150 0x7f41ac067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009ab0 tx=0x7f41c0009060 comp rx=0 tx=0).stop 2024-08-17T02:24:04.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.789+0000 7f41d3400640 1 -- 172.21.15.2:0/3549285491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41cc158c60 msgr2=0x7f41cc1480a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.789+0000 7f41d3400640 1 --2- 172.21.15.2:0/3549285491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41cc158c60 0x7f41cc1480a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f41b800b5e0 tx=0x7f41b80090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.789+0000 7f41d3400640 1 -- 172.21.15.2:0/3549285491 shutdown_connections 2024-08-17T02:24:04.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.789+0000 7f41d3400640 1 --2- 172.21.15.2:0/3549285491 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f41ac065150 0x7f41ac067600 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.789+0000 7f41d3400640 1 --2- 172.21.15.2:0/3549285491 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41cc159030 0x7f41cc156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.789+0000 7f41d3400640 1 --2- 172.21.15.2:0/3549285491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41cc158c60 0x7f41cc1480a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.789+0000 7f41d3400640 1 --2- 172.21.15.2:0/3549285491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41cc0cc450 0x7f41cc1697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.789+0000 7f41d3400640 1 -- 172.21.15.2:0/3549285491 >> 172.21.15.2:0/3549285491 conn(0x7f41cc06e590 msgr2=0x7f41cc0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:04.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.790+0000 7f41d3400640 1 -- 172.21.15.2:0/3549285491 shutdown_connections 2024-08-17T02:24:04.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:04.790+0000 7f41d3400640 1 -- 172.21.15.2:0/3549285491 wait complete. 2024-08-17T02:24:04.877 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2024-08-17T02:24:04.877 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:24:04.878 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:05.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.029+0000 7fd9be000640 1 Processor -- start 2024-08-17T02:24:05.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.029+0000 7fd9be000640 1 -- start start 2024-08-17T02:24:05.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.030+0000 7fd9be000640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd9b80afca0 0x7fd9b80b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.030+0000 7fd9be000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd9b81590b0 0x7fd9b8159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.030+0000 7fd9be000640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b815a4e0 con 0x7fd9b80acf10 2024-08-17T02:24:05.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.030+0000 7fd9be000640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b80b0980 con 0x7fd9b80afca0 2024-08-17T02:24:05.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.030+0000 7fd9be000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b80c92b0 con 0x7fd9b81590b0 2024-08-17T02:24:05.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.031+0000 7fd9b7e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd9b81590b0 0x7fd9b8159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.031+0000 7fd9b7400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd9b80afca0 0x7fd9b80b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.031+0000 7fd9b7400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd9b80afca0 0x7fd9b80b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:59510/0 (socket says 172.21.15.2:59510) 2024-08-17T02:24:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.031+0000 7fd9b7e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd9b81590b0 0x7fd9b8159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:56012/0 (socket says 172.21.15.2:56012) 2024-08-17T02:24:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.031+0000 7fd9b7400640 1 -- 172.21.15.2:0/2637246385 learned_addr learned my addr 172.21.15.2:0/2637246385 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.031+0000 7fd9b7400640 1 -- 172.21.15.2:0/2637246385 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd9b81590b0 msgr2=0x7fd9b8159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.031+0000 7fd9b7400640 1 --2- 172.21.15.2:0/2637246385 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd9b81590b0 0x7fd9b8159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.031+0000 7fd9b7400640 1 -- 172.21.15.2:0/2637246385 >> v1:172.21.15.145:6789/0 conn(0x7fd9b80acf10 legacy=0x7fd9b81589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.031+0000 7fd9b7400640 1 -- 172.21.15.2:0/2637246385 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b80ad480 con 0x7fd9b80afca0 2024-08-17T02:24:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.031+0000 7fd9b7e00640 1 --2- 172.21.15.2:0/2637246385 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd9b81590b0 0x7fd9b8159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:05.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.032+0000 7fd9b7400640 1 --2- 172.21.15.2:0/2637246385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9b80afca0 0x7fd9b80b0070 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8009910 tx=0x7fd9a80091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20f8eeffea427979 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:05.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.033+0000 7fd9b6000640 1 -- 172.21.15.2:0/2637246385 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a802ae40 con 0x7fd9b80afca0 2024-08-17T02:24:05.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.033+0000 7fd9b6000640 1 -- 172.21.15.2:0/2637246385 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a8032440 con 0x7fd9b80afca0 2024-08-17T02:24:05.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.033+0000 7fd9b6000640 1 -- 172.21.15.2:0/2637246385 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8032820 con 0x7fd9b80afca0 2024-08-17T02:24:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.033+0000 7fd9be000640 1 -- 172.21.15.2:0/2637246385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9b80afca0 msgr2=0x7fd9b80b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.033+0000 7fd9be000640 1 --2- 172.21.15.2:0/2637246385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9b80afca0 0x7fd9b80b0070 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8009910 tx=0x7fd9a80091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.033+0000 7fd9be000640 1 -- 172.21.15.2:0/2637246385 shutdown_connections 2024-08-17T02:24:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.033+0000 7fd9be000640 1 --2- 172.21.15.2:0/2637246385 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd9b81590b0 0x7fd9b8159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.033+0000 7fd9be000640 1 --2- 172.21.15.2:0/2637246385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9b80afca0 0x7fd9b80b0070 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.033+0000 7fd9be000640 1 -- 172.21.15.2:0/2637246385 >> 172.21.15.2:0/2637246385 conn(0x7fd9b8066e60 msgr2=0x7fd9b8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.033+0000 7fd9be000640 1 -- 172.21.15.2:0/2637246385 shutdown_connections 2024-08-17T02:24:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.033+0000 7fd9be000640 1 -- 172.21.15.2:0/2637246385 wait complete. 2024-08-17T02:24:05.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.035+0000 7fd9be000640 1 Processor -- start 2024-08-17T02:24:05.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.035+0000 7fd9be000640 1 -- start start 2024-08-17T02:24:05.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.036+0000 7fd9be000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9b80acf10 0x7fd9b8140c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.036+0000 7fd9be000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd9b80afca0 0x7fd9b80c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.036+0000 7fd9be000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9b81590b0 0x7fd9b80c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.036+0000 7fd9be000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b80c5d40 con 0x7fd9b80acf10 2024-08-17T02:24:05.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.036+0000 7fd9be000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b80c25c0 con 0x7fd9b81590b0 2024-08-17T02:24:05.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.036+0000 7fd9be000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b80c33e0 con 0x7fd9b80afca0 2024-08-17T02:24:05.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.036+0000 7fd9b7400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9b80acf10 0x7fd9b8140c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.036+0000 7fd9b7400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9b80acf10 0x7fd9b8140c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48604/0 (socket says 172.21.15.2:48604) 2024-08-17T02:24:05.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.036+0000 7fd9b7400640 1 -- 172.21.15.2:0/2386996401 learned_addr learned my addr 172.21.15.2:0/2386996401 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:05.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.036+0000 7fd9b7e00640 1 --2- 172.21.15.2:0/2386996401 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9b81590b0 0x7fd9b80c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.036+0000 7fd9b6a00640 1 --2- 172.21.15.2:0/2386996401 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd9b80afca0 0x7fd9b80c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.037+0000 7fd9b7400640 1 -- 172.21.15.2:0/2386996401 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd9b80afca0 msgr2=0x7fd9b80c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.037+0000 7fd9b7400640 1 --2- 172.21.15.2:0/2386996401 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd9b80afca0 0x7fd9b80c52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.037+0000 7fd9b7400640 1 -- 172.21.15.2:0/2386996401 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9b81590b0 msgr2=0x7fd9b80c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.037+0000 7fd9b7400640 1 --2- 172.21.15.2:0/2386996401 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9b81590b0 0x7fd9b80c5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.037+0000 7fd9b7400640 1 -- 172.21.15.2:0/2386996401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b0009a20 con 0x7fd9b80acf10 2024-08-17T02:24:05.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.037+0000 7fd9b7400640 1 --2- 172.21.15.2:0/2386996401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9b80acf10 0x7fd9b8140c50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8009970 tx=0x7fd9a8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:05.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.037+0000 7fd9aea00640 1 -- 172.21.15.2:0/2386996401 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8031c80 con 0x7fd9b80acf10 2024-08-17T02:24:05.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.037+0000 7fd9aea00640 1 -- 172.21.15.2:0/2386996401 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a8031e00 con 0x7fd9b80acf10 2024-08-17T02:24:05.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.037+0000 7fd9aea00640 1 -- 172.21.15.2:0/2386996401 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a803d670 con 0x7fd9b80acf10 2024-08-17T02:24:05.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.037+0000 7fd9be000640 1 -- 172.21.15.2:0/2386996401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a8009450 con 0x7fd9b80acf10 2024-08-17T02:24:05.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.037+0000 7fd9be000640 1 -- 172.21.15.2:0/2386996401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b80c2d90 con 0x7fd9b80acf10 2024-08-17T02:24:05.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.038+0000 7fd9be000640 1 -- 172.21.15.2:0/2386996401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b80acd70 con 0x7fd9b80acf10 2024-08-17T02:24:05.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.039+0000 7fd9aea00640 1 -- 172.21.15.2:0/2386996401 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd9a8039040 con 0x7fd9b80acf10 2024-08-17T02:24:05.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.040+0000 7fd9aea00640 1 --2- 172.21.15.2:0/2386996401 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd998065150 0x7fd998067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.040+0000 7fd9aea00640 1 -- 172.21.15.2:0/2386996401 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd9a802ae40 con 0x7fd9b80acf10 2024-08-17T02:24:05.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.040+0000 7fd9b6a00640 1 --2- 172.21.15.2:0/2386996401 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd998065150 0x7fd998067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.041+0000 7fd9b6a00640 1 --2- 172.21.15.2:0/2386996401 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd998065150 0x7fd998067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd9b80ca720 tx=0x7fd9a4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:05.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.044+0000 7fd9aea00640 1 -- 172.21.15.2:0/2386996401 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd9b80acd70 con 0x7fd9b80acf10 2024-08-17T02:24:05.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.227+0000 7fd9be000640 1 -- 172.21.15.2:0/2386996401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9b80acd70 con 0x7fd9b80acf10 2024-08-17T02:24:05.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.228+0000 7fd9aea00640 1 -- 172.21.15.2:0/2386996401 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fd9b80acd70 con 0x7fd9b80acf10 2024-08-17T02:24:05.230 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:24:05.230 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:23:32.955197+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:29.708835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:30.361908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:05.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.230+0000 7fd9be000640 1 -- 172.21.15.2:0/2386996401 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd998065150 msgr2=0x7fd998067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.230+0000 7fd9be000640 1 --2- 172.21.15.2:0/2386996401 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd998065150 0x7fd998067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd9b80ca720 tx=0x7fd9a4009040 comp rx=0 tx=0).stop 2024-08-17T02:24:05.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.230+0000 7fd9be000640 1 -- 172.21.15.2:0/2386996401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9b80acf10 msgr2=0x7fd9b8140c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.231+0000 7fd9be000640 1 --2- 172.21.15.2:0/2386996401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9b80acf10 0x7fd9b8140c50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8009970 tx=0x7fd9a8032000 comp rx=0 tx=0).stop 2024-08-17T02:24:05.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.231+0000 7fd9be000640 1 -- 172.21.15.2:0/2386996401 shutdown_connections 2024-08-17T02:24:05.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.231+0000 7fd9be000640 1 --2- 172.21.15.2:0/2386996401 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9b81590b0 0x7fd9b80c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.231+0000 7fd9be000640 1 --2- 172.21.15.2:0/2386996401 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd998065150 0x7fd998067600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.231+0000 7fd9be000640 1 --2- 172.21.15.2:0/2386996401 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd9b80afca0 0x7fd9b80c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.231+0000 7fd9be000640 1 --2- 172.21.15.2:0/2386996401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9b80acf10 0x7fd9b8140c50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.231+0000 7fd9be000640 1 -- 172.21.15.2:0/2386996401 >> 172.21.15.2:0/2386996401 conn(0x7fd9b8066e60 msgr2=0x7fd9b8155500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:05.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.231+0000 7fd9be000640 1 -- 172.21.15.2:0/2386996401 shutdown_connections 2024-08-17T02:24:05.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.231+0000 7fd9be000640 1 -- 172.21.15.2:0/2386996401 wait complete. 2024-08-17T02:24:05.248 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:23:26.107978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:23:29.708835+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:23:30.361908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:24:05.248 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:24:05.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.402+0000 7f603f800640 1 Processor -- start 2024-08-17T02:24:05.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.402+0000 7f603f800640 1 -- start start 2024-08-17T02:24:05.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.403+0000 7f603f800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60380b0920 0x7f60380b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.403+0000 7f603f800640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6038160d40 0x7f6038163120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.403+0000 7f603f800640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60380b12b0 con 0x7f6038159220 2024-08-17T02:24:05.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.403+0000 7f603f800640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6038069b30 con 0x7f6038160d40 2024-08-17T02:24:05.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.403+0000 7f603f800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603809a2d0 con 0x7f60380b0920 2024-08-17T02:24:05.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.404+0000 7f603d800640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6038160d40 0x7f6038163120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.404+0000 7f603d800640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6038160d40 0x7f6038163120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:59532/0 (socket says 172.21.15.2:59532) 2024-08-17T02:24:05.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.404+0000 7f603d800640 1 -- 172.21.15.2:0/1199753420 learned_addr learned my addr 172.21.15.2:0/1199753420 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:05.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.404+0000 7f6037e00640 1 --2- 172.21.15.2:0/1199753420 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60380b0920 0x7f60380b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.404+0000 7f6037e00640 1 -- 172.21.15.2:0/1199753420 >> v2:172.21.15.145:3300/0 conn(0x7f6038160d40 msgr2=0x7f6038163120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:05.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.404+0000 7f6037e00640 1 --2- 172.21.15.2:0/1199753420 >> v2:172.21.15.145:3300/0 conn(0x7f6038160d40 0x7f6038163120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.404+0000 7f6037e00640 1 -- 172.21.15.2:0/1199753420 >> v1:172.21.15.145:6789/0 conn(0x7f6038159220 legacy=0x7f6038068930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.405+0000 7f6037e00640 1 -- 172.21.15.2:0/1199753420 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60381595f0 con 0x7f60380b0920 2024-08-17T02:24:05.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.405+0000 7f603d800640 1 --2- 172.21.15.2:0/1199753420 >> v2:172.21.15.145:3300/0 conn(0x7f6038160d40 0x7f6038163120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:05.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.405+0000 7f6037400640 1 -- 172.21.15.2:0/1199753420 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 45473043 0 0) 0x7f60380b12b0 con 0x7f6038159220 2024-08-17T02:24:05.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.406+0000 7f6037e00640 1 --2- 172.21.15.2:0/1199753420 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60380b0920 0x7f60380b0d70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6024009850 tx=0x7f60240090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f872e5409c96664 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:05.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.406+0000 7f6037400640 1 -- 172.21.15.2:0/1199753420 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602402ad90 con 0x7f60380b0920 2024-08-17T02:24:05.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.406+0000 7f6037400640 1 -- 172.21.15.2:0/1199753420 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6024032440 con 0x7f60380b0920 2024-08-17T02:24:05.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.406+0000 7f6037400640 1 -- 172.21.15.2:0/1199753420 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60240327e0 con 0x7f60380b0920 2024-08-17T02:24:05.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.406+0000 7f603f800640 1 -- 172.21.15.2:0/1199753420 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60380b0920 msgr2=0x7f60380b0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.406+0000 7f603f800640 1 --2- 172.21.15.2:0/1199753420 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60380b0920 0x7f60380b0d70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6024009850 tx=0x7f60240090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.407+0000 7f603f800640 1 -- 172.21.15.2:0/1199753420 shutdown_connections 2024-08-17T02:24:05.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.407+0000 7f603f800640 1 --2- 172.21.15.2:0/1199753420 >> v2:172.21.15.145:3300/0 conn(0x7f6038160d40 0x7f6038163120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.407+0000 7f603f800640 1 --2- 172.21.15.2:0/1199753420 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60380b0920 0x7f60380b0d70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.407+0000 7f603f800640 1 -- 172.21.15.2:0/1199753420 >> 172.21.15.2:0/1199753420 conn(0x7f6038066e60 msgr2=0x7f6038067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:05.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.407+0000 7f603f800640 1 -- 172.21.15.2:0/1199753420 shutdown_connections 2024-08-17T02:24:05.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.407+0000 7f603f800640 1 -- 172.21.15.2:0/1199753420 wait complete. 2024-08-17T02:24:05.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.408+0000 7f603f800640 1 Processor -- start 2024-08-17T02:24:05.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.408+0000 7f603f800640 1 -- start start 2024-08-17T02:24:05.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.409+0000 7f603f800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60380b0920 0x7f60380abe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.409+0000 7f603f800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6038159220 0x7f60380ad400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.409+0000 7f603f800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6038160d40 0x7f60380cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.409+0000 7f603f800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60380ac3b0 con 0x7f6038160d40 2024-08-17T02:24:05.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.409+0000 7f603f800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60380ad940 con 0x7f6038159220 2024-08-17T02:24:05.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.409+0000 7f603f800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60380adb50 con 0x7f60380b0920 2024-08-17T02:24:05.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.409+0000 7f603d800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6038160d40 0x7f60380cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.409+0000 7f603d800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6038160d40 0x7f60380cbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48610/0 (socket says 172.21.15.2:48610) 2024-08-17T02:24:05.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.409+0000 7f603d800640 1 -- 172.21.15.2:0/2908330315 learned_addr learned my addr 172.21.15.2:0/2908330315 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:05.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.409+0000 7f603ce00640 1 --2- 172.21.15.2:0/2908330315 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60380b0920 0x7f60380abe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.409+0000 7f6037e00640 1 --2- 172.21.15.2:0/2908330315 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6038159220 0x7f60380ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.410+0000 7f603d800640 1 -- 172.21.15.2:0/2908330315 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60380b0920 msgr2=0x7f60380abe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.410+0000 7f603d800640 1 --2- 172.21.15.2:0/2908330315 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60380b0920 0x7f60380abe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.410+0000 7f603d800640 1 -- 172.21.15.2:0/2908330315 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6038159220 msgr2=0x7f60380ad400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.410+0000 7f603d800640 1 --2- 172.21.15.2:0/2908330315 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6038159220 0x7f60380ad400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.410+0000 7f603d800640 1 -- 172.21.15.2:0/2908330315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6030009ae0 con 0x7f6038160d40 2024-08-17T02:24:05.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.410+0000 7f603d800640 1 --2- 172.21.15.2:0/2908330315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6038160d40 0x7f60380cbd90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6030009fb0 tx=0x7f603000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:05.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.410+0000 7f602be00640 1 -- 172.21.15.2:0/2908330315 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603000cc60 con 0x7f6038160d40 2024-08-17T02:24:05.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.410+0000 7f602be00640 1 -- 172.21.15.2:0/2908330315 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603000f040 con 0x7f6038160d40 2024-08-17T02:24:05.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.410+0000 7f602be00640 1 -- 172.21.15.2:0/2908330315 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030014480 con 0x7f6038160d40 2024-08-17T02:24:05.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.410+0000 7f603f800640 1 -- 172.21.15.2:0/2908330315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6024009390 con 0x7f6038160d40 2024-08-17T02:24:05.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.411+0000 7f603f800640 1 -- 172.21.15.2:0/2908330315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60380ae110 con 0x7f6038160d40 2024-08-17T02:24:05.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.412+0000 7f603f800640 1 -- 172.21.15.2:0/2908330315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6038155180 con 0x7f6038160d40 2024-08-17T02:24:05.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.412+0000 7f602be00640 1 -- 172.21.15.2:0/2908330315 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f60300147f0 con 0x7f6038160d40 2024-08-17T02:24:05.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.413+0000 7f602be00640 1 --2- 172.21.15.2:0/2908330315 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6018065150 0x7f6018067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.413+0000 7f602be00640 1 -- 172.21.15.2:0/2908330315 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6030082b90 con 0x7f6038160d40 2024-08-17T02:24:05.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.414+0000 7f603ce00640 1 --2- 172.21.15.2:0/2908330315 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6018065150 0x7f6018067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.414+0000 7f603ce00640 1 --2- 172.21.15.2:0/2908330315 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6018065150 0x7f6018067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f602c0011e0 tx=0x7f602c007ca0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:05.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.417+0000 7f602be00640 1 -- 172.21.15.2:0/2908330315 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6038155180 con 0x7f6038160d40 2024-08-17T02:24:05.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.600+0000 7f603f800640 1 -- 172.21.15.2:0/2908330315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6038155180 con 0x7f6038160d40 2024-08-17T02:24:05.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.601+0000 7f602be00640 1 -- 172.21.15.2:0/2908330315 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6038155180 con 0x7f6038160d40 2024-08-17T02:24:05.602 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-17T02:24:05.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.603+0000 7f603f800640 1 -- 172.21.15.2:0/2908330315 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6018065150 msgr2=0x7f6018067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.603+0000 7f603f800640 1 --2- 172.21.15.2:0/2908330315 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6018065150 0x7f6018067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f602c0011e0 tx=0x7f602c007ca0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.603+0000 7f603f800640 1 -- 172.21.15.2:0/2908330315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6038160d40 msgr2=0x7f60380cbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.603+0000 7f603f800640 1 --2- 172.21.15.2:0/2908330315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6038160d40 0x7f60380cbd90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6030009fb0 tx=0x7f603000b040 comp rx=0 tx=0).stop 2024-08-17T02:24:05.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.603+0000 7f603f800640 1 -- 172.21.15.2:0/2908330315 shutdown_connections 2024-08-17T02:24:05.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.603+0000 7f603f800640 1 --2- 172.21.15.2:0/2908330315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6038160d40 0x7f60380cbd90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.603+0000 7f603f800640 1 --2- 172.21.15.2:0/2908330315 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6038159220 0x7f60380ad400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.603+0000 7f603f800640 1 --2- 172.21.15.2:0/2908330315 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6018065150 0x7f6018067600 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.603+0000 7f603f800640 1 --2- 172.21.15.2:0/2908330315 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60380b0920 0x7f60380abe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.603+0000 7f603f800640 1 -- 172.21.15.2:0/2908330315 >> 172.21.15.2:0/2908330315 conn(0x7f6038066e60 msgr2=0x7f6038068d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:05.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.603+0000 7f603f800640 1 -- 172.21.15.2:0/2908330315 shutdown_connections 2024-08-17T02:24:05.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.603+0000 7f603f800640 1 -- 172.21.15.2:0/2908330315 wait complete. 2024-08-17T02:24:05.619 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:24:05.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.772+0000 7f16aec00640 1 Processor -- start 2024-08-17T02:24:05.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.772+0000 7f16aec00640 1 -- start start 2024-08-17T02:24:05.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.774+0000 7f16aec00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f16a80ae7d0 0x7f16a80ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.774+0000 7f16aec00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f16a8156cd0 0x7f16a80adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.774+0000 7f16aec00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a80b08d0 con 0x7f16a8156900 2024-08-17T02:24:05.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.774+0000 7f16aec00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a80b0b10 con 0x7f16a80ae7d0 2024-08-17T02:24:05.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.774+0000 7f16aec00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a80b0df0 con 0x7f16a8156cd0 2024-08-17T02:24:05.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.774+0000 7f16ace00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f16a80ae7d0 0x7f16a80ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.774+0000 7f16ace00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f16a80ae7d0 0x7f16a80ada70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48626/0 (socket says 172.21.15.2:48626) 2024-08-17T02:24:05.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.774+0000 7f16ace00640 1 -- 172.21.15.2:0/2979091331 learned_addr learned my addr 172.21.15.2:0/2979091331 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:05.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.774+0000 7f16ae200640 1 --2- 172.21.15.2:0/2979091331 >> v2:172.21.15.145:3300/0 conn(0x7f16a8156cd0 0x7f16a80adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.775+0000 7f16ace00640 1 -- 172.21.15.2:0/2979091331 >> v2:172.21.15.145:3300/0 conn(0x7f16a8156cd0 msgr2=0x7f16a80adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:05.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.775+0000 7f16ace00640 1 --2- 172.21.15.2:0/2979091331 >> v2:172.21.15.145:3300/0 conn(0x7f16a8156cd0 0x7f16a80adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.775+0000 7f16ace00640 1 -- 172.21.15.2:0/2979091331 >> v1:172.21.15.2:6789/0 conn(0x7f16a8156900 legacy=0x7f16a80b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.775+0000 7f16ace00640 1 -- 172.21.15.2:0/2979091331 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a80b10d0 con 0x7f16a80ae7d0 2024-08-17T02:24:05.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.776+0000 7f16ace00640 1 --2- 172.21.15.2:0/2979091331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16a80ae7d0 0x7f16a80ada70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f16a80cb730 tx=0x7f16940091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43326427b5d27571 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:05.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.776+0000 7f16a7e00640 1 -- 172.21.15.2:0/2979091331 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169402ae80 con 0x7f16a80ae7d0 2024-08-17T02:24:05.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.776+0000 7f16a7e00640 1 -- 172.21.15.2:0/2979091331 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1694032440 con 0x7f16a80ae7d0 2024-08-17T02:24:05.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.776+0000 7f16a7e00640 1 -- 172.21.15.2:0/2979091331 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694032800 con 0x7f16a80ae7d0 2024-08-17T02:24:05.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.776+0000 7f16aec00640 1 -- 172.21.15.2:0/2979091331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16a80ae7d0 msgr2=0x7f16a80ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.776+0000 7f16aec00640 1 --2- 172.21.15.2:0/2979091331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16a80ae7d0 0x7f16a80ada70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f16a80cb730 tx=0x7f16940091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.777+0000 7f16aec00640 1 -- 172.21.15.2:0/2979091331 shutdown_connections 2024-08-17T02:24:05.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.777+0000 7f16aec00640 1 --2- 172.21.15.2:0/2979091331 >> v2:172.21.15.145:3300/0 conn(0x7f16a8156cd0 0x7f16a80adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.777+0000 7f16aec00640 1 --2- 172.21.15.2:0/2979091331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16a80ae7d0 0x7f16a80ada70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.777+0000 7f16aec00640 1 -- 172.21.15.2:0/2979091331 >> 172.21.15.2:0/2979091331 conn(0x7f16a8067930 msgr2=0x7f16a80cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:05.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.777+0000 7f16aec00640 1 -- 172.21.15.2:0/2979091331 shutdown_connections 2024-08-17T02:24:05.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.777+0000 7f16aec00640 1 -- 172.21.15.2:0/2979091331 wait complete. 2024-08-17T02:24:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.778+0000 7f16aec00640 1 Processor -- start 2024-08-17T02:24:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.778+0000 7f16aec00640 1 -- start start 2024-08-17T02:24:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.779+0000 7f16aec00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f16a80ae7d0 0x7f16a8154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.779+0000 7f16aec00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16a8156900 0x7f16a80a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.779+0000 7f16aec00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f16a8156cd0 0x7f16a80a8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.779+0000 7f16aec00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a80aa060 con 0x7f16a8156900 2024-08-17T02:24:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.779+0000 7f16aec00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a81699e0 con 0x7f16a8156cd0 2024-08-17T02:24:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.779+0000 7f16aec00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a80a9450 con 0x7f16a80ae7d0 2024-08-17T02:24:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.779+0000 7f16ace00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16a8156900 0x7f16a80a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.780+0000 7f16ace00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16a8156900 0x7f16a80a88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48636/0 (socket says 172.21.15.2:48636) 2024-08-17T02:24:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.780+0000 7f16ace00640 1 -- 172.21.15.2:0/1448704379 learned_addr learned my addr 172.21.15.2:0/1448704379 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.780+0000 7f16ad800640 1 --2- 172.21.15.2:0/1448704379 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f16a80ae7d0 0x7f16a8154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.780+0000 7f16ae200640 1 --2- 172.21.15.2:0/1448704379 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f16a8156cd0 0x7f16a80a8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.780+0000 7f16ace00640 1 -- 172.21.15.2:0/1448704379 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f16a80ae7d0 msgr2=0x7f16a8154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.780+0000 7f16ace00640 1 --2- 172.21.15.2:0/1448704379 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f16a80ae7d0 0x7f16a8154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.780+0000 7f16ace00640 1 -- 172.21.15.2:0/1448704379 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f16a8156cd0 msgr2=0x7f16a80a8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.780+0000 7f16ace00640 1 --2- 172.21.15.2:0/1448704379 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f16a8156cd0 0x7f16a80a8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.780+0000 7f16ace00640 1 -- 172.21.15.2:0/1448704379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1694009450 con 0x7f16a8156900 2024-08-17T02:24:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.780+0000 7f16ace00640 1 --2- 172.21.15.2:0/1448704379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16a8156900 0x7f16a80a88e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1694009210 tx=0x7f1694032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.781+0000 7f16a4c00640 1 -- 172.21.15.2:0/1448704379 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694031c80 con 0x7f16a8156900 2024-08-17T02:24:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.781+0000 7f16a4c00640 1 -- 172.21.15.2:0/1448704379 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1694031e00 con 0x7f16a8156900 2024-08-17T02:24:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.781+0000 7f16a4c00640 1 -- 172.21.15.2:0/1448704379 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169403d670 con 0x7f16a8156900 2024-08-17T02:24:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.781+0000 7f16aec00640 1 -- 172.21.15.2:0/1448704379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a80a9730 con 0x7f16a8156900 2024-08-17T02:24:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.781+0000 7f16aec00640 1 -- 172.21.15.2:0/1448704379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a80a9cf0 con 0x7f16a8156900 2024-08-17T02:24:05.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.782+0000 7f16aec00640 1 -- 172.21.15.2:0/1448704379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a80aa210 con 0x7f16a8156900 2024-08-17T02:24:05.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.783+0000 7f16a4c00640 1 -- 172.21.15.2:0/1448704379 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1694039040 con 0x7f16a8156900 2024-08-17T02:24:05.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.783+0000 7f16a4c00640 1 --2- 172.21.15.2:0/1448704379 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1688065150 0x7f1688067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.784+0000 7f16a4c00640 1 -- 172.21.15.2:0/1448704379 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f16940a2300 con 0x7f16a8156900 2024-08-17T02:24:05.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.784+0000 7f16ad800640 1 --2- 172.21.15.2:0/1448704379 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1688065150 0x7f1688067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.785+0000 7f16ad800640 1 --2- 172.21.15.2:0/1448704379 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1688065150 0x7f1688067600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f169c007fd0 tx=0x7f169c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:05.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.787+0000 7f16a4c00640 1 -- 172.21.15.2:0/1448704379 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f16940703d0 con 0x7f16a8156900 2024-08-17T02:24:05.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.968+0000 7f16aec00640 1 -- 172.21.15.2:0/1448704379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16a8070720 con 0x7f16a8156900 2024-08-17T02:24:05.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.968+0000 7f16a4c00640 1 -- 172.21.15.2:0/1448704379 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f16940739f0 con 0x7f16a8156900 2024-08-17T02:24:05.970 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:24:05.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.970+0000 7f16aec00640 1 -- 172.21.15.2:0/1448704379 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1688065150 msgr2=0x7f1688067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.970+0000 7f16aec00640 1 --2- 172.21.15.2:0/1448704379 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1688065150 0x7f1688067600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f169c007fd0 tx=0x7f169c009040 comp rx=0 tx=0).stop 2024-08-17T02:24:05.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.970+0000 7f16aec00640 1 -- 172.21.15.2:0/1448704379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16a8156900 msgr2=0x7f16a80a88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.970+0000 7f16aec00640 1 --2- 172.21.15.2:0/1448704379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16a8156900 0x7f16a80a88e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1694009210 tx=0x7f1694032000 comp rx=0 tx=0).stop 2024-08-17T02:24:05.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.970+0000 7f16aec00640 1 -- 172.21.15.2:0/1448704379 shutdown_connections 2024-08-17T02:24:05.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.970+0000 7f16aec00640 1 --2- 172.21.15.2:0/1448704379 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f16a8156cd0 0x7f16a80a8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.970+0000 7f16aec00640 1 --2- 172.21.15.2:0/1448704379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16a8156900 0x7f16a80a88e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.970+0000 7f16aec00640 1 --2- 172.21.15.2:0/1448704379 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1688065150 0x7f1688067600 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.970+0000 7f16aec00640 1 --2- 172.21.15.2:0/1448704379 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f16a80ae7d0 0x7f16a8154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.970+0000 7f16aec00640 1 -- 172.21.15.2:0/1448704379 >> 172.21.15.2:0/1448704379 conn(0x7f16a8067930 msgr2=0x7f16a8157190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:05.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.970+0000 7f16aec00640 1 -- 172.21.15.2:0/1448704379 shutdown_connections 2024-08-17T02:24:05.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:05.970+0000 7f16aec00640 1 -- 172.21.15.2:0/1448704379 wait complete. 2024-08-17T02:24:05.986 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:24:06.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.139+0000 7f0dd0a00640 1 Processor -- start 2024-08-17T02:24:06.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.139+0000 7f0dd0a00640 1 -- start start 2024-08-17T02:24:06.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.140+0000 7f0dd0a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0dcc0afca0 0x7f0dcc0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.141+0000 7f0dd0a00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f0dcc0acf10 0x7f0dcc159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.141+0000 7f0dd0a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dcc15a4e0 con 0x7f0dcc1589a0 2024-08-17T02:24:06.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.141+0000 7f0dd0a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dcc0b0980 con 0x7f0dcc0afca0 2024-08-17T02:24:06.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.141+0000 7f0dd0a00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dcc0c92b0 con 0x7f0dcc0acf10 2024-08-17T02:24:06.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.141+0000 7f0dc9e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0dcc0afca0 0x7f0dcc0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.141+0000 7f0dc9e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0dcc0afca0 0x7f0dcc0b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48638/0 (socket says 172.21.15.2:48638) 2024-08-17T02:24:06.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.141+0000 7f0dc9e00640 1 -- 172.21.15.2:0/1482887214 learned_addr learned my addr 172.21.15.2:0/1482887214 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:06.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.141+0000 7f0dc9e00640 1 -- 172.21.15.2:0/1482887214 >> v2:172.21.15.145:3300/0 conn(0x7f0dcc0acf10 msgr2=0x7f0dcc159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:06.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.141+0000 7f0dc9e00640 1 --2- 172.21.15.2:0/1482887214 >> v2:172.21.15.145:3300/0 conn(0x7f0dcc0acf10 0x7f0dcc159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.141+0000 7f0dc9e00640 1 -- 172.21.15.2:0/1482887214 >> v1:172.21.15.2:6789/0 conn(0x7f0dcc1589a0 legacy=0x7f0dcc158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.141+0000 7f0dc9e00640 1 -- 172.21.15.2:0/1482887214 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc0ad480 con 0x7f0dcc0afca0 2024-08-17T02:24:06.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.142+0000 7f0dc9e00640 1 --2- 172.21.15.2:0/1482887214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dcc0afca0 0x7f0dcc0b0070 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0c83b0 tx=0x7f0dbc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79bca6efb9f6d67e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:06.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.142+0000 7f0dc9400640 1 -- 172.21.15.2:0/1482887214 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc02ae70 con 0x7f0dcc0afca0 2024-08-17T02:24:06.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.143+0000 7f0dc9400640 1 -- 172.21.15.2:0/1482887214 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc032440 con 0x7f0dcc0afca0 2024-08-17T02:24:06.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.143+0000 7f0dc9400640 1 -- 172.21.15.2:0/1482887214 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc032820 con 0x7f0dcc0afca0 2024-08-17T02:24:06.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.143+0000 7f0dd0a00640 1 -- 172.21.15.2:0/1482887214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dcc0afca0 msgr2=0x7f0dcc0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.143+0000 7f0dd0a00640 1 --2- 172.21.15.2:0/1482887214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dcc0afca0 0x7f0dcc0b0070 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0c83b0 tx=0x7f0dbc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.143+0000 7f0dd0a00640 1 -- 172.21.15.2:0/1482887214 shutdown_connections 2024-08-17T02:24:06.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.143+0000 7f0dd0a00640 1 --2- 172.21.15.2:0/1482887214 >> v2:172.21.15.145:3300/0 conn(0x7f0dcc0acf10 0x7f0dcc159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.143+0000 7f0dd0a00640 1 --2- 172.21.15.2:0/1482887214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dcc0afca0 0x7f0dcc0b0070 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.143+0000 7f0dd0a00640 1 -- 172.21.15.2:0/1482887214 >> 172.21.15.2:0/1482887214 conn(0x7f0dcc066e60 msgr2=0x7f0dcc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:06.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.143+0000 7f0dd0a00640 1 -- 172.21.15.2:0/1482887214 shutdown_connections 2024-08-17T02:24:06.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.143+0000 7f0dd0a00640 1 -- 172.21.15.2:0/1482887214 wait complete. 2024-08-17T02:24:06.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.145+0000 7f0dd0a00640 1 Processor -- start 2024-08-17T02:24:06.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.145+0000 7f0dd0a00640 1 -- start start 2024-08-17T02:24:06.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.145+0000 7f0dd0a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dcc0acf10 0x7f0dcc14c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.145+0000 7f0dd0a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0dcc0afca0 0x7f0dcc144e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.146+0000 7f0dd0a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0dcc1589a0 0x7f0dcc148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.146+0000 7f0dd0a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc15a9b0 con 0x7f0dcc0acf10 2024-08-17T02:24:06.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.146+0000 7f0dd0a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc14c330 con 0x7f0dcc1589a0 2024-08-17T02:24:06.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.146+0000 7f0dd0a00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc14b720 con 0x7f0dcc0afca0 2024-08-17T02:24:06.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.146+0000 7f0dc9e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dcc0acf10 0x7f0dcc14c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.146+0000 7f0dc9e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dcc0acf10 0x7f0dcc14c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48654/0 (socket says 172.21.15.2:48654) 2024-08-17T02:24:06.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.146+0000 7f0dc9e00640 1 -- 172.21.15.2:0/1817950621 learned_addr learned my addr 172.21.15.2:0/1817950621 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:06.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.146+0000 7f0dca800640 1 --2- 172.21.15.2:0/1817950621 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0dcc1589a0 0x7f0dcc148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.146+0000 7f0dc9e00640 1 -- 172.21.15.2:0/1817950621 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0dcc0afca0 msgr2=0x7f0dcc144e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.146+0000 7f0dc3e00640 1 --2- 172.21.15.2:0/1817950621 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0dcc0afca0 0x7f0dcc144e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.146+0000 7f0dc9e00640 1 --2- 172.21.15.2:0/1817950621 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0dcc0afca0 0x7f0dcc144e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.146+0000 7f0dc9e00640 1 -- 172.21.15.2:0/1817950621 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0dcc1589a0 msgr2=0x7f0dcc148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.146+0000 7f0dc9e00640 1 --2- 172.21.15.2:0/1817950621 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0dcc1589a0 0x7f0dcc148c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.146+0000 7f0dc9e00640 1 -- 172.21.15.2:0/1817950621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc009450 con 0x7f0dcc0acf10 2024-08-17T02:24:06.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.146+0000 7f0dca800640 1 --2- 172.21.15.2:0/1817950621 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0dcc1589a0 0x7f0dcc148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:06.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.146+0000 7f0dc3e00640 1 --2- 172.21.15.2:0/1817950621 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0dcc0afca0 0x7f0dcc144e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:06.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.147+0000 7f0dc9e00640 1 --2- 172.21.15.2:0/1817950621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dcc0acf10 0x7f0dcc14c9e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc035040 tx=0x7f0dbc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:06.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.147+0000 7f0dc1600640 1 -- 172.21.15.2:0/1817950621 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc031a60 con 0x7f0dcc0acf10 2024-08-17T02:24:06.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.147+0000 7f0dc1600640 1 -- 172.21.15.2:0/1817950621 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc031c00 con 0x7f0dcc0acf10 2024-08-17T02:24:06.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.147+0000 7f0dc1600640 1 -- 172.21.15.2:0/1817950621 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc03e450 con 0x7f0dcc0acf10 2024-08-17T02:24:06.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.147+0000 7f0dd0a00640 1 -- 172.21.15.2:0/1817950621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dcc14ba00 con 0x7f0dcc0acf10 2024-08-17T02:24:06.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.147+0000 7f0dd0a00640 1 -- 172.21.15.2:0/1817950621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dcc14bfc0 con 0x7f0dcc0acf10 2024-08-17T02:24:06.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.148+0000 7f0dd0a00640 1 -- 172.21.15.2:0/1817950621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dcc063fb0 con 0x7f0dcc0acf10 2024-08-17T02:24:06.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.149+0000 7f0dc1600640 1 -- 172.21.15.2:0/1817950621 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0dbc03e7c0 con 0x7f0dcc0acf10 2024-08-17T02:24:06.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.150+0000 7f0dc1600640 1 --2- 172.21.15.2:0/1817950621 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f0da8065150 0x7f0da8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.150+0000 7f0dc1600640 1 -- 172.21.15.2:0/1817950621 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0dbc0a2a90 con 0x7f0dcc0acf10 2024-08-17T02:24:06.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.150+0000 7f0dc3e00640 1 --2- 172.21.15.2:0/1817950621 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f0da8065150 0x7f0da8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.151+0000 7f0dc3e00640 1 --2- 172.21.15.2:0/1817950621 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f0da8065150 0x7f0da8067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0db4006fd0 tx=0x7f0db4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:06.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.154+0000 7f0dc1600640 1 -- 172.21.15.2:0/1817950621 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0dbc070b60 con 0x7f0dcc0acf10 2024-08-17T02:24:06.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.333+0000 7f0dd0a00640 1 -- 172.21.15.2:0/1817950621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0dcc067b70 con 0x7f0dcc0acf10 2024-08-17T02:24:06.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.334+0000 7f0dc1600640 1 -- 172.21.15.2:0/1817950621 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0dbc0430a0 con 0x7f0dcc0acf10 2024-08-17T02:24:06.335 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-08-17T02:24:06.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.336+0000 7f0dd0a00640 1 -- 172.21.15.2:0/1817950621 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f0da8065150 msgr2=0x7f0da8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.336+0000 7f0dd0a00640 1 --2- 172.21.15.2:0/1817950621 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f0da8065150 0x7f0da8067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0db4006fd0 tx=0x7f0db4008040 comp rx=0 tx=0).stop 2024-08-17T02:24:06.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.336+0000 7f0dd0a00640 1 -- 172.21.15.2:0/1817950621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dcc0acf10 msgr2=0x7f0dcc14c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.336+0000 7f0dd0a00640 1 --2- 172.21.15.2:0/1817950621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dcc0acf10 0x7f0dcc14c9e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc035040 tx=0x7f0dbc032000 comp rx=0 tx=0).stop 2024-08-17T02:24:06.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.336+0000 7f0dd0a00640 1 -- 172.21.15.2:0/1817950621 shutdown_connections 2024-08-17T02:24:06.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.336+0000 7f0dd0a00640 1 --2- 172.21.15.2:0/1817950621 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0dcc1589a0 0x7f0dcc148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.336+0000 7f0dd0a00640 1 --2- 172.21.15.2:0/1817950621 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f0da8065150 0x7f0da8067600 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.336+0000 7f0dd0a00640 1 --2- 172.21.15.2:0/1817950621 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0dcc0afca0 0x7f0dcc144e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.336+0000 7f0dd0a00640 1 --2- 172.21.15.2:0/1817950621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dcc0acf10 0x7f0dcc14c9e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.336+0000 7f0dd0a00640 1 -- 172.21.15.2:0/1817950621 >> 172.21.15.2:0/1817950621 conn(0x7f0dcc066e60 msgr2=0x7f0dcc069910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:06.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.336+0000 7f0dd0a00640 1 -- 172.21.15.2:0/1817950621 shutdown_connections 2024-08-17T02:24:06.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.336+0000 7f0dd0a00640 1 -- 172.21.15.2:0/1817950621 wait complete. 2024-08-17T02:24:06.355 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:24:06.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.506+0000 7fc74b000640 1 Processor -- start 2024-08-17T02:24:06.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.506+0000 7fc74b000640 1 -- start start 2024-08-17T02:24:06.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.507+0000 7fc74b000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc7440b0e30 0x7fc7440b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.507+0000 7fc74b000640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc74415a590 0x7fc74413fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.507+0000 7fc74b000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc74406d7c0 con 0x7fc744156f90 2024-08-17T02:24:06.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.507+0000 7fc74b000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74415ab30 con 0x7fc7440b0e30 2024-08-17T02:24:06.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.507+0000 7fc74b000640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74415ae10 con 0x7fc74415a590 2024-08-17T02:24:06.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.507+0000 7fc749c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc7440b0e30 0x7fc7440b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.507+0000 7fc749c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc7440b0e30 0x7fc7440b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48658/0 (socket says 172.21.15.2:48658) 2024-08-17T02:24:06.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.507+0000 7fc749c00640 1 -- 172.21.15.2:0/3913754587 learned_addr learned my addr 172.21.15.2:0/3913754587 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:06.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.507+0000 7fc74a600640 1 --2- 172.21.15.2:0/3913754587 >> v2:172.21.15.145:3300/0 conn(0x7fc74415a590 0x7fc74413fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.508+0000 7fc749c00640 1 -- 172.21.15.2:0/3913754587 >> v2:172.21.15.145:3300/0 conn(0x7fc74415a590 msgr2=0x7fc74413fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:06.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.508+0000 7fc749c00640 1 --2- 172.21.15.2:0/3913754587 >> v2:172.21.15.145:3300/0 conn(0x7fc74415a590 0x7fc74413fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.508+0000 7fc749c00640 1 -- 172.21.15.2:0/3913754587 >> v1:172.21.15.2:6789/0 conn(0x7fc744156f90 legacy=0x7fc7440cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.508+0000 7fc749c00640 1 -- 172.21.15.2:0/3913754587 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74415b0f0 con 0x7fc7440b0e30 2024-08-17T02:24:06.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.509+0000 7fc749c00640 1 --2- 172.21.15.2:0/3913754587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7440b0e30 0x7fc7440b1200 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc744069f30 tx=0x7fc7380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d1558d0b4cac86 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:06.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.509+0000 7fc743e00640 1 -- 172.21.15.2:0/3913754587 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73802ae80 con 0x7fc7440b0e30 2024-08-17T02:24:06.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.509+0000 7fc743e00640 1 -- 172.21.15.2:0/3913754587 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc738032440 con 0x7fc7440b0e30 2024-08-17T02:24:06.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.509+0000 7fc743e00640 1 -- 172.21.15.2:0/3913754587 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc738032800 con 0x7fc7440b0e30 2024-08-17T02:24:06.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.510+0000 7fc74b000640 1 -- 172.21.15.2:0/3913754587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7440b0e30 msgr2=0x7fc7440b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.510+0000 7fc74b000640 1 --2- 172.21.15.2:0/3913754587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7440b0e30 0x7fc7440b1200 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc744069f30 tx=0x7fc7380091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.510+0000 7fc74b000640 1 -- 172.21.15.2:0/3913754587 shutdown_connections 2024-08-17T02:24:06.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.510+0000 7fc74b000640 1 --2- 172.21.15.2:0/3913754587 >> v2:172.21.15.145:3300/0 conn(0x7fc74415a590 0x7fc74413fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.510+0000 7fc74b000640 1 --2- 172.21.15.2:0/3913754587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7440b0e30 0x7fc7440b1200 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.510+0000 7fc74b000640 1 -- 172.21.15.2:0/3913754587 >> 172.21.15.2:0/3913754587 conn(0x7fc744062af0 msgr2=0x7fc744062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:06.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.510+0000 7fc74b000640 1 -- 172.21.15.2:0/3913754587 shutdown_connections 2024-08-17T02:24:06.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.510+0000 7fc74b000640 1 -- 172.21.15.2:0/3913754587 wait complete. 2024-08-17T02:24:06.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.511+0000 7fc74b000640 1 Processor -- start 2024-08-17T02:24:06.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.511+0000 7fc74b000640 1 -- start start 2024-08-17T02:24:06.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.512+0000 7fc74b000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7440b0e30 0x7fc7440af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.512+0000 7fc74b000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc744156f90 0x7fc7441361f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.512+0000 7fc74b000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc74415a590 0x7fc7441369f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.512+0000 7fc74b000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc744169210 con 0x7fc74415a590 2024-08-17T02:24:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.512+0000 7fc74b000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7440af9e0 con 0x7fc7440b0e30 2024-08-17T02:24:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.512+0000 7fc74b000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7440afcc0 con 0x7fc744156f90 2024-08-17T02:24:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.512+0000 7fc74a600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc74415a590 0x7fc7441369f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.512+0000 7fc74a600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc74415a590 0x7fc7441369f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48674/0 (socket says 172.21.15.2:48674) 2024-08-17T02:24:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.512+0000 7fc74a600640 1 -- 172.21.15.2:0/3511480083 learned_addr learned my addr 172.21.15.2:0/3511480083 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.513+0000 7fc749c00640 1 --2- 172.21.15.2:0/3511480083 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7440b0e30 0x7fc7440af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.513+0000 7fc749200640 1 --2- 172.21.15.2:0/3511480083 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc744156f90 0x7fc7441361f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.513+0000 7fc74a600640 1 -- 172.21.15.2:0/3511480083 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc744156f90 msgr2=0x7fc7441361f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.513+0000 7fc74a600640 1 --2- 172.21.15.2:0/3511480083 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc744156f90 0x7fc7441361f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.513+0000 7fc74a600640 1 -- 172.21.15.2:0/3511480083 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7440b0e30 msgr2=0x7fc7440af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.513+0000 7fc74a600640 1 --2- 172.21.15.2:0/3511480083 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7440b0e30 0x7fc7440af3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.513+0000 7fc74a600640 1 -- 172.21.15.2:0/3511480083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc738009450 con 0x7fc74415a590 2024-08-17T02:24:06.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.513+0000 7fc749200640 1 --2- 172.21.15.2:0/3511480083 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc744156f90 0x7fc7441361f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:06.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.513+0000 7fc74a600640 1 --2- 172.21.15.2:0/3511480083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc74415a590 0x7fc7441369f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc73c009df0 tx=0x7fc73c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:06.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.513+0000 7fc740c00640 1 -- 172.21.15.2:0/3511480083 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c00cd40 con 0x7fc74415a590 2024-08-17T02:24:06.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.513+0000 7fc740c00640 1 -- 172.21.15.2:0/3511480083 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73c00f040 con 0x7fc74415a590 2024-08-17T02:24:06.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.513+0000 7fc740c00640 1 -- 172.21.15.2:0/3511480083 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c0146d0 con 0x7fc74415a590 2024-08-17T02:24:06.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.513+0000 7fc74b000640 1 -- 172.21.15.2:0/3511480083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7440affa0 con 0x7fc74415a590 2024-08-17T02:24:06.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.514+0000 7fc74b000640 1 -- 172.21.15.2:0/3511480083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc744136730 con 0x7fc74415a590 2024-08-17T02:24:06.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.515+0000 7fc74b000640 1 -- 172.21.15.2:0/3511480083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7441693c0 con 0x7fc74415a590 2024-08-17T02:24:06.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.515+0000 7fc740c00640 1 -- 172.21.15.2:0/3511480083 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc73c014a80 con 0x7fc74415a590 2024-08-17T02:24:06.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.516+0000 7fc740c00640 1 --2- 172.21.15.2:0/3511480083 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc724065150 0x7fc724067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.516+0000 7fc740c00640 1 -- 172.21.15.2:0/3511480083 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc73c083170 con 0x7fc74415a590 2024-08-17T02:24:06.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.517+0000 7fc749c00640 1 --2- 172.21.15.2:0/3511480083 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc724065150 0x7fc724067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.518+0000 7fc749c00640 1 --2- 172.21.15.2:0/3511480083 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc724065150 0x7fc724067600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc738034000 tx=0x7fc738032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:06.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.520+0000 7fc740c00640 1 -- 172.21.15.2:0/3511480083 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc73c051190 con 0x7fc74415a590 2024-08-17T02:24:06.554 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:06.558 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:06.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:06.774+0000 7fc74b000640 1 -- 172.21.15.2:0/3511480083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7fc744070720 con 0x7fc74415a590 2024-08-17T02:24:07.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.183+0000 7fc740c00640 1 -- 172.21.15.2:0/3511480083 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v50) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc73c0547b0 con 0x7fc74415a590 2024-08-17T02:24:07.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.186+0000 7fc74b000640 1 -- 172.21.15.2:0/3511480083 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc724065150 msgr2=0x7fc724067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:07.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.186+0000 7fc74b000640 1 --2- 172.21.15.2:0/3511480083 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc724065150 0x7fc724067600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc738034000 tx=0x7fc738032000 comp rx=0 tx=0).stop 2024-08-17T02:24:07.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.186+0000 7fc74b000640 1 -- 172.21.15.2:0/3511480083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc74415a590 msgr2=0x7fc7441369f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:07.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.186+0000 7fc74b000640 1 --2- 172.21.15.2:0/3511480083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc74415a590 0x7fc7441369f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc73c009df0 tx=0x7fc73c00b040 comp rx=0 tx=0).stop 2024-08-17T02:24:07.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.186+0000 7fc74b000640 1 -- 172.21.15.2:0/3511480083 shutdown_connections 2024-08-17T02:24:07.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.186+0000 7fc74b000640 1 --2- 172.21.15.2:0/3511480083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc74415a590 0x7fc7441369f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.186+0000 7fc74b000640 1 --2- 172.21.15.2:0/3511480083 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc724065150 0x7fc724067600 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.186+0000 7fc74b000640 1 --2- 172.21.15.2:0/3511480083 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc744156f90 0x7fc7441361f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.186+0000 7fc74b000640 1 --2- 172.21.15.2:0/3511480083 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7440b0e30 0x7fc7440af3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.186+0000 7fc74b000640 1 -- 172.21.15.2:0/3511480083 >> 172.21.15.2:0/3511480083 conn(0x7fc744062af0 msgr2=0x7fc7441557b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:07.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.186+0000 7fc74b000640 1 -- 172.21.15.2:0/3511480083 shutdown_connections 2024-08-17T02:24:07.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.186+0000 7fc74b000640 1 -- 172.21.15.2:0/3511480083 wait complete. 2024-08-17T02:24:07.203 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:24:07.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.357+0000 7f0911200640 1 Processor -- start 2024-08-17T02:24:07.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.358+0000 7f0911200640 1 -- start start 2024-08-17T02:24:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.359+0000 7f0911200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f090c0aa0b0 0x7f090c0aa480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.359+0000 7f0911200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f090c0a98d0 0x7f090c0c9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.359+0000 7f0911200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f090c0c9cc0 0x7f090c0abfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.359+0000 7f0911200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090c06c620 con 0x7f090c0c9cc0 2024-08-17T02:24:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.359+0000 7f0911200640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090c0c92f0 con 0x7f090c0aa0b0 2024-08-17T02:24:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.359+0000 7f0911200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090c0aa9c0 con 0x7f090c0a98d0 2024-08-17T02:24:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.359+0000 7f090be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f090c0c9cc0 0x7f090c0abfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.360+0000 7f090be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f090c0c9cc0 0x7f090c0abfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48682/0 (socket says 172.21.15.2:48682) 2024-08-17T02:24:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.360+0000 7f090be00640 1 -- 172.21.15.2:0/773149003 learned_addr learned my addr 172.21.15.2:0/773149003 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.360+0000 7f0903e00640 1 --2- 172.21.15.2:0/773149003 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f090c0a98d0 0x7f090c0c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.360+0000 7f090b400640 1 --2- 172.21.15.2:0/773149003 >> v2:172.21.15.145:3300/0 conn(0x7f090c0aa0b0 0x7f090c0aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.360+0000 7f090be00640 1 -- 172.21.15.2:0/773149003 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f090c0a98d0 msgr2=0x7f090c0c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.360+0000 7f090be00640 1 --2- 172.21.15.2:0/773149003 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f090c0a98d0 0x7f090c0c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.360+0000 7f090be00640 1 -- 172.21.15.2:0/773149003 >> v2:172.21.15.145:3300/0 conn(0x7f090c0aa0b0 msgr2=0x7f090c0aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.360+0000 7f090be00640 1 --2- 172.21.15.2:0/773149003 >> v2:172.21.15.145:3300/0 conn(0x7f090c0aa0b0 0x7f090c0aa480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.360+0000 7f090be00640 1 -- 172.21.15.2:0/773149003 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c06bd80 con 0x7f090c0c9cc0 2024-08-17T02:24:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.360+0000 7f090b400640 1 --2- 172.21.15.2:0/773149003 >> v2:172.21.15.145:3300/0 conn(0x7f090c0aa0b0 0x7f090c0aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:07.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.361+0000 7f090be00640 1 --2- 172.21.15.2:0/773149003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090c0c9cc0 0x7f090c0abfa0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f090c069340 tx=0x7f0904009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff28aee31344d021 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.361+0000 7f090aa00640 1 -- 172.21.15.2:0/773149003 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0904031400 con 0x7f090c0c9cc0 2024-08-17T02:24:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.361+0000 7f090aa00640 1 -- 172.21.15.2:0/773149003 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090402d050 con 0x7f090c0c9cc0 2024-08-17T02:24:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.361+0000 7f090aa00640 1 -- 172.21.15.2:0/773149003 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09040317d0 con 0x7f090c0c9cc0 2024-08-17T02:24:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.362+0000 7f0911200640 1 -- 172.21.15.2:0/773149003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090c0c9cc0 msgr2=0x7f090c0abfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.362+0000 7f0911200640 1 --2- 172.21.15.2:0/773149003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090c0c9cc0 0x7f090c0abfa0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f090c069340 tx=0x7f0904009840 comp rx=0 tx=0).stop 2024-08-17T02:24:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.362+0000 7f0911200640 1 -- 172.21.15.2:0/773149003 shutdown_connections 2024-08-17T02:24:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.362+0000 7f0911200640 1 --2- 172.21.15.2:0/773149003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090c0c9cc0 0x7f090c0abfa0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.362+0000 7f0911200640 1 --2- 172.21.15.2:0/773149003 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f090c0a98d0 0x7f090c0c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.362+0000 7f0911200640 1 --2- 172.21.15.2:0/773149003 >> v2:172.21.15.145:3300/0 conn(0x7f090c0aa0b0 0x7f090c0aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.362+0000 7f0911200640 1 -- 172.21.15.2:0/773149003 >> 172.21.15.2:0/773149003 conn(0x7f090c095a70 msgr2=0x7f090c095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.362+0000 7f0911200640 1 -- 172.21.15.2:0/773149003 shutdown_connections 2024-08-17T02:24:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.362+0000 7f0911200640 1 -- 172.21.15.2:0/773149003 wait complete. 2024-08-17T02:24:07.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.363+0000 7f0911200640 1 Processor -- start 2024-08-17T02:24:07.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.363+0000 7f0911200640 1 -- start start 2024-08-17T02:24:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.364+0000 7f0911200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f090c0a98d0 0x7f090c168bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.364+0000 7f0911200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f090c0aa0b0 0x7f090c067090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.364+0000 7f0911200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090c0c9cc0 0x7f090c152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.364+0000 7f0911200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c0af730 con 0x7f090c0c9cc0 2024-08-17T02:24:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.364+0000 7f0911200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c0b02b0 con 0x7f090c0aa0b0 2024-08-17T02:24:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.364+0000 7f0911200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090c0af980 con 0x7f090c0a98d0 2024-08-17T02:24:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.365+0000 7f090be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090c0c9cc0 0x7f090c152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.365+0000 7f090be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090c0c9cc0 0x7f090c152340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48692/0 (socket says 172.21.15.2:48692) 2024-08-17T02:24:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.365+0000 7f090be00640 1 -- 172.21.15.2:0/2380723049 learned_addr learned my addr 172.21.15.2:0/2380723049 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.365+0000 7f090b400640 1 --2- 172.21.15.2:0/2380723049 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f090c0a98d0 0x7f090c168bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.365+0000 7f0903e00640 1 --2- 172.21.15.2:0/2380723049 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f090c0aa0b0 0x7f090c067090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.365+0000 7f090be00640 1 -- 172.21.15.2:0/2380723049 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f090c0a98d0 msgr2=0x7f090c168bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.365+0000 7f090be00640 1 --2- 172.21.15.2:0/2380723049 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f090c0a98d0 0x7f090c168bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.365+0000 7f090be00640 1 -- 172.21.15.2:0/2380723049 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f090c0aa0b0 msgr2=0x7f090c067090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:07.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.365+0000 7f090be00640 1 --2- 172.21.15.2:0/2380723049 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f090c0aa0b0 0x7f090c067090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.365+0000 7f090be00640 1 -- 172.21.15.2:0/2380723049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0904009ae0 con 0x7f090c0c9cc0 2024-08-17T02:24:07.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.365+0000 7f090be00640 1 --2- 172.21.15.2:0/2380723049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090c0c9cc0 0x7f090c152340 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f090402acd0 tx=0x7f0904034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:07.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.366+0000 7f0902a00640 1 -- 172.21.15.2:0/2380723049 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0904007170 con 0x7f090c0c9cc0 2024-08-17T02:24:07.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.366+0000 7f0902a00640 1 -- 172.21.15.2:0/2380723049 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0904008e50 con 0x7f090c0c9cc0 2024-08-17T02:24:07.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.366+0000 7f0902a00640 1 -- 172.21.15.2:0/2380723049 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090403b640 con 0x7f090c0c9cc0 2024-08-17T02:24:07.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.366+0000 7f0911200640 1 -- 172.21.15.2:0/2380723049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090c0afc60 con 0x7f090c0c9cc0 2024-08-17T02:24:07.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.366+0000 7f0911200640 1 -- 172.21.15.2:0/2380723049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090c169100 con 0x7f090c0c9cc0 2024-08-17T02:24:07.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.367+0000 7f0911200640 1 -- 172.21.15.2:0/2380723049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090c0b0420 con 0x7f090c0c9cc0 2024-08-17T02:24:07.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.368+0000 7f0902a00640 1 -- 172.21.15.2:0/2380723049 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0904038050 con 0x7f090c0c9cc0 2024-08-17T02:24:07.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.369+0000 7f0902a00640 1 --2- 172.21.15.2:0/2380723049 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f08e8065150 0x7f08e8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:07.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.369+0000 7f0902a00640 1 -- 172.21.15.2:0/2380723049 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f09040a2ac0 con 0x7f090c0c9cc0 2024-08-17T02:24:07.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.369+0000 7f090b400640 1 --2- 172.21.15.2:0/2380723049 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f08e8065150 0x7f08e8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:07.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.370+0000 7f090b400640 1 --2- 172.21.15.2:0/2380723049 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f08e8065150 0x7f08e8067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f08fc00ab30 tx=0x7f08fc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:07.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.373+0000 7f0902a00640 1 -- 172.21.15.2:0/2380723049 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0904070ae0 con 0x7f090c0c9cc0 2024-08-17T02:24:07.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.557+0000 7f0911200640 1 -- 172.21.15.2:0/2380723049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f090c070720 con 0x7f090c0c9cc0 2024-08-17T02:24:07.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.561+0000 7f0902a00640 1 -- 172.21.15.2:0/2380723049 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0904074100 con 0x7f090c0c9cc0 2024-08-17T02:24:07.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.563+0000 7f0911200640 1 -- 172.21.15.2:0/2380723049 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f08e8065150 msgr2=0x7f08e8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:07.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.563+0000 7f0911200640 1 --2- 172.21.15.2:0/2380723049 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f08e8065150 0x7f08e8067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f08fc00ab30 tx=0x7f08fc008040 comp rx=0 tx=0).stop 2024-08-17T02:24:07.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.563+0000 7f0911200640 1 -- 172.21.15.2:0/2380723049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090c0c9cc0 msgr2=0x7f090c152340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:07.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.563+0000 7f0911200640 1 --2- 172.21.15.2:0/2380723049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090c0c9cc0 0x7f090c152340 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f090402acd0 tx=0x7f0904034000 comp rx=0 tx=0).stop 2024-08-17T02:24:07.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.563+0000 7f0911200640 1 -- 172.21.15.2:0/2380723049 shutdown_connections 2024-08-17T02:24:07.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.563+0000 7f0911200640 1 --2- 172.21.15.2:0/2380723049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090c0c9cc0 0x7f090c152340 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.563+0000 7f0911200640 1 --2- 172.21.15.2:0/2380723049 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f090c0aa0b0 0x7f090c067090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.563+0000 7f0911200640 1 --2- 172.21.15.2:0/2380723049 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f08e8065150 0x7f08e8067600 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.563+0000 7f0911200640 1 --2- 172.21.15.2:0/2380723049 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f090c0a98d0 0x7f090c168bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.563+0000 7f0911200640 1 -- 172.21.15.2:0/2380723049 >> 172.21.15.2:0/2380723049 conn(0x7f090c095a70 msgr2=0x7f090c0ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:07.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.563+0000 7f0911200640 1 -- 172.21.15.2:0/2380723049 shutdown_connections 2024-08-17T02:24:07.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:07.563+0000 7f0911200640 1 -- 172.21.15.2:0/2380723049 wait complete. 2024-08-17T02:24:07.580 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:24:07.580 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:24:07.665 DEBUG:teuthology.orchestra.run.smithi145:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:24:07.772 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:24:07.773 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:24:07.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:24:07.773 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-17T02:24:07.836 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:24:07.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:07.836 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:24:07.876 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:24:07.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:24:07.876 DEBUG:teuthology.orchestra.run.smithi145:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-08-17T02:24:07.941 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi145.front.sepia.ceph.com 2024-08-17T02:24:07.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:07.941 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:24:07.988 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-08-17T02:24:07.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:24:07.988 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-08-17T02:24:08.048 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:24:08.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:08.049 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:24:08.086 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-08-17T02:24:08.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:24:08.086 DEBUG:teuthology.orchestra.run.smithi145:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-08-17T02:24:08.146 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi145.front.sepia.ceph.com 2024-08-17T02:24:08.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:08.146 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:24:08.183 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-17T02:24:08.183 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:24:08.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.333+0000 7fdf01600640 1 Processor -- start 2024-08-17T02:24:08.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.333+0000 7fdf01600640 1 -- start start 2024-08-17T02:24:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.335+0000 7fdf01600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdefc0acf10 0x7fdefc0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.335+0000 7fdf01600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdefc0c92b0 con 0x7fdefc1590b0 2024-08-17T02:24:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.335+0000 7fdf01600640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdefc0ad480 con 0x7fdefc0afca0 2024-08-17T02:24:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.335+0000 7fdf01600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc0b0980 con 0x7fdefc0acf10 2024-08-17T02:24:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.335+0000 7fdef3e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fdefc1590b0 0x7fdefc0c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43394/0 (socket says 172.21.15.2:43394) 2024-08-17T02:24:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.335+0000 7fdef3e00640 1 -- 172.21.15.2:0/500828389 learned_addr learned my addr 172.21.15.2:0/500828389 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.335+0000 7fdefb400640 1 --2- 172.21.15.2:0/500828389 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdefc0acf10 0x7fdefc0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.335+0000 7fdefa000640 1 -- 172.21.15.2:0/500828389 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2941805569 0 0) 0x7fdefc0c92b0 con 0x7fdefc1590b0 2024-08-17T02:24:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.335+0000 7fdefa000640 1 -- 172.21.15.2:0/500828389 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdee00034e0 con 0x7fdefc1590b0 2024-08-17T02:24:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.336+0000 7fdefb400640 1 -- 172.21.15.2:0/500828389 >> v1:172.21.15.145:6789/0 conn(0x7fdefc0afca0 legacy=0x7fdefc1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.336+0000 7fdefa000640 1 -- 172.21.15.2:0/500828389 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3510344310 0 0) 0x7fdefc0ad480 con 0x7fdefc0afca0 2024-08-17T02:24:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.336+0000 7fdefb400640 1 -- 172.21.15.2:0/500828389 >> v1:172.21.15.2:6789/0 conn(0x7fdefc1590b0 legacy=0x7fdefc0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.336+0000 7fdefb400640 1 -- 172.21.15.2:0/500828389 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdefc0ad760 con 0x7fdefc0acf10 2024-08-17T02:24:08.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.337+0000 7fdefb400640 1 --2- 172.21.15.2:0/500828389 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdefc0acf10 0x7fdefc0b0070 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdef4009e90 tx=0x7fdef4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a395b675e5a79373 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.337+0000 7fdefa000640 1 -- 172.21.15.2:0/500828389 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4031610 con 0x7fdefc0acf10 2024-08-17T02:24:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.337+0000 7fdefa000640 1 -- 172.21.15.2:0/500828389 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef4031770 con 0x7fdefc0acf10 2024-08-17T02:24:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.337+0000 7fdefa000640 1 -- 172.21.15.2:0/500828389 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4031af0 con 0x7fdefc0acf10 2024-08-17T02:24:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.337+0000 7fdf01600640 1 -- 172.21.15.2:0/500828389 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdefc0acf10 msgr2=0x7fdefc0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.337+0000 7fdf01600640 1 --2- 172.21.15.2:0/500828389 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdefc0acf10 0x7fdefc0b0070 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdef4009e90 tx=0x7fdef4009780 comp rx=0 tx=0).stop 2024-08-17T02:24:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.337+0000 7fdf01600640 1 -- 172.21.15.2:0/500828389 shutdown_connections 2024-08-17T02:24:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.338+0000 7fdf01600640 1 --2- 172.21.15.2:0/500828389 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdefc0acf10 0x7fdefc0b0070 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.338+0000 7fdf01600640 1 -- 172.21.15.2:0/500828389 >> 172.21.15.2:0/500828389 conn(0x7fdefc066e60 msgr2=0x7fdefc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.338+0000 7fdf01600640 1 -- 172.21.15.2:0/500828389 shutdown_connections 2024-08-17T02:24:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.338+0000 7fdf01600640 1 -- 172.21.15.2:0/500828389 wait complete. 2024-08-17T02:24:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.339+0000 7fdf01600640 1 Processor -- start 2024-08-17T02:24:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.339+0000 7fdf01600640 1 -- start start 2024-08-17T02:24:08.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.340+0000 7fdf01600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdefc0acf10 0x7fdefc0c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.340+0000 7fdf01600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdefc0afca0 0x7fdefc144300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.340+0000 7fdf01600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdefc1590b0 0x7fdefc156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.340+0000 7fdf01600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc168910 con 0x7fdefc0acf10 2024-08-17T02:24:08.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.340+0000 7fdf01600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc16c310 con 0x7fdefc0afca0 2024-08-17T02:24:08.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.340+0000 7fdf01600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc16c5f0 con 0x7fdefc1590b0 2024-08-17T02:24:08.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.340+0000 7fdefaa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdefc0acf10 0x7fdefc0c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.340+0000 7fdefaa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdefc0acf10 0x7fdefc0c4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48696/0 (socket says 172.21.15.2:48696) 2024-08-17T02:24:08.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.340+0000 7fdefaa00640 1 -- 172.21.15.2:0/2292560493 learned_addr learned my addr 172.21.15.2:0/2292560493 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:08.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.340+0000 7fdefb400640 1 --2- 172.21.15.2:0/2292560493 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdefc1590b0 0x7fdefc156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.341+0000 7fdef3e00640 1 --2- 172.21.15.2:0/2292560493 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdefc0afca0 0x7fdefc144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.341+0000 7fdefaa00640 1 -- 172.21.15.2:0/2292560493 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdefc1590b0 msgr2=0x7fdefc156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.341+0000 7fdefaa00640 1 --2- 172.21.15.2:0/2292560493 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdefc1590b0 0x7fdefc156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.341+0000 7fdefaa00640 1 -- 172.21.15.2:0/2292560493 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdefc0afca0 msgr2=0x7fdefc144300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.341+0000 7fdefaa00640 1 --2- 172.21.15.2:0/2292560493 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdefc0afca0 0x7fdefc144300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.341+0000 7fdefaa00640 1 -- 172.21.15.2:0/2292560493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef4009a20 con 0x7fdefc0acf10 2024-08-17T02:24:08.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.341+0000 7fdefaa00640 1 --2- 172.21.15.2:0/2292560493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdefc0acf10 0x7fdefc0c4bf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0011e0 tx=0x7fdeec007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:08.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.341+0000 7fdef2000640 1 -- 172.21.15.2:0/2292560493 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec011590 con 0x7fdefc0acf10 2024-08-17T02:24:08.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.341+0000 7fdef2000640 1 -- 172.21.15.2:0/2292560493 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeec0116f0 con 0x7fdefc0acf10 2024-08-17T02:24:08.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.341+0000 7fdef2000640 1 -- 172.21.15.2:0/2292560493 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec011ab0 con 0x7fdefc0acf10 2024-08-17T02:24:08.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.341+0000 7fdf01600640 1 -- 172.21.15.2:0/2292560493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdefc16c8d0 con 0x7fdefc0acf10 2024-08-17T02:24:08.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.341+0000 7fdf01600640 1 -- 172.21.15.2:0/2292560493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdefc0c5130 con 0x7fdefc0acf10 2024-08-17T02:24:08.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.342+0000 7fdf01600640 1 -- 172.21.15.2:0/2292560493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdefc063fb0 con 0x7fdefc0acf10 2024-08-17T02:24:08.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.343+0000 7fdef2000640 1 -- 172.21.15.2:0/2292560493 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdeec01b3b0 con 0x7fdefc0acf10 2024-08-17T02:24:08.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.344+0000 7fdef2000640 1 --2- 172.21.15.2:0/2292560493 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fded8065150 0x7fded8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.344+0000 7fdef2000640 1 -- 172.21.15.2:0/2292560493 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdeec081a30 con 0x7fdefc0acf10 2024-08-17T02:24:08.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.344+0000 7fdef3e00640 1 --2- 172.21.15.2:0/2292560493 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fded8065150 0x7fded8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.345+0000 7fdef3e00640 1 --2- 172.21.15.2:0/2292560493 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fded8065150 0x7fded8067600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdefc06e890 tx=0x7fdee4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:08.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.348+0000 7fdef2000640 1 -- 172.21.15.2:0/2292560493 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdeec04fa50 con 0x7fdefc0acf10 2024-08-17T02:24:08.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.572+0000 7fdf01600640 1 -- 172.21.15.2:0/2292560493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdefc168a50 con 0x7fdefc0acf10 2024-08-17T02:24:08.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.573+0000 7fdef2000640 1 -- 172.21.15.2:0/2292560493 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7fdefc168a50 con 0x7fdefc0acf10 2024-08-17T02:24:08.574 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:24:08.574 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/88006300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":88006300},{"type":"v1","addr":"172.21.15.2:6835","nonce":88006300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3374741059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3374741059},{"type":"v1","addr":"172.21.15.2:6833","nonce":3374741059}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/3494373963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":3494373963},{"type":"v1","addr":"172.21.15.145:6837","nonce":3494373963}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:31.378654+0000","modified":"2024-08-17T02:23:34.968351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6836/3984927211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3984927211},{"type":"v1","addr":"172.21.15.145:6836","nonce":3984927211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:24:08.575 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2024-08-17T02:24:08.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.575+0000 7fdf01600640 1 -- 172.21.15.2:0/2292560493 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fded8065150 msgr2=0x7fded8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.575+0000 7fdf01600640 1 --2- 172.21.15.2:0/2292560493 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fded8065150 0x7fded8067600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdefc06e890 tx=0x7fdee4009040 comp rx=0 tx=0).stop 2024-08-17T02:24:08.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.575+0000 7fdf01600640 1 -- 172.21.15.2:0/2292560493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdefc0acf10 msgr2=0x7fdefc0c4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.575+0000 7fdf01600640 1 --2- 172.21.15.2:0/2292560493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdefc0acf10 0x7fdefc0c4bf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0011e0 tx=0x7fdeec007d10 comp rx=0 tx=0).stop 2024-08-17T02:24:08.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.575+0000 7fdf01600640 1 -- 172.21.15.2:0/2292560493 shutdown_connections 2024-08-17T02:24:08.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.575+0000 7fdf01600640 1 --2- 172.21.15.2:0/2292560493 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fded8065150 0x7fded8067600 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.575+0000 7fdf01600640 1 --2- 172.21.15.2:0/2292560493 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdefc1590b0 0x7fdefc156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.575+0000 7fdf01600640 1 --2- 172.21.15.2:0/2292560493 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdefc0afca0 0x7fdefc144300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.575+0000 7fdf01600640 1 --2- 172.21.15.2:0/2292560493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdefc0acf10 0x7fdefc0c4bf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.575+0000 7fdf01600640 1 -- 172.21.15.2:0/2292560493 >> 172.21.15.2:0/2292560493 conn(0x7fdefc066e60 msgr2=0x7fdefc1514f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:08.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.575+0000 7fdf01600640 1 -- 172.21.15.2:0/2292560493 shutdown_connections 2024-08-17T02:24:08.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.575+0000 7fdf01600640 1 -- 172.21.15.2:0/2292560493 wait complete. 2024-08-17T02:24:08.592 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.743+0000 7fdaa1000640 1 Processor -- start 2024-08-17T02:24:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.743+0000 7fdaa1000640 1 -- start start 2024-08-17T02:24:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.744+0000 7fdaa1000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fda9c0b15d0 0x7fda9c0b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.744+0000 7fdaa1000640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fda9c0adde0 0x7fda9c0b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.744+0000 7fdaa1000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda9c156790 0x7fda9c156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.744+0000 7fdaa1000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c0ae2a0 con 0x7fda9c0b15d0 2024-08-17T02:24:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.744+0000 7fdaa1000640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c0ae580 con 0x7fda9c0adde0 2024-08-17T02:24:08.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.744+0000 7fdaa1000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0ae860 con 0x7fda9c156790 2024-08-17T02:24:08.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.745+0000 7fda99e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fda9c0b15d0 0x7fda9c0b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.745+0000 7fda99e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fda9c0b15d0 0x7fda9c0b19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48702/0 (socket says 172.21.15.2:48702) 2024-08-17T02:24:08.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.745+0000 7fda99e00640 1 -- 172.21.15.2:0/949536400 learned_addr learned my addr 172.21.15.2:0/949536400 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:08.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.745+0000 7fda9a800640 1 --2- 172.21.15.2:0/949536400 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda9c156790 0x7fda9c156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.745+0000 7fda99400640 1 --2- 172.21.15.2:0/949536400 >> v2:172.21.15.145:3300/0 conn(0x7fda9c0adde0 0x7fda9c0b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.745+0000 7fda99e00640 1 -- 172.21.15.2:0/949536400 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda9c156790 msgr2=0x7fda9c156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:08.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.745+0000 7fda99e00640 1 --2- 172.21.15.2:0/949536400 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda9c156790 0x7fda9c156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.745+0000 7fda99e00640 1 -- 172.21.15.2:0/949536400 >> v2:172.21.15.145:3300/0 conn(0x7fda9c0adde0 msgr2=0x7fda9c0b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:08.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.745+0000 7fda99e00640 1 --2- 172.21.15.2:0/949536400 >> v2:172.21.15.145:3300/0 conn(0x7fda9c0adde0 0x7fda9c0b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.745+0000 7fda99e00640 1 -- 172.21.15.2:0/949536400 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c0aeb40 con 0x7fda9c0b15d0 2024-08-17T02:24:08.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.746+0000 7fda99e00640 1 --2- 172.21.15.2:0/949536400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda9c0b15d0 0x7fda9c0b19a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fda9c06ba00 tx=0x7fda8c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a4e849d28c7a4f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:08.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.746+0000 7fda98a00640 1 -- 172.21.15.2:0/949536400 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c02add0 con 0x7fda9c0b15d0 2024-08-17T02:24:08.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.746+0000 7fda98a00640 1 -- 172.21.15.2:0/949536400 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c032440 con 0x7fda9c0b15d0 2024-08-17T02:24:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.746+0000 7fda98a00640 1 -- 172.21.15.2:0/949536400 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c032820 con 0x7fda9c0b15d0 2024-08-17T02:24:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.747+0000 7fdaa1000640 1 -- 172.21.15.2:0/949536400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda9c0b15d0 msgr2=0x7fda9c0b19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.747+0000 7fdaa1000640 1 --2- 172.21.15.2:0/949536400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda9c0b15d0 0x7fda9c0b19a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fda9c06ba00 tx=0x7fda8c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.747+0000 7fdaa1000640 1 -- 172.21.15.2:0/949536400 shutdown_connections 2024-08-17T02:24:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.747+0000 7fdaa1000640 1 --2- 172.21.15.2:0/949536400 >> v2:172.21.15.145:3300/0 conn(0x7fda9c0adde0 0x7fda9c0b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.747+0000 7fdaa1000640 1 --2- 172.21.15.2:0/949536400 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda9c156790 0x7fda9c156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.747+0000 7fdaa1000640 1 --2- 172.21.15.2:0/949536400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda9c0b15d0 0x7fda9c0b19a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.747+0000 7fdaa1000640 1 -- 172.21.15.2:0/949536400 >> 172.21.15.2:0/949536400 conn(0x7fda9c0ce5e0 msgr2=0x7fda9c095d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.747+0000 7fdaa1000640 1 -- 172.21.15.2:0/949536400 shutdown_connections 2024-08-17T02:24:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.747+0000 7fdaa1000640 1 -- 172.21.15.2:0/949536400 wait complete. 2024-08-17T02:24:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.748+0000 7fdaa1000640 1 Processor -- start 2024-08-17T02:24:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.749+0000 7fdaa1000640 1 -- start start 2024-08-17T02:24:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.749+0000 7fdaa1000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda9c0adde0 0x7fda9c0ac3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.749+0000 7fdaa1000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda9c0b15d0 0x7fda9c098d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.749+0000 7fdaa1000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda9c156790 0x7fda9c166940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.749+0000 7fdaa1000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0a8cf0 con 0x7fda9c0adde0 2024-08-17T02:24:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.749+0000 7fdaa1000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c167240 con 0x7fda9c156790 2024-08-17T02:24:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.749+0000 7fdaa1000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c167520 con 0x7fda9c0b15d0 2024-08-17T02:24:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.750+0000 7fda99e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda9c0adde0 0x7fda9c0ac3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.750+0000 7fda99e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda9c0adde0 0x7fda9c0ac3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48718/0 (socket says 172.21.15.2:48718) 2024-08-17T02:24:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.750+0000 7fda99e00640 1 -- 172.21.15.2:0/2461560451 learned_addr learned my addr 172.21.15.2:0/2461560451 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.750+0000 7fda9a800640 1 --2- 172.21.15.2:0/2461560451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda9c156790 0x7fda9c166940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.750+0000 7fda99400640 1 --2- 172.21.15.2:0/2461560451 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda9c0b15d0 0x7fda9c098d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.750+0000 7fda99e00640 1 -- 172.21.15.2:0/2461560451 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda9c0b15d0 msgr2=0x7fda9c098d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.750+0000 7fda99e00640 1 --2- 172.21.15.2:0/2461560451 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda9c0b15d0 0x7fda9c098d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.750+0000 7fda99e00640 1 -- 172.21.15.2:0/2461560451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda9c156790 msgr2=0x7fda9c166940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.750+0000 7fda99e00640 1 --2- 172.21.15.2:0/2461560451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda9c156790 0x7fda9c166940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.750+0000 7fda99e00640 1 -- 172.21.15.2:0/2461560451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c009450 con 0x7fda9c0adde0 2024-08-17T02:24:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.750+0000 7fda99e00640 1 --2- 172.21.15.2:0/2461560451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda9c0adde0 0x7fda9c0ac3f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fda8c009210 tx=0x7fda8c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:08.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.751+0000 7fda91600640 1 -- 172.21.15.2:0/2461560451 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c031ae0 con 0x7fda9c0adde0 2024-08-17T02:24:08.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.751+0000 7fda91600640 1 -- 172.21.15.2:0/2461560451 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c031c60 con 0x7fda9c0adde0 2024-08-17T02:24:08.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.751+0000 7fdaa1000640 1 -- 172.21.15.2:0/2461560451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c167800 con 0x7fda9c0adde0 2024-08-17T02:24:08.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.751+0000 7fda91600640 1 -- 172.21.15.2:0/2461560451 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c03d670 con 0x7fda9c0adde0 2024-08-17T02:24:08.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.751+0000 7fdaa1000640 1 -- 172.21.15.2:0/2461560451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c0992c0 con 0x7fda9c0adde0 2024-08-17T02:24:08.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.752+0000 7fdaa1000640 1 -- 172.21.15.2:0/2461560451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c063fb0 con 0x7fda9c0adde0 2024-08-17T02:24:08.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.752+0000 7fda91600640 1 -- 172.21.15.2:0/2461560451 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fda8c039040 con 0x7fda9c0adde0 2024-08-17T02:24:08.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.753+0000 7fda91600640 1 --2- 172.21.15.2:0/2461560451 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fda7c065150 0x7fda7c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.753+0000 7fda91600640 1 -- 172.21.15.2:0/2461560451 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fda8c0a2510 con 0x7fda9c0adde0 2024-08-17T02:24:08.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.754+0000 7fda99400640 1 --2- 172.21.15.2:0/2461560451 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fda7c065150 0x7fda7c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.755+0000 7fda99400640 1 --2- 172.21.15.2:0/2461560451 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fda7c065150 0x7fda7c067600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fda9c09ba00 tx=0x7fda88008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:08.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.758+0000 7fda91600640 1 -- 172.21.15.2:0/2461560451 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fda8c0705f0 con 0x7fda9c0adde0 2024-08-17T02:24:08.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.938+0000 7fdaa1000640 1 -- 172.21.15.2:0/2461560451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda9c096d00 con 0x7fda9c0adde0 2024-08-17T02:24:08.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.939+0000 7fda91600640 1 -- 172.21.15.2:0/2461560451 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fda8c073c10 con 0x7fda9c0adde0 2024-08-17T02:24:08.941 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:24:08.942 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:23:32.955197+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:29.708835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:30.361908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:08.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.941+0000 7fdaa1000640 1 -- 172.21.15.2:0/2461560451 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fda7c065150 msgr2=0x7fda7c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.941+0000 7fdaa1000640 1 --2- 172.21.15.2:0/2461560451 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fda7c065150 0x7fda7c067600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fda9c09ba00 tx=0x7fda88008040 comp rx=0 tx=0).stop 2024-08-17T02:24:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.941+0000 7fdaa1000640 1 -- 172.21.15.2:0/2461560451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda9c0adde0 msgr2=0x7fda9c0ac3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.941+0000 7fdaa1000640 1 --2- 172.21.15.2:0/2461560451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda9c0adde0 0x7fda9c0ac3f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fda8c009210 tx=0x7fda8c032000 comp rx=0 tx=0).stop 2024-08-17T02:24:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.941+0000 7fdaa1000640 1 -- 172.21.15.2:0/2461560451 shutdown_connections 2024-08-17T02:24:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.941+0000 7fdaa1000640 1 --2- 172.21.15.2:0/2461560451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda9c156790 0x7fda9c166940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.941+0000 7fdaa1000640 1 --2- 172.21.15.2:0/2461560451 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fda7c065150 0x7fda7c067600 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.941+0000 7fdaa1000640 1 --2- 172.21.15.2:0/2461560451 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda9c0b15d0 0x7fda9c098d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.941+0000 7fdaa1000640 1 --2- 172.21.15.2:0/2461560451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda9c0adde0 0x7fda9c0ac3f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.941+0000 7fdaa1000640 1 -- 172.21.15.2:0/2461560451 >> 172.21.15.2:0/2461560451 conn(0x7fda9c0ce5e0 msgr2=0x7fda9c155cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.942+0000 7fdaa1000640 1 -- 172.21.15.2:0/2461560451 shutdown_connections 2024-08-17T02:24:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:08.942+0000 7fdaa1000640 1 -- 172.21.15.2:0/2461560451 wait complete. 2024-08-17T02:24:08.958 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:23:26.107978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:23:29.708835+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:23:30.361908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:24:08.959 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:24:09.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.113+0000 7f8374c00640 1 Processor -- start 2024-08-17T02:24:09.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.113+0000 7f8374c00640 1 -- start start 2024-08-17T02:24:09.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.114+0000 7f8374c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83700b1280 0x7f83700c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:09.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.114+0000 7f8374c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f83700adf90 0x7f83700ca420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:09.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.114+0000 7f8374c00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83700ac040 con 0x7f8370156bd0 2024-08-17T02:24:09.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.114+0000 7f8374c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8370067810 con 0x7f83700adf90 2024-08-17T02:24:09.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.114+0000 7f8374c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83700ab150 con 0x7f83700b1280 2024-08-17T02:24:09.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.114+0000 7f836e800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f83700adf90 0x7f83700ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:09.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.114+0000 7f836e800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f83700adf90 0x7f83700ca420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48732/0 (socket says 172.21.15.2:48732) 2024-08-17T02:24:09.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.114+0000 7f836e800640 1 -- 172.21.15.2:0/632942498 learned_addr learned my addr 172.21.15.2:0/632942498 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:09.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.115+0000 7f8367e00640 1 --2- 172.21.15.2:0/632942498 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83700b1280 0x7f83700c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:09.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.115+0000 7f836e800640 1 -- 172.21.15.2:0/632942498 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83700b1280 msgr2=0x7f83700c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:09.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.115+0000 7f836e800640 1 --2- 172.21.15.2:0/632942498 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83700b1280 0x7f83700c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.115+0000 7f836e800640 1 -- 172.21.15.2:0/632942498 >> v1:172.21.15.145:6789/0 conn(0x7f8370156bd0 legacy=0x7f83700b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:09.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.115+0000 7f836e800640 1 -- 172.21.15.2:0/632942498 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83700ab430 con 0x7f83700adf90 2024-08-17T02:24:09.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.115+0000 7f836d400640 1 -- 172.21.15.2:0/632942498 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3788196870 0 0) 0x7f83700ac040 con 0x7f8370156bd0 2024-08-17T02:24:09.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.115+0000 7f8367e00640 1 --2- 172.21.15.2:0/632942498 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83700b1280 0x7f83700c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:09.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.116+0000 7f836e800640 1 --2- 172.21.15.2:0/632942498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83700adf90 0x7f83700ca420 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8368009f20 tx=0x7f8368009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02bf9546d50186b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:09.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.116+0000 7f836d400640 1 -- 172.21.15.2:0/632942498 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368031400 con 0x7f83700adf90 2024-08-17T02:24:09.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.116+0000 7f836d400640 1 -- 172.21.15.2:0/632942498 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836802d050 con 0x7f83700adf90 2024-08-17T02:24:09.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.116+0000 7f836d400640 1 -- 172.21.15.2:0/632942498 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368031790 con 0x7f83700adf90 2024-08-17T02:24:09.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.117+0000 7f8374c00640 1 -- 172.21.15.2:0/632942498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83700adf90 msgr2=0x7f83700ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:09.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.117+0000 7f8374c00640 1 --2- 172.21.15.2:0/632942498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83700adf90 0x7f83700ca420 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8368009f20 tx=0x7f8368009840 comp rx=0 tx=0).stop 2024-08-17T02:24:09.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.117+0000 7f8374c00640 1 -- 172.21.15.2:0/632942498 shutdown_connections 2024-08-17T02:24:09.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.117+0000 7f8374c00640 1 --2- 172.21.15.2:0/632942498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83700adf90 0x7f83700ca420 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.117+0000 7f8374c00640 1 --2- 172.21.15.2:0/632942498 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83700b1280 0x7f83700c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.117+0000 7f8374c00640 1 -- 172.21.15.2:0/632942498 >> 172.21.15.2:0/632942498 conn(0x7f83700cc390 msgr2=0x7f8370066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:09.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.117+0000 7f8374c00640 1 -- 172.21.15.2:0/632942498 shutdown_connections 2024-08-17T02:24:09.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.117+0000 7f8374c00640 1 -- 172.21.15.2:0/632942498 wait complete. 2024-08-17T02:24:09.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.118+0000 7f8374c00640 1 Processor -- start 2024-08-17T02:24:09.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.118+0000 7f8374c00640 1 -- start start 2024-08-17T02:24:09.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.119+0000 7f8374c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83700adf90 0x7f8370156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:09.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.119+0000 7f8374c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83700b1280 0x7f837015bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.119+0000 7f8374c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8370156bd0 0x7f8370153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.119+0000 7f8374c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8370157660 con 0x7f8370156bd0 2024-08-17T02:24:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.119+0000 7f8374c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8370157940 con 0x7f83700adf90 2024-08-17T02:24:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.119+0000 7f8374c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8370157c20 con 0x7f83700b1280 2024-08-17T02:24:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.120+0000 7f836e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8370156bd0 0x7f8370153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.120+0000 7f836e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8370156bd0 0x7f8370153410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48746/0 (socket says 172.21.15.2:48746) 2024-08-17T02:24:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.120+0000 7f836e800640 1 -- 172.21.15.2:0/3336641267 learned_addr learned my addr 172.21.15.2:0/3336641267 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.120+0000 7f8367e00640 1 --2- 172.21.15.2:0/3336641267 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83700b1280 0x7f837015bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.120+0000 7f836de00640 1 --2- 172.21.15.2:0/3336641267 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83700adf90 0x7f8370156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.120+0000 7f836e800640 1 -- 172.21.15.2:0/3336641267 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83700b1280 msgr2=0x7f837015bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.120+0000 7f836e800640 1 --2- 172.21.15.2:0/3336641267 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83700b1280 0x7f837015bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.120+0000 7f836e800640 1 -- 172.21.15.2:0/3336641267 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83700adf90 msgr2=0x7f8370156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:09.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.120+0000 7f836e800640 1 --2- 172.21.15.2:0/3336641267 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83700adf90 0x7f8370156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.120+0000 7f836e800640 1 -- 172.21.15.2:0/3336641267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8368009ae0 con 0x7f8370156bd0 2024-08-17T02:24:09.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.120+0000 7f836e800640 1 --2- 172.21.15.2:0/3336641267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8370156bd0 0x7f8370153410 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8368009f20 tx=0x7f8368036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:09.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.121+0000 7f8365600640 1 -- 172.21.15.2:0/3336641267 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368031ea0 con 0x7f8370156bd0 2024-08-17T02:24:09.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.121+0000 7f8365600640 1 -- 172.21.15.2:0/3336641267 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8368008ad0 con 0x7f8370156bd0 2024-08-17T02:24:09.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.121+0000 7f8365600640 1 -- 172.21.15.2:0/3336641267 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368008e90 con 0x7f8370156bd0 2024-08-17T02:24:09.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.121+0000 7f8374c00640 1 -- 172.21.15.2:0/3336641267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8370157f00 con 0x7f8370156bd0 2024-08-17T02:24:09.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.121+0000 7f8374c00640 1 -- 172.21.15.2:0/3336641267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8370153950 con 0x7f8370156bd0 2024-08-17T02:24:09.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.122+0000 7f8374c00640 1 -- 172.21.15.2:0/3336641267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8370063fb0 con 0x7f8370156bd0 2024-08-17T02:24:09.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.123+0000 7f8365600640 1 -- 172.21.15.2:0/3336641267 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8368038050 con 0x7f8370156bd0 2024-08-17T02:24:09.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.123+0000 7f8365600640 1 --2- 172.21.15.2:0/3336641267 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f834c065150 0x7f834c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:09.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.124+0000 7f8365600640 1 -- 172.21.15.2:0/3336641267 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f83680a3170 con 0x7f8370156bd0 2024-08-17T02:24:09.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.124+0000 7f836de00640 1 --2- 172.21.15.2:0/3336641267 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f834c065150 0x7f834c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:09.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.125+0000 7f836de00640 1 --2- 172.21.15.2:0/3336641267 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f834c065150 0x7f834c067600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8360007fd0 tx=0x7f8360007e30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:09.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.127+0000 7f8365600640 1 -- 172.21.15.2:0/3336641267 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8368071240 con 0x7f8370156bd0 2024-08-17T02:24:09.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.307+0000 7f8374c00640 1 -- 172.21.15.2:0/3336641267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8370069cf0 con 0x7f8370156bd0 2024-08-17T02:24:09.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.307+0000 7f8365600640 1 -- 172.21.15.2:0/3336641267 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8368033ed0 con 0x7f8370156bd0 2024-08-17T02:24:09.309 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-17T02:24:09.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.309+0000 7f8374c00640 1 -- 172.21.15.2:0/3336641267 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f834c065150 msgr2=0x7f834c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:09.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.309+0000 7f8374c00640 1 --2- 172.21.15.2:0/3336641267 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f834c065150 0x7f834c067600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8360007fd0 tx=0x7f8360007e30 comp rx=0 tx=0).stop 2024-08-17T02:24:09.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.309+0000 7f8374c00640 1 -- 172.21.15.2:0/3336641267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8370156bd0 msgr2=0x7f8370153410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:09.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.309+0000 7f8374c00640 1 --2- 172.21.15.2:0/3336641267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8370156bd0 0x7f8370153410 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8368009f20 tx=0x7f8368036000 comp rx=0 tx=0).stop 2024-08-17T02:24:09.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.309+0000 7f8374c00640 1 -- 172.21.15.2:0/3336641267 shutdown_connections 2024-08-17T02:24:09.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.309+0000 7f8374c00640 1 --2- 172.21.15.2:0/3336641267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8370156bd0 0x7f8370153410 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.309+0000 7f8374c00640 1 --2- 172.21.15.2:0/3336641267 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f834c065150 0x7f834c067600 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.309+0000 7f8374c00640 1 --2- 172.21.15.2:0/3336641267 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83700b1280 0x7f837015bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.309+0000 7f8374c00640 1 --2- 172.21.15.2:0/3336641267 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83700adf90 0x7f8370156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.309+0000 7f8374c00640 1 -- 172.21.15.2:0/3336641267 >> 172.21.15.2:0/3336641267 conn(0x7f83700cc390 msgr2=0x7f83700b0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:09.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.310+0000 7f8374c00640 1 -- 172.21.15.2:0/3336641267 shutdown_connections 2024-08-17T02:24:09.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.310+0000 7f8374c00640 1 -- 172.21.15.2:0/3336641267 wait complete. 2024-08-17T02:24:09.325 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:24:09.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.479+0000 7f6e5d000640 1 Processor -- start 2024-08-17T02:24:09.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.479+0000 7f6e5d000640 1 -- start start 2024-08-17T02:24:09.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.480+0000 7f6e5d000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6e581590b0 0x7f6e580b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:09.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.480+0000 7f6e5d000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6e580acf10 0x7f6e58159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:09.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.480+0000 7f6e5d000640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e5815a4e0 con 0x7f6e580afca0 2024-08-17T02:24:09.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.480+0000 7f6e5d000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e580b0980 con 0x7f6e581590b0 2024-08-17T02:24:09.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.480+0000 7f6e5d000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e580c92b0 con 0x7f6e580acf10 2024-08-17T02:24:09.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.481+0000 7f6e4fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6e581590b0 0x7f6e580b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:09.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.481+0000 7f6e4fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6e581590b0 0x7f6e580b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48758/0 (socket says 172.21.15.2:48758) 2024-08-17T02:24:09.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.481+0000 7f6e4fe00640 1 -- 172.21.15.2:0/3332798930 learned_addr learned my addr 172.21.15.2:0/3332798930 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:09.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.481+0000 7f6e55e00640 1 --1- 172.21.15.2:0/3332798930 >> v1:172.21.15.145:6789/0 conn(0x7f6e580afca0 0x7f6e581589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:59128/0 (socket says 172.21.15.2:59128) 2024-08-17T02:24:09.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.481+0000 7f6e56800640 1 --2- 172.21.15.2:0/3332798930 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6e580acf10 0x7f6e58159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:09.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.481+0000 7f6e4fe00640 1 -- 172.21.15.2:0/3332798930 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6e580acf10 msgr2=0x7f6e58159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:09.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.481+0000 7f6e4fe00640 1 --2- 172.21.15.2:0/3332798930 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6e580acf10 0x7f6e58159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.481+0000 7f6e4fe00640 1 -- 172.21.15.2:0/3332798930 >> v1:172.21.15.145:6789/0 conn(0x7f6e580afca0 legacy=0x7f6e581589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:09.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.481+0000 7f6e4fe00640 1 -- 172.21.15.2:0/3332798930 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e580ad480 con 0x7f6e581590b0 2024-08-17T02:24:09.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.481+0000 7f6e55400640 1 -- 172.21.15.2:0/3332798930 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914821491 0 0) 0x7f6e48001110 con 0x7f6e580afca0 2024-08-17T02:24:09.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.482+0000 7f6e4fe00640 1 --2- 172.21.15.2:0/3332798930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e581590b0 0x7f6e580b0070 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6e40009910 tx=0x7f6e400091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b612997ca5eddb70 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:09.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.483+0000 7f6e55400640 1 -- 172.21.15.2:0/3332798930 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4002ae40 con 0x7f6e581590b0 2024-08-17T02:24:09.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.483+0000 7f6e55400640 1 -- 172.21.15.2:0/3332798930 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e40032440 con 0x7f6e581590b0 2024-08-17T02:24:09.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.483+0000 7f6e55400640 1 -- 172.21.15.2:0/3332798930 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e400327e0 con 0x7f6e581590b0 2024-08-17T02:24:09.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.483+0000 7f6e5d000640 1 -- 172.21.15.2:0/3332798930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e581590b0 msgr2=0x7f6e580b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:09.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.483+0000 7f6e5d000640 1 --2- 172.21.15.2:0/3332798930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e581590b0 0x7f6e580b0070 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6e40009910 tx=0x7f6e400091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.483+0000 7f6e5d000640 1 -- 172.21.15.2:0/3332798930 shutdown_connections 2024-08-17T02:24:09.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.483+0000 7f6e5d000640 1 --2- 172.21.15.2:0/3332798930 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6e580acf10 0x7f6e58159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.483+0000 7f6e5d000640 1 --2- 172.21.15.2:0/3332798930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e581590b0 0x7f6e580b0070 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.483+0000 7f6e5d000640 1 -- 172.21.15.2:0/3332798930 >> 172.21.15.2:0/3332798930 conn(0x7f6e58066e60 msgr2=0x7f6e58067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:09.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.483+0000 7f6e5d000640 1 -- 172.21.15.2:0/3332798930 shutdown_connections 2024-08-17T02:24:09.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.483+0000 7f6e5d000640 1 -- 172.21.15.2:0/3332798930 wait complete. 2024-08-17T02:24:09.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.485+0000 7f6e5d000640 1 Processor -- start 2024-08-17T02:24:09.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.485+0000 7f6e5d000640 1 -- start start 2024-08-17T02:24:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.487+0000 7f6e5d000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6e580acf10 0x7f6e58168fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.487+0000 7f6e5d000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e580afca0 0x7f6e580aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.487+0000 7f6e5d000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e581590b0 0x7f6e58150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.487+0000 7f6e5d000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5816d520 con 0x7f6e581590b0 2024-08-17T02:24:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.487+0000 7f6e5d000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5816d240 con 0x7f6e580afca0 2024-08-17T02:24:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.487+0000 7f6e5d000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e580c5340 con 0x7f6e580acf10 2024-08-17T02:24:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.487+0000 7f6e56800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e581590b0 0x7f6e58150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.487+0000 7f6e56800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e581590b0 0x7f6e58150fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48768/0 (socket says 172.21.15.2:48768) 2024-08-17T02:24:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.487+0000 7f6e56800640 1 -- 172.21.15.2:0/845510583 learned_addr learned my addr 172.21.15.2:0/845510583 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.487+0000 7f6e55e00640 1 --2- 172.21.15.2:0/845510583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6e580acf10 0x7f6e58168fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.487+0000 7f6e4fe00640 1 --2- 172.21.15.2:0/845510583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e580afca0 0x7f6e580aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.487+0000 7f6e56800640 1 -- 172.21.15.2:0/845510583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6e580acf10 msgr2=0x7f6e58168fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.487+0000 7f6e56800640 1 --2- 172.21.15.2:0/845510583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6e580acf10 0x7f6e58168fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.487+0000 7f6e56800640 1 -- 172.21.15.2:0/845510583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e580afca0 msgr2=0x7f6e580aeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.487+0000 7f6e56800640 1 --2- 172.21.15.2:0/845510583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e580afca0 0x7f6e580aeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.487+0000 7f6e56800640 1 -- 172.21.15.2:0/845510583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e40009450 con 0x7f6e581590b0 2024-08-17T02:24:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.487+0000 7f6e55e00640 1 --2- 172.21.15.2:0/845510583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6e580acf10 0x7f6e58168fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:09.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.487+0000 7f6e4fe00640 1 --2- 172.21.15.2:0/845510583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e580afca0 0x7f6e580aeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:09.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.487+0000 7f6e56800640 1 --2- 172.21.15.2:0/845510583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e581590b0 0x7f6e58150fe0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6e50009ef0 tx=0x7f6e5000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:09.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.487+0000 7f6e4d600640 1 -- 172.21.15.2:0/845510583 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5000ce10 con 0x7f6e581590b0 2024-08-17T02:24:09.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.487+0000 7f6e4d600640 1 -- 172.21.15.2:0/845510583 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5000f040 con 0x7f6e581590b0 2024-08-17T02:24:09.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.487+0000 7f6e4d600640 1 -- 172.21.15.2:0/845510583 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e500146d0 con 0x7f6e581590b0 2024-08-17T02:24:09.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.487+0000 7f6e5d000640 1 -- 172.21.15.2:0/845510583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e580c5620 con 0x7f6e581590b0 2024-08-17T02:24:09.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.487+0000 7f6e5d000640 1 -- 172.21.15.2:0/845510583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e58169520 con 0x7f6e581590b0 2024-08-17T02:24:09.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.488+0000 7f6e5d000640 1 -- 172.21.15.2:0/845510583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e58063fb0 con 0x7f6e581590b0 2024-08-17T02:24:09.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.489+0000 7f6e4d600640 1 -- 172.21.15.2:0/845510583 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6e50014a80 con 0x7f6e581590b0 2024-08-17T02:24:09.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.490+0000 7f6e4d600640 1 --2- 172.21.15.2:0/845510583 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6e34065180 0x7f6e34067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:09.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.490+0000 7f6e4d600640 1 -- 172.21.15.2:0/845510583 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6e500832c0 con 0x7f6e581590b0 2024-08-17T02:24:09.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.490+0000 7f6e55e00640 1 --2- 172.21.15.2:0/845510583 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6e34065180 0x7f6e34067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:09.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.491+0000 7f6e55e00640 1 --2- 172.21.15.2:0/845510583 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6e34065180 0x7f6e34067630 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6e480074b0 tx=0x7f6e480079b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:09.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.494+0000 7f6e4d600640 1 -- 172.21.15.2:0/845510583 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6e500512e0 con 0x7f6e581590b0 2024-08-17T02:24:09.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.678+0000 7f6e5d000640 1 -- 172.21.15.2:0/845510583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6e58067b70 con 0x7f6e581590b0 2024-08-17T02:24:09.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.678+0000 7f6e4d600640 1 -- 172.21.15.2:0/845510583 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6e50054900 con 0x7f6e581590b0 2024-08-17T02:24:09.679 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:24:09.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.680+0000 7f6e5d000640 1 -- 172.21.15.2:0/845510583 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6e34065180 msgr2=0x7f6e34067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:09.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.680+0000 7f6e5d000640 1 --2- 172.21.15.2:0/845510583 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6e34065180 0x7f6e34067630 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6e480074b0 tx=0x7f6e480079b0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.680+0000 7f6e5d000640 1 -- 172.21.15.2:0/845510583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e581590b0 msgr2=0x7f6e58150fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:09.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.680+0000 7f6e5d000640 1 --2- 172.21.15.2:0/845510583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e581590b0 0x7f6e58150fe0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6e50009ef0 tx=0x7f6e5000b040 comp rx=0 tx=0).stop 2024-08-17T02:24:09.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.680+0000 7f6e5d000640 1 -- 172.21.15.2:0/845510583 shutdown_connections 2024-08-17T02:24:09.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.680+0000 7f6e5d000640 1 --2- 172.21.15.2:0/845510583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e581590b0 0x7f6e58150fe0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.680+0000 7f6e5d000640 1 --2- 172.21.15.2:0/845510583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e580afca0 0x7f6e580aeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.680+0000 7f6e5d000640 1 --2- 172.21.15.2:0/845510583 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6e34065180 0x7f6e34067630 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.680+0000 7f6e5d000640 1 --2- 172.21.15.2:0/845510583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6e580acf10 0x7f6e58168fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.680+0000 7f6e5d000640 1 -- 172.21.15.2:0/845510583 >> 172.21.15.2:0/845510583 conn(0x7f6e58066e60 msgr2=0x7f6e58067440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:09.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.680+0000 7f6e5d000640 1 -- 172.21.15.2:0/845510583 shutdown_connections 2024-08-17T02:24:09.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.680+0000 7f6e5d000640 1 -- 172.21.15.2:0/845510583 wait complete. 2024-08-17T02:24:09.698 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:24:09.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.852+0000 7fa12c400640 1 Processor -- start 2024-08-17T02:24:09.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.852+0000 7fa12c400640 1 -- start start 2024-08-17T02:24:09.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.852+0000 7fa12c400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa1241590b0 0x7fa1240b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:09.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.852+0000 7fa12c400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa1240acf10 0x7fa124159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:09.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.852+0000 7fa12c400640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa12415a4e0 con 0x7fa1240afca0 2024-08-17T02:24:09.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.852+0000 7fa12c400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1240b0980 con 0x7fa1241590b0 2024-08-17T02:24:09.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.852+0000 7fa12c400640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1240c92b0 con 0x7fa1240acf10 2024-08-17T02:24:09.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.852+0000 7fa129000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa1241590b0 0x7fa1240b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:09.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.852+0000 7fa129000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa1241590b0 0x7fa1240b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48778/0 (socket says 172.21.15.2:48778) 2024-08-17T02:24:09.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.852+0000 7fa129000640 1 -- 172.21.15.2:0/2564446268 learned_addr learned my addr 172.21.15.2:0/2564446268 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:09.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.852+0000 7fa12a400640 1 --2- 172.21.15.2:0/2564446268 >> v2:172.21.15.145:3300/0 conn(0x7fa1240acf10 0x7fa124159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.853+0000 7fa129000640 1 -- 172.21.15.2:0/2564446268 >> v2:172.21.15.145:3300/0 conn(0x7fa1240acf10 msgr2=0x7fa124159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.853+0000 7fa129000640 1 --2- 172.21.15.2:0/2564446268 >> v2:172.21.15.145:3300/0 conn(0x7fa1240acf10 0x7fa124159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.853+0000 7fa129000640 1 -- 172.21.15.2:0/2564446268 >> v1:172.21.15.145:6789/0 conn(0x7fa1240afca0 legacy=0x7fa1241589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.853+0000 7fa129000640 1 -- 172.21.15.2:0/2564446268 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1240ad480 con 0x7fa1241590b0 2024-08-17T02:24:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.854+0000 7fa129000640 1 --2- 172.21.15.2:0/2564446268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1241590b0 0x7fa1240b0070 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa1240cb4a0 tx=0x7fa1100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437012e95813fe1f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.854+0000 7fa123e00640 1 -- 172.21.15.2:0/2564446268 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11002ae80 con 0x7fa1241590b0 2024-08-17T02:24:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.854+0000 7fa123e00640 1 -- 172.21.15.2:0/2564446268 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa110032440 con 0x7fa1241590b0 2024-08-17T02:24:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.854+0000 7fa123e00640 1 -- 172.21.15.2:0/2564446268 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa110032800 con 0x7fa1241590b0 2024-08-17T02:24:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.855+0000 7fa12c400640 1 -- 172.21.15.2:0/2564446268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1241590b0 msgr2=0x7fa1240b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:09.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.855+0000 7fa12c400640 1 --2- 172.21.15.2:0/2564446268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1241590b0 0x7fa1240b0070 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa1240cb4a0 tx=0x7fa1100091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.855+0000 7fa12c400640 1 -- 172.21.15.2:0/2564446268 shutdown_connections 2024-08-17T02:24:09.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.855+0000 7fa12c400640 1 --2- 172.21.15.2:0/2564446268 >> v2:172.21.15.145:3300/0 conn(0x7fa1240acf10 0x7fa124159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.855+0000 7fa12c400640 1 --2- 172.21.15.2:0/2564446268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1241590b0 0x7fa1240b0070 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.855+0000 7fa12c400640 1 -- 172.21.15.2:0/2564446268 >> 172.21.15.2:0/2564446268 conn(0x7fa124066e60 msgr2=0x7fa124067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:09.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.855+0000 7fa12c400640 1 -- 172.21.15.2:0/2564446268 shutdown_connections 2024-08-17T02:24:09.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.855+0000 7fa12c400640 1 -- 172.21.15.2:0/2564446268 wait complete. 2024-08-17T02:24:09.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.856+0000 7fa12c400640 1 Processor -- start 2024-08-17T02:24:09.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.856+0000 7fa12c400640 1 -- start start 2024-08-17T02:24:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.857+0000 7fa12c400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1240acf10 0x7fa12415a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.857+0000 7fa12c400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa1240afca0 0x7fa124146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.857+0000 7fa12c400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa1241590b0 0x7fa124148e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.857+0000 7fa12c400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12414d110 con 0x7fa1240acf10 2024-08-17T02:24:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.857+0000 7fa12c400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12415afd0 con 0x7fa1240afca0 2024-08-17T02:24:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.857+0000 7fa12c400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12415b2b0 con 0x7fa1241590b0 2024-08-17T02:24:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.857+0000 7fa129a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1240acf10 0x7fa12415a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.858+0000 7fa129a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1240acf10 0x7fa12415a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48794/0 (socket says 172.21.15.2:48794) 2024-08-17T02:24:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.858+0000 7fa129a00640 1 -- 172.21.15.2:0/1205960771 learned_addr learned my addr 172.21.15.2:0/1205960771 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.858+0000 7fa129000640 1 --2- 172.21.15.2:0/1205960771 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa1240afca0 0x7fa124146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:09.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.858+0000 7fa12a400640 1 --2- 172.21.15.2:0/1205960771 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa1241590b0 0x7fa124148e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:09.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.858+0000 7fa129a00640 1 -- 172.21.15.2:0/1205960771 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa1241590b0 msgr2=0x7fa124148e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:09.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.858+0000 7fa129a00640 1 --2- 172.21.15.2:0/1205960771 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa1241590b0 0x7fa124148e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.858+0000 7fa129a00640 1 -- 172.21.15.2:0/1205960771 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa1240afca0 msgr2=0x7fa124146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:09.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.858+0000 7fa129a00640 1 --2- 172.21.15.2:0/1205960771 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa1240afca0 0x7fa124146320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.858+0000 7fa129a00640 1 -- 172.21.15.2:0/1205960771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa110009450 con 0x7fa1240acf10 2024-08-17T02:24:09.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.858+0000 7fa129a00640 1 --2- 172.21.15.2:0/1205960771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1240acf10 0x7fa12415a6d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa11800c560 tx=0x7fa118007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:09.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.858+0000 7fa120c00640 1 -- 172.21.15.2:0/1205960771 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa118011590 con 0x7fa1240acf10 2024-08-17T02:24:09.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.859+0000 7fa120c00640 1 -- 172.21.15.2:0/1205960771 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa118011710 con 0x7fa1240acf10 2024-08-17T02:24:09.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.859+0000 7fa120c00640 1 -- 172.21.15.2:0/1205960771 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa118011ad0 con 0x7fa1240acf10 2024-08-17T02:24:09.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.859+0000 7fa12c400640 1 -- 172.21.15.2:0/1205960771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa12414d3b0 con 0x7fa1240acf10 2024-08-17T02:24:09.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.859+0000 7fa12c400640 1 -- 172.21.15.2:0/1205960771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa12415ac10 con 0x7fa1240acf10 2024-08-17T02:24:09.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.860+0000 7fa12c400640 1 -- 172.21.15.2:0/1205960771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa12415b4d0 con 0x7fa1240acf10 2024-08-17T02:24:09.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.860+0000 7fa120c00640 1 -- 172.21.15.2:0/1205960771 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa11801b3b0 con 0x7fa1240acf10 2024-08-17T02:24:09.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.861+0000 7fa120c00640 1 --2- 172.21.15.2:0/1205960771 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa104065150 0x7fa104067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:09.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.861+0000 7fa120c00640 1 -- 172.21.15.2:0/1205960771 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa1180817e0 con 0x7fa1240acf10 2024-08-17T02:24:09.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.862+0000 7fa129000640 1 --2- 172.21.15.2:0/1205960771 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa104065150 0x7fa104067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:09.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.863+0000 7fa129000640 1 --2- 172.21.15.2:0/1205960771 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa104065150 0x7fa104067600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa110034000 tx=0x7fa110032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:09.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:09.865+0000 7fa120c00640 1 -- 172.21.15.2:0/1205960771 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa12415b4d0 con 0x7fa1240acf10 2024-08-17T02:24:10.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.048+0000 7fa12c400640 1 -- 172.21.15.2:0/1205960771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa12415a4e0 con 0x7fa1240acf10 2024-08-17T02:24:10.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.048+0000 7fa120c00640 1 -- 172.21.15.2:0/1205960771 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa12415a4e0 con 0x7fa1240acf10 2024-08-17T02:24:10.049 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-08-17T02:24:10.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.050+0000 7fa12c400640 1 -- 172.21.15.2:0/1205960771 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa104065150 msgr2=0x7fa104067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.050+0000 7fa12c400640 1 --2- 172.21.15.2:0/1205960771 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa104065150 0x7fa104067600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa110034000 tx=0x7fa110032000 comp rx=0 tx=0).stop 2024-08-17T02:24:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.050+0000 7fa12c400640 1 -- 172.21.15.2:0/1205960771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1240acf10 msgr2=0x7fa12415a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.050+0000 7fa12c400640 1 --2- 172.21.15.2:0/1205960771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1240acf10 0x7fa12415a6d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa11800c560 tx=0x7fa118007ef0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.050+0000 7fa12c400640 1 -- 172.21.15.2:0/1205960771 shutdown_connections 2024-08-17T02:24:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.050+0000 7fa12c400640 1 --2- 172.21.15.2:0/1205960771 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa104065150 0x7fa104067600 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.050+0000 7fa12c400640 1 --2- 172.21.15.2:0/1205960771 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa1241590b0 0x7fa124148e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.050+0000 7fa12c400640 1 --2- 172.21.15.2:0/1205960771 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa1240afca0 0x7fa124146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.050+0000 7fa12c400640 1 --2- 172.21.15.2:0/1205960771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1240acf10 0x7fa12415a6d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.050+0000 7fa12c400640 1 -- 172.21.15.2:0/1205960771 >> 172.21.15.2:0/1205960771 conn(0x7fa124066e60 msgr2=0x7fa1241594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.050+0000 7fa12c400640 1 -- 172.21.15.2:0/1205960771 shutdown_connections 2024-08-17T02:24:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.050+0000 7fa12c400640 1 -- 172.21.15.2:0/1205960771 wait complete. 2024-08-17T02:24:10.067 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:24:10.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.218+0000 7fa238400640 1 Processor -- start 2024-08-17T02:24:10.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.218+0000 7fa238400640 1 -- start start 2024-08-17T02:24:10.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.219+0000 7fa238400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa230159100 0x7fa2300aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.219+0000 7fa238400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa230069d40 0x7fa2300af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.219+0000 7fa238400640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2300b14e0 con 0x7fa230067f70 2024-08-17T02:24:10.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.219+0000 7fa238400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa230069210 con 0x7fa230159100 2024-08-17T02:24:10.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.219+0000 7fa238400640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2300694f0 con 0x7fa230069d40 2024-08-17T02:24:10.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.219+0000 7fa235a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa230159100 0x7fa2300aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.219+0000 7fa235a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa230159100 0x7fa2300aeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48796/0 (socket says 172.21.15.2:48796) 2024-08-17T02:24:10.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.219+0000 7fa235a00640 1 -- 172.21.15.2:0/951109543 learned_addr learned my addr 172.21.15.2:0/951109543 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:10.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.219+0000 7fa235000640 1 --2- 172.21.15.2:0/951109543 >> v2:172.21.15.145:3300/0 conn(0x7fa230069d40 0x7fa2300af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.219+0000 7fa235a00640 1 -- 172.21.15.2:0/951109543 >> v2:172.21.15.145:3300/0 conn(0x7fa230069d40 msgr2=0x7fa2300af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:10.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.219+0000 7fa235a00640 1 --2- 172.21.15.2:0/951109543 >> v2:172.21.15.145:3300/0 conn(0x7fa230069d40 0x7fa2300af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.219+0000 7fa235a00640 1 -- 172.21.15.2:0/951109543 >> v1:172.21.15.145:6789/0 conn(0x7fa230067f70 legacy=0x7fa2300ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:10.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.219+0000 7fa235a00640 1 -- 172.21.15.2:0/951109543 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2300697d0 con 0x7fa230159100 2024-08-17T02:24:10.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.219+0000 7fa235000640 1 --2- 172.21.15.2:0/951109543 >> v2:172.21.15.145:3300/0 conn(0x7fa230069d40 0x7fa2300af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:10.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.220+0000 7fa235a00640 1 --2- 172.21.15.2:0/951109543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa230159100 0x7fa2300aeae0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa2300b3970 tx=0x7fa2240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c8669f8672f420 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:10.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.220+0000 7fa22fe00640 1 -- 172.21.15.2:0/951109543 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22402ad40 con 0x7fa230159100 2024-08-17T02:24:10.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.220+0000 7fa22fe00640 1 -- 172.21.15.2:0/951109543 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa224032440 con 0x7fa230159100 2024-08-17T02:24:10.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.220+0000 7fa22fe00640 1 -- 172.21.15.2:0/951109543 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22402aea0 con 0x7fa230159100 2024-08-17T02:24:10.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.221+0000 7fa238400640 1 -- 172.21.15.2:0/951109543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa230159100 msgr2=0x7fa2300aeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.221+0000 7fa238400640 1 --2- 172.21.15.2:0/951109543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa230159100 0x7fa2300aeae0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa2300b3970 tx=0x7fa2240091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.221+0000 7fa238400640 1 -- 172.21.15.2:0/951109543 shutdown_connections 2024-08-17T02:24:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.221+0000 7fa238400640 1 --2- 172.21.15.2:0/951109543 >> v2:172.21.15.145:3300/0 conn(0x7fa230069d40 0x7fa2300af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.221+0000 7fa238400640 1 --2- 172.21.15.2:0/951109543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa230159100 0x7fa2300aeae0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.221+0000 7fa238400640 1 -- 172.21.15.2:0/951109543 >> 172.21.15.2:0/951109543 conn(0x7fa2300ce5e0 msgr2=0x7fa230095d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.221+0000 7fa238400640 1 -- 172.21.15.2:0/951109543 shutdown_connections 2024-08-17T02:24:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.221+0000 7fa238400640 1 -- 172.21.15.2:0/951109543 wait complete. 2024-08-17T02:24:10.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.222+0000 7fa238400640 1 Processor -- start 2024-08-17T02:24:10.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.222+0000 7fa238400640 1 -- start start 2024-08-17T02:24:10.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.223+0000 7fa238400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa230067f70 0x7fa23015cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.223+0000 7fa238400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa230069d40 0x7fa2300c28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.223+0000 7fa238400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa230159100 0x7fa230144a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.223+0000 7fa238400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa230144f80 con 0x7fa230069d40 2024-08-17T02:24:10.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.223+0000 7fa238400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23015d370 con 0x7fa230159100 2024-08-17T02:24:10.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.223+0000 7fa238400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23015ea90 con 0x7fa230067f70 2024-08-17T02:24:10.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.223+0000 7fa235000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa230069d40 0x7fa2300c28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.223+0000 7fa235000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa230069d40 0x7fa2300c28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48810/0 (socket says 172.21.15.2:48810) 2024-08-17T02:24:10.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.223+0000 7fa235000640 1 -- 172.21.15.2:0/3990919318 learned_addr learned my addr 172.21.15.2:0/3990919318 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:10.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.223+0000 7fa235a00640 1 --2- 172.21.15.2:0/3990919318 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa230067f70 0x7fa23015cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.224+0000 7fa236400640 1 --2- 172.21.15.2:0/3990919318 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa230159100 0x7fa230144a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.224+0000 7fa235000640 1 -- 172.21.15.2:0/3990919318 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa230067f70 msgr2=0x7fa23015cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.224+0000 7fa235000640 1 --2- 172.21.15.2:0/3990919318 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa230067f70 0x7fa23015cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.224+0000 7fa235000640 1 -- 172.21.15.2:0/3990919318 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa230159100 msgr2=0x7fa230144a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.224+0000 7fa235000640 1 --2- 172.21.15.2:0/3990919318 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa230159100 0x7fa230144a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.224+0000 7fa235000640 1 -- 172.21.15.2:0/3990919318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa224009450 con 0x7fa230069d40 2024-08-17T02:24:10.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.224+0000 7fa236400640 1 --2- 172.21.15.2:0/3990919318 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa230159100 0x7fa230144a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:10.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.224+0000 7fa235000640 1 --2- 172.21.15.2:0/3990919318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa230069d40 0x7fa2300c28e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00c880 tx=0x7fa21c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:10.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.224+0000 7fa22cc00640 1 -- 172.21.15.2:0/3990919318 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c00ce10 con 0x7fa230069d40 2024-08-17T02:24:10.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.224+0000 7fa22cc00640 1 -- 172.21.15.2:0/3990919318 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21c007890 con 0x7fa230069d40 2024-08-17T02:24:10.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.224+0000 7fa22cc00640 1 -- 172.21.15.2:0/3990919318 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c007c10 con 0x7fa230069d40 2024-08-17T02:24:10.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.224+0000 7fa238400640 1 -- 172.21.15.2:0/3990919318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23015e160 con 0x7fa230069d40 2024-08-17T02:24:10.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.225+0000 7fa238400640 1 -- 172.21.15.2:0/3990919318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23015e720 con 0x7fa230069d40 2024-08-17T02:24:10.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.227+0000 7fa238400640 1 -- 172.21.15.2:0/3990919318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23015d500 con 0x7fa230069d40 2024-08-17T02:24:10.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.227+0000 7fa22cc00640 1 -- 172.21.15.2:0/3990919318 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa21c0113f0 con 0x7fa230069d40 2024-08-17T02:24:10.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.228+0000 7fa22cc00640 1 --2- 172.21.15.2:0/3990919318 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa210065150 0x7fa210067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.228+0000 7fa22cc00640 1 -- 172.21.15.2:0/3990919318 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa21c082420 con 0x7fa230069d40 2024-08-17T02:24:10.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.228+0000 7fa235a00640 1 --2- 172.21.15.2:0/3990919318 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa210065150 0x7fa210067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.230+0000 7fa235a00640 1 --2- 172.21.15.2:0/3990919318 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa210065150 0x7fa210067600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa224034000 tx=0x7fa224032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:10.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.232+0000 7fa22cc00640 1 -- 172.21.15.2:0/3990919318 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa21c053f80 con 0x7fa230069d40 2024-08-17T02:24:10.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.450+0000 7fa238400640 1 -- 172.21.15.2:0/3990919318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa230063fb0 con 0x7fa230069d40 2024-08-17T02:24:10.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.451+0000 7fa22cc00640 1 -- 172.21.15.2:0/3990919318 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7fa21c053b10 con 0x7fa230069d40 2024-08-17T02:24:10.451 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:24:10.451 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/88006300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":88006300},{"type":"v1","addr":"172.21.15.2:6835","nonce":88006300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3374741059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3374741059},{"type":"v1","addr":"172.21.15.2:6833","nonce":3374741059}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/3494373963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":3494373963},{"type":"v1","addr":"172.21.15.145:6837","nonce":3494373963}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:31.378654+0000","modified":"2024-08-17T02:23:34.968351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6836/3984927211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3984927211},{"type":"v1","addr":"172.21.15.145:6836","nonce":3984927211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:24:10.452 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2024-08-17T02:24:10.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.453+0000 7fa238400640 1 -- 172.21.15.2:0/3990919318 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa210065150 msgr2=0x7fa210067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.453+0000 7fa238400640 1 --2- 172.21.15.2:0/3990919318 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa210065150 0x7fa210067600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa224034000 tx=0x7fa224032000 comp rx=0 tx=0).stop 2024-08-17T02:24:10.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.453+0000 7fa238400640 1 -- 172.21.15.2:0/3990919318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa230069d40 msgr2=0x7fa2300c28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.453+0000 7fa238400640 1 --2- 172.21.15.2:0/3990919318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa230069d40 0x7fa2300c28e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00c880 tx=0x7fa21c008040 comp rx=0 tx=0).stop 2024-08-17T02:24:10.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.453+0000 7fa238400640 1 -- 172.21.15.2:0/3990919318 shutdown_connections 2024-08-17T02:24:10.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.453+0000 7fa238400640 1 --2- 172.21.15.2:0/3990919318 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa230159100 0x7fa230144a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.453+0000 7fa238400640 1 --2- 172.21.15.2:0/3990919318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa230069d40 0x7fa2300c28e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.453+0000 7fa238400640 1 --2- 172.21.15.2:0/3990919318 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa210065150 0x7fa210067600 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.453+0000 7fa238400640 1 --2- 172.21.15.2:0/3990919318 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa230067f70 0x7fa23015cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.453+0000 7fa238400640 1 -- 172.21.15.2:0/3990919318 >> 172.21.15.2:0/3990919318 conn(0x7fa2300ce5e0 msgr2=0x7fa2300b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:10.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.453+0000 7fa238400640 1 -- 172.21.15.2:0/3990919318 shutdown_connections 2024-08-17T02:24:10.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.453+0000 7fa238400640 1 -- 172.21.15.2:0/3990919318 wait complete. 2024-08-17T02:24:10.469 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:10.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.620+0000 7f3acf200640 1 Processor -- start 2024-08-17T02:24:10.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.621+0000 7f3acf200640 1 -- start start 2024-08-17T02:24:10.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.622+0000 7f3acf200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3ac8158bf0 0x7f3ac80af330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.622+0000 7f3acf200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ac80ac4b0 0x7f3ac8068770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.622+0000 7f3acf200640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ac80682e0 con 0x7f3ac80ae4a0 2024-08-17T02:24:10.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.622+0000 7f3acf200640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac80afca0 con 0x7f3ac8158bf0 2024-08-17T02:24:10.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.622+0000 7f3acf200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac80aff80 con 0x7f3ac80ac4b0 2024-08-17T02:24:10.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.622+0000 7f3ace800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ac80ac4b0 0x7f3ac8068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.622+0000 7f3acd400640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f3ac80ae4a0 0x7f3ac80abda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:59156/0 (socket says 172.21.15.2:59156) 2024-08-17T02:24:10.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.622+0000 7f3acd400640 1 -- 172.21.15.2:0/3515190811 learned_addr learned my addr 172.21.15.2:0/3515190811 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:10.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.622+0000 7f3acde00640 1 --2- 172.21.15.2:0/3515190811 >> v2:172.21.15.145:3300/0 conn(0x7f3ac8158bf0 0x7f3ac80af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.623+0000 7f3acde00640 1 -- 172.21.15.2:0/3515190811 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ac80ac4b0 msgr2=0x7f3ac8068770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:10.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.623+0000 7f3acde00640 1 --2- 172.21.15.2:0/3515190811 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ac80ac4b0 0x7f3ac8068770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.623+0000 7f3acde00640 1 -- 172.21.15.2:0/3515190811 >> v1:172.21.15.145:6789/0 conn(0x7f3ac80ae4a0 legacy=0x7f3ac80abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.623+0000 7f3acde00640 1 -- 172.21.15.2:0/3515190811 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac80b0260 con 0x7f3ac8158bf0 2024-08-17T02:24:10.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.623+0000 7f3ace800640 1 --2- 172.21.15.2:0/3515190811 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ac80ac4b0 0x7f3ac8068770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:10.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.624+0000 7f3acde00640 1 --2- 172.21.15.2:0/3515190811 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ac8158bf0 0x7f3ac80af330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009850 tx=0x7f3abc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90eac4bb868b30e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:10.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.624+0000 7f3acca00640 1 -- 172.21.15.2:0/3515190811 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc02ad90 con 0x7f3ac8158bf0 2024-08-17T02:24:10.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.624+0000 7f3acca00640 1 -- 172.21.15.2:0/3515190811 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3abc032440 con 0x7f3ac8158bf0 2024-08-17T02:24:10.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.624+0000 7f3acca00640 1 -- 172.21.15.2:0/3515190811 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc032820 con 0x7f3ac8158bf0 2024-08-17T02:24:10.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.625+0000 7f3acf200640 1 -- 172.21.15.2:0/3515190811 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ac8158bf0 msgr2=0x7f3ac80af330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.625+0000 7f3acf200640 1 --2- 172.21.15.2:0/3515190811 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ac8158bf0 0x7f3ac80af330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009850 tx=0x7f3abc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.625+0000 7f3acf200640 1 -- 172.21.15.2:0/3515190811 shutdown_connections 2024-08-17T02:24:10.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.625+0000 7f3acf200640 1 --2- 172.21.15.2:0/3515190811 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ac80ac4b0 0x7f3ac8068770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.625+0000 7f3acf200640 1 --2- 172.21.15.2:0/3515190811 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ac8158bf0 0x7f3ac80af330 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.625+0000 7f3acf200640 1 -- 172.21.15.2:0/3515190811 >> 172.21.15.2:0/3515190811 conn(0x7f3ac80ce420 msgr2=0x7f3ac8095d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:10.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.625+0000 7f3acf200640 1 -- 172.21.15.2:0/3515190811 shutdown_connections 2024-08-17T02:24:10.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.625+0000 7f3acf200640 1 -- 172.21.15.2:0/3515190811 wait complete. 2024-08-17T02:24:10.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.626+0000 7f3acf200640 1 Processor -- start 2024-08-17T02:24:10.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.627+0000 7f3acf200640 1 -- start start 2024-08-17T02:24:10.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.627+0000 7f3acf200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac80ac4b0 0x7f3ac80689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.627+0000 7f3acf200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ac80ae4a0 0x7f3ac8167ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.627+0000 7f3acf200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ac8158bf0 0x7f3ac8168220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.627+0000 7f3acf200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac80b36c0 con 0x7f3ac80ac4b0 2024-08-17T02:24:10.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.627+0000 7f3acf200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac816bf50 con 0x7f3ac8158bf0 2024-08-17T02:24:10.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.627+0000 7f3acf200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac816c230 con 0x7f3ac80ae4a0 2024-08-17T02:24:10.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.628+0000 7f3acde00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac80ac4b0 0x7f3ac80689a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.628+0000 7f3acde00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac80ac4b0 0x7f3ac80689a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48822/0 (socket says 172.21.15.2:48822) 2024-08-17T02:24:10.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.628+0000 7f3acde00640 1 -- 172.21.15.2:0/4270475935 learned_addr learned my addr 172.21.15.2:0/4270475935 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:10.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.628+0000 7f3acde00640 1 -- 172.21.15.2:0/4270475935 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ac80ae4a0 msgr2=0x7f3ac8167ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.628+0000 7f3acde00640 1 --2- 172.21.15.2:0/4270475935 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ac80ae4a0 0x7f3ac8167ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.628+0000 7f3acde00640 1 -- 172.21.15.2:0/4270475935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ac8158bf0 msgr2=0x7f3ac8168220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.628+0000 7f3acde00640 1 --2- 172.21.15.2:0/4270475935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ac8158bf0 0x7f3ac8168220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.628+0000 7f3acde00640 1 -- 172.21.15.2:0/4270475935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac4009a20 con 0x7f3ac80ac4b0 2024-08-17T02:24:10.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.628+0000 7f3acde00640 1 --2- 172.21.15.2:0/4270475935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac80ac4b0 0x7f3ac80689a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009360 tx=0x7f3abc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:10.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.629+0000 7f3ac1600640 1 -- 172.21.15.2:0/4270475935 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc000d10 con 0x7f3ac80ac4b0 2024-08-17T02:24:10.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.629+0000 7f3ac1600640 1 -- 172.21.15.2:0/4270475935 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3abc031de0 con 0x7f3ac80ac4b0 2024-08-17T02:24:10.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.629+0000 7f3ac1600640 1 -- 172.21.15.2:0/4270475935 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc03d670 con 0x7f3ac80ac4b0 2024-08-17T02:24:10.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.629+0000 7f3acf200640 1 -- 172.21.15.2:0/4270475935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3abc009390 con 0x7f3ac80ac4b0 2024-08-17T02:24:10.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.629+0000 7f3acf200640 1 -- 172.21.15.2:0/4270475935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac816c7f0 con 0x7f3ac80ac4b0 2024-08-17T02:24:10.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.630+0000 7f3acf200640 1 -- 172.21.15.2:0/4270475935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac816c9e0 con 0x7f3ac80ac4b0 2024-08-17T02:24:10.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.631+0000 7f3ac1600640 1 -- 172.21.15.2:0/4270475935 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3abc039040 con 0x7f3ac80ac4b0 2024-08-17T02:24:10.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.632+0000 7f3ac1600640 1 --2- 172.21.15.2:0/4270475935 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3aac065150 0x7f3aac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.632+0000 7f3ac1600640 1 -- 172.21.15.2:0/4270475935 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3abc0a23e0 con 0x7f3ac80ac4b0 2024-08-17T02:24:10.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.633+0000 7f3acd400640 1 --2- 172.21.15.2:0/4270475935 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3aac065150 0x7f3aac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.634+0000 7f3acd400640 1 --2- 172.21.15.2:0/4270475935 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3aac065150 0x7f3aac067600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80b26a0 tx=0x7f3ab8007aa0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:10.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.636+0000 7f3ac1600640 1 -- 172.21.15.2:0/4270475935 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3abc070400 con 0x7f3ac80ac4b0 2024-08-17T02:24:10.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.821+0000 7f3acf200640 1 -- 172.21.15.2:0/4270475935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ac81687c0 con 0x7f3ac80ac4b0 2024-08-17T02:24:10.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.822+0000 7f3ac1600640 1 -- 172.21.15.2:0/4270475935 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f3abc073a20 con 0x7f3ac80ac4b0 2024-08-17T02:24:10.822 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:24:10.822 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:23:32.955197+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:29.708835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:30.361908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:10.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.824+0000 7f3acf200640 1 -- 172.21.15.2:0/4270475935 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3aac065150 msgr2=0x7f3aac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.824+0000 7f3acf200640 1 --2- 172.21.15.2:0/4270475935 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3aac065150 0x7f3aac067600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80b26a0 tx=0x7f3ab8007aa0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.824+0000 7f3acf200640 1 -- 172.21.15.2:0/4270475935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac80ac4b0 msgr2=0x7f3ac80689a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.824+0000 7f3acf200640 1 --2- 172.21.15.2:0/4270475935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac80ac4b0 0x7f3ac80689a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009360 tx=0x7f3abc032000 comp rx=0 tx=0).stop 2024-08-17T02:24:10.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.824+0000 7f3acf200640 1 -- 172.21.15.2:0/4270475935 shutdown_connections 2024-08-17T02:24:10.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.824+0000 7f3acf200640 1 --2- 172.21.15.2:0/4270475935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ac8158bf0 0x7f3ac8168220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.824+0000 7f3acf200640 1 --2- 172.21.15.2:0/4270475935 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3aac065150 0x7f3aac067600 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.824+0000 7f3acf200640 1 --2- 172.21.15.2:0/4270475935 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ac80ae4a0 0x7f3ac8167ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.824+0000 7f3acf200640 1 --2- 172.21.15.2:0/4270475935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac80ac4b0 0x7f3ac80689a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.824+0000 7f3acf200640 1 -- 172.21.15.2:0/4270475935 >> 172.21.15.2:0/4270475935 conn(0x7f3ac80ce420 msgr2=0x7f3ac81560a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:10.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.824+0000 7f3acf200640 1 -- 172.21.15.2:0/4270475935 shutdown_connections 2024-08-17T02:24:10.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.824+0000 7f3acf200640 1 -- 172.21.15.2:0/4270475935 wait complete. 2024-08-17T02:24:10.839 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:24:10.840 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:24:10.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.993+0000 7f6f8c400640 1 Processor -- start 2024-08-17T02:24:10.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.993+0000 7f6f8c400640 1 -- start start 2024-08-17T02:24:10.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.994+0000 7f6f8c400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6f840afca0 0x7f6f840b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.994+0000 7f6f8c400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f841590b0 0x7f6f84159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.994+0000 7f6f8c400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f8415a4e0 con 0x7f6f840acf10 2024-08-17T02:24:10.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.994+0000 7f6f8c400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f840b0980 con 0x7f6f840afca0 2024-08-17T02:24:10.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.994+0000 7f6f8c400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840c92b0 con 0x7f6f841590b0 2024-08-17T02:24:10.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.994+0000 7f6f89a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6f840afca0 0x7f6f840b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.994+0000 7f6f89a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6f840afca0 0x7f6f840b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48830/0 (socket says 172.21.15.2:48830) 2024-08-17T02:24:10.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.994+0000 7f6f89a00640 1 -- 172.21.15.2:0/1496104495 learned_addr learned my addr 172.21.15.2:0/1496104495 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:10.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.995+0000 7f6f8a400640 1 --2- 172.21.15.2:0/1496104495 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f841590b0 0x7f6f84159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.995+0000 7f6f89a00640 1 -- 172.21.15.2:0/1496104495 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f841590b0 msgr2=0x7f6f84159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:10.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.995+0000 7f6f89a00640 1 --2- 172.21.15.2:0/1496104495 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f841590b0 0x7f6f84159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.995+0000 7f6f89a00640 1 -- 172.21.15.2:0/1496104495 >> v1:172.21.15.2:6789/0 conn(0x7f6f840acf10 legacy=0x7f6f841589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.995+0000 7f6f89a00640 1 -- 172.21.15.2:0/1496104495 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f840ad480 con 0x7f6f840afca0 2024-08-17T02:24:10.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.996+0000 7f6f89a00640 1 --2- 172.21.15.2:0/1496104495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f840afca0 0x7f6f840b0070 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6f78009910 tx=0x7f6f780091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6403617aa410523 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:10.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.996+0000 7f6f83e00640 1 -- 172.21.15.2:0/1496104495 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7802ae40 con 0x7f6f840afca0 2024-08-17T02:24:10.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.996+0000 7f6f83e00640 1 -- 172.21.15.2:0/1496104495 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f78032440 con 0x7f6f840afca0 2024-08-17T02:24:10.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.996+0000 7f6f83e00640 1 -- 172.21.15.2:0/1496104495 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f78032820 con 0x7f6f840afca0 2024-08-17T02:24:10.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.997+0000 7f6f8c400640 1 -- 172.21.15.2:0/1496104495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f840afca0 msgr2=0x7f6f840b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.997+0000 7f6f8c400640 1 --2- 172.21.15.2:0/1496104495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f840afca0 0x7f6f840b0070 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6f78009910 tx=0x7f6f780091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.997+0000 7f6f8c400640 1 -- 172.21.15.2:0/1496104495 shutdown_connections 2024-08-17T02:24:10.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.997+0000 7f6f8c400640 1 --2- 172.21.15.2:0/1496104495 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f841590b0 0x7f6f84159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.997+0000 7f6f8c400640 1 --2- 172.21.15.2:0/1496104495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f840afca0 0x7f6f840b0070 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.997+0000 7f6f8c400640 1 -- 172.21.15.2:0/1496104495 >> 172.21.15.2:0/1496104495 conn(0x7f6f84066e60 msgr2=0x7f6f84067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:10.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.997+0000 7f6f8c400640 1 -- 172.21.15.2:0/1496104495 shutdown_connections 2024-08-17T02:24:10.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.997+0000 7f6f8c400640 1 -- 172.21.15.2:0/1496104495 wait complete. 2024-08-17T02:24:11.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.998+0000 7f6f8c400640 1 Processor -- start 2024-08-17T02:24:11.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.998+0000 7f6f8c400640 1 -- start start 2024-08-17T02:24:11.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.999+0000 7f6f8c400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f840acf10 0x7f6f840c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.999+0000 7f6f8c400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f840afca0 0x7f6f84151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.999+0000 7f6f8c400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f841590b0 0x7f6f840c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.999+0000 7f6f8c400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8415b030 con 0x7f6f840afca0 2024-08-17T02:24:11.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.999+0000 7f6f8c400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f84158380 con 0x7f6f841590b0 2024-08-17T02:24:11.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.999+0000 7f6f8c400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840c56a0 con 0x7f6f840acf10 2024-08-17T02:24:11.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:10.999+0000 7f6f89000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f840afca0 0x7f6f84151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.000+0000 7f6f89000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f840afca0 0x7f6f84151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48832/0 (socket says 172.21.15.2:48832) 2024-08-17T02:24:11.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.000+0000 7f6f89000640 1 -- 172.21.15.2:0/3538693670 learned_addr learned my addr 172.21.15.2:0/3538693670 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:11.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.000+0000 7f6f89a00640 1 --2- 172.21.15.2:0/3538693670 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f840acf10 0x7f6f840c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.000+0000 7f6f8a400640 1 --2- 172.21.15.2:0/3538693670 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f841590b0 0x7f6f840c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.000+0000 7f6f89000640 1 -- 172.21.15.2:0/3538693670 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f840acf10 msgr2=0x7f6f840c4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.000+0000 7f6f89000640 1 --2- 172.21.15.2:0/3538693670 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f840acf10 0x7f6f840c4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.000+0000 7f6f89000640 1 -- 172.21.15.2:0/3538693670 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f841590b0 msgr2=0x7f6f840c75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.000+0000 7f6f89000640 1 --2- 172.21.15.2:0/3538693670 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f841590b0 0x7f6f840c75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.000+0000 7f6f89000640 1 -- 172.21.15.2:0/3538693670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f78009450 con 0x7f6f840afca0 2024-08-17T02:24:11.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.000+0000 7f6f89a00640 1 --2- 172.21.15.2:0/3538693670 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f840acf10 0x7f6f840c4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:11.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.000+0000 7f6f8a400640 1 --2- 172.21.15.2:0/3538693670 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f841590b0 0x7f6f840c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:11.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.000+0000 7f6f89000640 1 --2- 172.21.15.2:0/3538693670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f840afca0 0x7f6f84151c20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6f7000c560 tx=0x7f6f70007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:11.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.000+0000 7f6f80c00640 1 -- 172.21.15.2:0/3538693670 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f70011590 con 0x7f6f840afca0 2024-08-17T02:24:11.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.001+0000 7f6f80c00640 1 -- 172.21.15.2:0/3538693670 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f70011710 con 0x7f6f840afca0 2024-08-17T02:24:11.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.001+0000 7f6f80c00640 1 -- 172.21.15.2:0/3538693670 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f70011ad0 con 0x7f6f840afca0 2024-08-17T02:24:11.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.001+0000 7f6f8c400640 1 -- 172.21.15.2:0/3538693670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f840c5980 con 0x7f6f840afca0 2024-08-17T02:24:11.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.001+0000 7f6f8c400640 1 -- 172.21.15.2:0/3538693670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f84152160 con 0x7f6f840afca0 2024-08-17T02:24:11.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.002+0000 7f6f8c400640 1 -- 172.21.15.2:0/3538693670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8415b240 con 0x7f6f840afca0 2024-08-17T02:24:11.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.003+0000 7f6f80c00640 1 -- 172.21.15.2:0/3538693670 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6f7001b3b0 con 0x7f6f840afca0 2024-08-17T02:24:11.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.003+0000 7f6f80c00640 1 --2- 172.21.15.2:0/3538693670 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6f64065150 0x7f6f64067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.004+0000 7f6f80c00640 1 -- 172.21.15.2:0/3538693670 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6f70081890 con 0x7f6f840afca0 2024-08-17T02:24:11.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.004+0000 7f6f89a00640 1 --2- 172.21.15.2:0/3538693670 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6f64065150 0x7f6f64067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.005+0000 7f6f89a00640 1 --2- 172.21.15.2:0/3538693670 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6f64065150 0x7f6f64067600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6f78034000 tx=0x7f6f78032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:11.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.007+0000 7f6f80c00640 1 -- 172.21.15.2:0/3538693670 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6f8415b240 con 0x7f6f840afca0 2024-08-17T02:24:11.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.227+0000 7f6f8c400640 1 -- 172.21.15.2:0/3538693670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f8415a4e0 con 0x7f6f840afca0 2024-08-17T02:24:11.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.228+0000 7f6f80c00640 1 -- 172.21.15.2:0/3538693670 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f6f8415a4e0 con 0x7f6f840afca0 2024-08-17T02:24:11.229 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:24:11.229 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/88006300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":88006300},{"type":"v1","addr":"172.21.15.2:6835","nonce":88006300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3374741059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3374741059},{"type":"v1","addr":"172.21.15.2:6833","nonce":3374741059}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/3494373963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":3494373963},{"type":"v1","addr":"172.21.15.145:6837","nonce":3494373963}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:31.378654+0000","modified":"2024-08-17T02:23:34.968351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6836/3984927211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3984927211},{"type":"v1","addr":"172.21.15.145:6836","nonce":3984927211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:24:11.229 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2024-08-17T02:24:11.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.230+0000 7f6f8c400640 1 -- 172.21.15.2:0/3538693670 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6f64065150 msgr2=0x7f6f64067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.230+0000 7f6f8c400640 1 --2- 172.21.15.2:0/3538693670 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6f64065150 0x7f6f64067600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6f78034000 tx=0x7f6f78032000 comp rx=0 tx=0).stop 2024-08-17T02:24:11.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.230+0000 7f6f8c400640 1 -- 172.21.15.2:0/3538693670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f840afca0 msgr2=0x7f6f84151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.230+0000 7f6f8c400640 1 --2- 172.21.15.2:0/3538693670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f840afca0 0x7f6f84151c20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6f7000c560 tx=0x7f6f70007ef0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.230+0000 7f6f8c400640 1 -- 172.21.15.2:0/3538693670 shutdown_connections 2024-08-17T02:24:11.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.230+0000 7f6f8c400640 1 --2- 172.21.15.2:0/3538693670 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f841590b0 0x7f6f840c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.230+0000 7f6f8c400640 1 --2- 172.21.15.2:0/3538693670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f840afca0 0x7f6f84151c20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.230+0000 7f6f8c400640 1 --2- 172.21.15.2:0/3538693670 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6f64065150 0x7f6f64067600 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.230+0000 7f6f8c400640 1 --2- 172.21.15.2:0/3538693670 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f840acf10 0x7f6f840c4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.231+0000 7f6f8c400640 1 -- 172.21.15.2:0/3538693670 >> 172.21.15.2:0/3538693670 conn(0x7f6f84066e60 msgr2=0x7f6f8406d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:11.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.231+0000 7f6f8c400640 1 -- 172.21.15.2:0/3538693670 shutdown_connections 2024-08-17T02:24:11.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.231+0000 7f6f8c400640 1 -- 172.21.15.2:0/3538693670 wait complete. 2024-08-17T02:24:11.246 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:24:11.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.397+0000 7fb618600640 1 Processor -- start 2024-08-17T02:24:11.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.398+0000 7fb618600640 1 -- start start 2024-08-17T02:24:11.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.399+0000 7fb618600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb610158b90 0x7fb6100b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.399+0000 7fb618600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6100afd20 con 0x7fb6100af130 2024-08-17T02:24:11.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.399+0000 7fb618600640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6100affe0 con 0x7fb6100b2370 2024-08-17T02:24:11.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.399+0000 7fb618600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6100b02c0 con 0x7fb610158b90 2024-08-17T02:24:11.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.399+0000 7fb615c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb610158b90 0x7fb6100b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.399+0000 7fb615c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb610158b90 0x7fb6100b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48838/0 (socket says 172.21.15.2:48838) 2024-08-17T02:24:11.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.399+0000 7fb615c00640 1 -- 172.21.15.2:0/4083731544 learned_addr learned my addr 172.21.15.2:0/4083731544 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:11.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.400+0000 7fb615c00640 1 -- 172.21.15.2:0/4083731544 >> v1:172.21.15.145:6789/0 conn(0x7fb6100b2370 legacy=0x7fb6100aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.400+0000 7fb615c00640 1 -- 172.21.15.2:0/4083731544 >> v1:172.21.15.2:6789/0 conn(0x7fb6100af130 legacy=0x7fb6100ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.400+0000 7fb60fe00640 1 -- 172.21.15.2:0/4083731544 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653035758 0 0) 0x7fb6100affe0 con 0x7fb6100b2370 2024-08-17T02:24:11.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.400+0000 7fb615c00640 1 -- 172.21.15.2:0/4083731544 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6100ca3c0 con 0x7fb610158b90 2024-08-17T02:24:11.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.401+0000 7fb615c00640 1 --2- 172.21.15.2:0/4083731544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb610158b90 0x7fb6100b1e30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb604009910 tx=0x7fb6040091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca95f6db4caecc98 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:11.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.401+0000 7fb60fe00640 1 -- 172.21.15.2:0/4083731544 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb604032440 con 0x7fb610158b90 2024-08-17T02:24:11.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.401+0000 7fb60fe00640 1 -- 172.21.15.2:0/4083731544 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6040325a0 con 0x7fb610158b90 2024-08-17T02:24:11.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.401+0000 7fb60fe00640 1 -- 172.21.15.2:0/4083731544 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb604032940 con 0x7fb610158b90 2024-08-17T02:24:11.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.401+0000 7fb618600640 1 -- 172.21.15.2:0/4083731544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb610158b90 msgr2=0x7fb6100b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.402+0000 7fb618600640 1 --2- 172.21.15.2:0/4083731544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb610158b90 0x7fb6100b1e30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb604009910 tx=0x7fb6040091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.402+0000 7fb618600640 1 -- 172.21.15.2:0/4083731544 shutdown_connections 2024-08-17T02:24:11.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.402+0000 7fb618600640 1 --2- 172.21.15.2:0/4083731544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb610158b90 0x7fb6100b1e30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.402+0000 7fb618600640 1 -- 172.21.15.2:0/4083731544 >> 172.21.15.2:0/4083731544 conn(0x7fb61006e590 msgr2=0x7fb61006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:11.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.402+0000 7fb618600640 1 -- 172.21.15.2:0/4083731544 shutdown_connections 2024-08-17T02:24:11.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.402+0000 7fb618600640 1 -- 172.21.15.2:0/4083731544 wait complete. 2024-08-17T02:24:11.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.403+0000 7fb618600640 1 Processor -- start 2024-08-17T02:24:11.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.403+0000 7fb618600640 1 -- start start 2024-08-17T02:24:11.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.404+0000 7fb618600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6100af130 0x7fb61015b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.404+0000 7fb618600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6100b2370 0x7fb6100b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.404+0000 7fb618600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb610158b90 0x7fb610149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.404+0000 7fb618600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61016a450 con 0x7fb6100b2370 2024-08-17T02:24:11.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.404+0000 7fb618600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61015b800 con 0x7fb6100af130 2024-08-17T02:24:11.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.404+0000 7fb618600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb610169840 con 0x7fb610158b90 2024-08-17T02:24:11.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.404+0000 7fb615200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6100b2370 0x7fb6100b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.405+0000 7fb615200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6100b2370 0x7fb6100b33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48844/0 (socket says 172.21.15.2:48844) 2024-08-17T02:24:11.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.405+0000 7fb615200640 1 -- 172.21.15.2:0/85296387 learned_addr learned my addr 172.21.15.2:0/85296387 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:11.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.405+0000 7fb615c00640 1 --2- 172.21.15.2:0/85296387 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6100af130 0x7fb61015b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.405+0000 7fb616600640 1 --2- 172.21.15.2:0/85296387 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb610158b90 0x7fb610149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.405+0000 7fb615200640 1 -- 172.21.15.2:0/85296387 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb610158b90 msgr2=0x7fb610149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.405+0000 7fb615200640 1 --2- 172.21.15.2:0/85296387 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb610158b90 0x7fb610149d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.405+0000 7fb615200640 1 -- 172.21.15.2:0/85296387 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6100af130 msgr2=0x7fb61015b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.405+0000 7fb615200640 1 --2- 172.21.15.2:0/85296387 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6100af130 0x7fb61015b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.405+0000 7fb615200640 1 -- 172.21.15.2:0/85296387 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb604009450 con 0x7fb6100b2370 2024-08-17T02:24:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.405+0000 7fb615200640 1 --2- 172.21.15.2:0/85296387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6100b2370 0x7fb6100b33e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00c5b0 tx=0x7fb5fc007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.406+0000 7fb60cc00640 1 -- 172.21.15.2:0/85296387 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc012630 con 0x7fb6100b2370 2024-08-17T02:24:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.406+0000 7fb60cc00640 1 -- 172.21.15.2:0/85296387 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5fc0127b0 con 0x7fb6100b2370 2024-08-17T02:24:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.406+0000 7fb60cc00640 1 -- 172.21.15.2:0/85296387 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc012b70 con 0x7fb6100b2370 2024-08-17T02:24:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.406+0000 7fb618600640 1 -- 172.21.15.2:0/85296387 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb610169b20 con 0x7fb6100b2370 2024-08-17T02:24:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.406+0000 7fb618600640 1 -- 172.21.15.2:0/85296387 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61016a0e0 con 0x7fb6100b2370 2024-08-17T02:24:11.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.407+0000 7fb618600640 1 -- 172.21.15.2:0/85296387 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb610063fb0 con 0x7fb6100b2370 2024-08-17T02:24:11.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.408+0000 7fb60cc00640 1 -- 172.21.15.2:0/85296387 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb5fc01b400 con 0x7fb6100b2370 2024-08-17T02:24:11.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.408+0000 7fb60cc00640 1 --2- 172.21.15.2:0/85296387 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb5f0065180 0x7fb5f0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.409+0000 7fb60cc00640 1 -- 172.21.15.2:0/85296387 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb5fc081de0 con 0x7fb6100b2370 2024-08-17T02:24:11.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.409+0000 7fb615c00640 1 --2- 172.21.15.2:0/85296387 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb5f0065180 0x7fb5f0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.410+0000 7fb615c00640 1 --2- 172.21.15.2:0/85296387 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb5f0065180 0x7fb5f0067630 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb604034000 tx=0x7fb604032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:11.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.412+0000 7fb60cc00640 1 -- 172.21.15.2:0/85296387 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb5fc04ff50 con 0x7fb6100b2370 2024-08-17T02:24:11.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.634+0000 7fb618600640 1 -- 172.21.15.2:0/85296387 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6100cfca0 con 0x7fb6100b2370 2024-08-17T02:24:11.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.635+0000 7fb60cc00640 1 -- 172.21.15.2:0/85296387 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7fb5fc053570 con 0x7fb6100b2370 2024-08-17T02:24:11.636 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:24:11.636 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/88006300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":88006300},{"type":"v1","addr":"172.21.15.2:6835","nonce":88006300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3374741059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3374741059},{"type":"v1","addr":"172.21.15.2:6833","nonce":3374741059}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/3494373963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":3494373963},{"type":"v1","addr":"172.21.15.145:6837","nonce":3494373963}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:31.378654+0000","modified":"2024-08-17T02:23:34.968351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6836/3984927211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3984927211},{"type":"v1","addr":"172.21.15.145:6836","nonce":3984927211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:24:11.636 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2024-08-17T02:24:11.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.637+0000 7fb618600640 1 -- 172.21.15.2:0/85296387 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb5f0065180 msgr2=0x7fb5f0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.637+0000 7fb618600640 1 --2- 172.21.15.2:0/85296387 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb5f0065180 0x7fb5f0067630 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb604034000 tx=0x7fb604032000 comp rx=0 tx=0).stop 2024-08-17T02:24:11.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.637+0000 7fb618600640 1 -- 172.21.15.2:0/85296387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6100b2370 msgr2=0x7fb6100b33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.637+0000 7fb618600640 1 --2- 172.21.15.2:0/85296387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6100b2370 0x7fb6100b33e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00c5b0 tx=0x7fb5fc007d60 comp rx=0 tx=0).stop 2024-08-17T02:24:11.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.637+0000 7fb618600640 1 -- 172.21.15.2:0/85296387 shutdown_connections 2024-08-17T02:24:11.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.637+0000 7fb618600640 1 --2- 172.21.15.2:0/85296387 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb5f0065180 0x7fb5f0067630 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.637+0000 7fb618600640 1 --2- 172.21.15.2:0/85296387 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb610158b90 0x7fb610149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.637+0000 7fb618600640 1 --2- 172.21.15.2:0/85296387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6100b2370 0x7fb6100b33e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.637+0000 7fb618600640 1 --2- 172.21.15.2:0/85296387 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6100af130 0x7fb61015b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.637+0000 7fb618600640 1 -- 172.21.15.2:0/85296387 >> 172.21.15.2:0/85296387 conn(0x7fb61006e590 msgr2=0x7fb61015fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:11.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.637+0000 7fb618600640 1 -- 172.21.15.2:0/85296387 shutdown_connections 2024-08-17T02:24:11.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.637+0000 7fb618600640 1 -- 172.21.15.2:0/85296387 wait complete. 2024-08-17T02:24:11.653 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:11.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.805+0000 7f5f8ee00640 1 Processor -- start 2024-08-17T02:24:11.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.805+0000 7f5f8ee00640 1 -- start start 2024-08-17T02:24:11.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.807+0000 7f5f8ee00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f880ca050 0x7f5f88156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.807+0000 7f5f8ee00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5f880add30 0x7f5f8815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.807+0000 7f5f8ee00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8815b5e0 con 0x7f5f880ad960 2024-08-17T02:24:11.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.807+0000 7f5f8ee00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f880cb160 con 0x7f5f880add30 2024-08-17T02:24:11.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.807+0000 7f5f8ee00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880b0d10 con 0x7f5f880ca050 2024-08-17T02:24:11.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.807+0000 7f5f87e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5f880ad960 0x7f5f88156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43412/0 (socket says 172.21.15.2:43412) 2024-08-17T02:24:11.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.807+0000 7f5f87e00640 1 -- 172.21.15.2:0/2970901811 learned_addr learned my addr 172.21.15.2:0/2970901811 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:11.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.807+0000 7f5f8ce00640 1 --2- 172.21.15.2:0/2970901811 >> v2:172.21.15.2:3300/0 conn(0x7f5f880add30 0x7f5f8815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.807+0000 7f5f87400640 1 --2- 172.21.15.2:0/2970901811 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f880ca050 0x7f5f88156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.807+0000 7f5f8ce00640 1 -- 172.21.15.2:0/2970901811 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f880ca050 msgr2=0x7f5f88156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:11.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.807+0000 7f5f8ce00640 1 --2- 172.21.15.2:0/2970901811 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f880ca050 0x7f5f88156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.807+0000 7f5f8ce00640 1 -- 172.21.15.2:0/2970901811 >> v1:172.21.15.2:6789/0 conn(0x7f5f880ad960 legacy=0x7f5f88156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.807+0000 7f5f8ce00640 1 -- 172.21.15.2:0/2970901811 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f880ca550 con 0x7f5f880add30 2024-08-17T02:24:11.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.808+0000 7f5f8ce00640 1 --2- 172.21.15.2:0/2970901811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f880add30 0x7f5f8815b0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009e60 tx=0x7f5f80009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4c745e4ba9c66a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:11.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.809+0000 7f5f86a00640 1 -- 172.21.15.2:0/2970901811 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f80007550 con 0x7f5f880add30 2024-08-17T02:24:11.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.809+0000 7f5f86a00640 1 -- 172.21.15.2:0/2970901811 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8002d050 con 0x7f5f880add30 2024-08-17T02:24:11.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.809+0000 7f5f86a00640 1 -- 172.21.15.2:0/2970901811 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f80007900 con 0x7f5f880add30 2024-08-17T02:24:11.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.809+0000 7f5f8ee00640 1 -- 172.21.15.2:0/2970901811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f880add30 msgr2=0x7f5f8815b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.809+0000 7f5f8ee00640 1 --2- 172.21.15.2:0/2970901811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f880add30 0x7f5f8815b0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009e60 tx=0x7f5f80009780 comp rx=0 tx=0).stop 2024-08-17T02:24:11.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.809+0000 7f5f8ee00640 1 -- 172.21.15.2:0/2970901811 shutdown_connections 2024-08-17T02:24:11.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.809+0000 7f5f8ee00640 1 --2- 172.21.15.2:0/2970901811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f880add30 0x7f5f8815b0a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.809+0000 7f5f8ee00640 1 --2- 172.21.15.2:0/2970901811 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f880ca050 0x7f5f88156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.809+0000 7f5f8ee00640 1 -- 172.21.15.2:0/2970901811 >> 172.21.15.2:0/2970901811 conn(0x7f5f88066e60 msgr2=0x7f5f88067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:11.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.810+0000 7f5f8ee00640 1 -- 172.21.15.2:0/2970901811 shutdown_connections 2024-08-17T02:24:11.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.810+0000 7f5f8ee00640 1 -- 172.21.15.2:0/2970901811 wait complete. 2024-08-17T02:24:11.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.811+0000 7f5f8ee00640 1 Processor -- start 2024-08-17T02:24:11.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.811+0000 7f5f8ee00640 1 -- start start 2024-08-17T02:24:11.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.812+0000 7f5f8ee00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f880ad960 0x7f5f8814b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.812+0000 7f5f8ee00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f880add30 0x7f5f8814d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.812+0000 7f5f8ee00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f880ca050 0x7f5f88169280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.812+0000 7f5f8ee00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f88169d70 con 0x7f5f880add30 2024-08-17T02:24:11.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.812+0000 7f5f8ee00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8816a050 con 0x7f5f880ca050 2024-08-17T02:24:11.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.812+0000 7f5f8ee00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880ab640 con 0x7f5f880ad960 2024-08-17T02:24:11.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.812+0000 7f5f87400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f880add30 0x7f5f8814d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.812+0000 7f5f87400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f880add30 0x7f5f8814d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48860/0 (socket says 172.21.15.2:48860) 2024-08-17T02:24:11.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.812+0000 7f5f87400640 1 -- 172.21.15.2:0/3289919620 learned_addr learned my addr 172.21.15.2:0/3289919620 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:11.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.812+0000 7f5f87e00640 1 --2- 172.21.15.2:0/3289919620 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f880ad960 0x7f5f8814b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.812+0000 7f5f8ce00640 1 --2- 172.21.15.2:0/3289919620 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f880ca050 0x7f5f88169280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.812+0000 7f5f87400640 1 -- 172.21.15.2:0/3289919620 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f880ad960 msgr2=0x7f5f8814b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.813+0000 7f5f87400640 1 --2- 172.21.15.2:0/3289919620 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f880ad960 0x7f5f8814b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.813+0000 7f5f87400640 1 -- 172.21.15.2:0/3289919620 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f880ca050 msgr2=0x7f5f88169280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.813+0000 7f5f87400640 1 --2- 172.21.15.2:0/3289919620 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f880ca050 0x7f5f88169280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.813+0000 7f5f87400640 1 -- 172.21.15.2:0/3289919620 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f80009a20 con 0x7f5f880add30 2024-08-17T02:24:11.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.813+0000 7f5f87e00640 1 --2- 172.21.15.2:0/3289919620 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f880ad960 0x7f5f8814b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:11.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.813+0000 7f5f8ce00640 1 --2- 172.21.15.2:0/3289919620 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f880ca050 0x7f5f88169280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:11.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.813+0000 7f5f87400640 1 --2- 172.21.15.2:0/3289919620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f880add30 0x7f5f8814d3c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5f7400d890 tx=0x7f5f74008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:11.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.813+0000 7f5f7f400640 1 -- 172.21.15.2:0/3289919620 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7400de20 con 0x7f5f880add30 2024-08-17T02:24:11.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.813+0000 7f5f7f400640 1 -- 172.21.15.2:0/3289919620 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7400b8d0 con 0x7f5f880add30 2024-08-17T02:24:11.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.813+0000 7f5f7f400640 1 -- 172.21.15.2:0/3289919620 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7400bc70 con 0x7f5f880add30 2024-08-17T02:24:11.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.813+0000 7f5f8ee00640 1 -- 172.21.15.2:0/3289919620 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f880ab920 con 0x7f5f880add30 2024-08-17T02:24:11.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.813+0000 7f5f8ee00640 1 -- 172.21.15.2:0/3289919620 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8814b810 con 0x7f5f880add30 2024-08-17T02:24:11.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.814+0000 7f5f8ee00640 1 -- 172.21.15.2:0/3289919620 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8816a270 con 0x7f5f880add30 2024-08-17T02:24:11.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.815+0000 7f5f7f400640 1 -- 172.21.15.2:0/3289919620 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5f74012630 con 0x7f5f880add30 2024-08-17T02:24:11.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.816+0000 7f5f7f400640 1 --2- 172.21.15.2:0/3289919620 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5f68065150 0x7f5f68067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.816+0000 7f5f7f400640 1 -- 172.21.15.2:0/3289919620 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5f740828e0 con 0x7f5f880add30 2024-08-17T02:24:11.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.816+0000 7f5f87e00640 1 --2- 172.21.15.2:0/3289919620 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5f68065150 0x7f5f68067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.817+0000 7f5f87e00640 1 --2- 172.21.15.2:0/3289919620 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5f68065150 0x7f5f68067600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5f78001700 tx=0x7f5f78009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:11.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:11.819+0000 7f5f7f400640 1 -- 172.21.15.2:0/3289919620 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5f740509b0 con 0x7f5f880add30 2024-08-17T02:24:12.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.005+0000 7f5f8ee00640 1 -- 172.21.15.2:0/3289919620 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f88063fb0 con 0x7f5f880add30 2024-08-17T02:24:12.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.006+0000 7f5f7f400640 1 -- 172.21.15.2:0/3289919620 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f5f74053fd0 con 0x7f5f880add30 2024-08-17T02:24:12.006 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:24:12.007 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:23:32.955197+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:29.708835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:30.361908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:12.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.008+0000 7f5f8ee00640 1 -- 172.21.15.2:0/3289919620 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5f68065150 msgr2=0x7f5f68067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.008+0000 7f5f8ee00640 1 --2- 172.21.15.2:0/3289919620 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5f68065150 0x7f5f68067600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5f78001700 tx=0x7f5f78009040 comp rx=0 tx=0).stop 2024-08-17T02:24:12.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.008+0000 7f5f8ee00640 1 -- 172.21.15.2:0/3289919620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f880add30 msgr2=0x7f5f8814d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.008+0000 7f5f8ee00640 1 --2- 172.21.15.2:0/3289919620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f880add30 0x7f5f8814d3c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5f7400d890 tx=0x7f5f74008040 comp rx=0 tx=0).stop 2024-08-17T02:24:12.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.008+0000 7f5f8ee00640 1 -- 172.21.15.2:0/3289919620 shutdown_connections 2024-08-17T02:24:12.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.008+0000 7f5f8ee00640 1 --2- 172.21.15.2:0/3289919620 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f880ca050 0x7f5f88169280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.008+0000 7f5f8ee00640 1 --2- 172.21.15.2:0/3289919620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f880add30 0x7f5f8814d3c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.008+0000 7f5f8ee00640 1 --2- 172.21.15.2:0/3289919620 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5f68065150 0x7f5f68067600 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.008+0000 7f5f8ee00640 1 --2- 172.21.15.2:0/3289919620 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f880ad960 0x7f5f8814b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.008+0000 7f5f8ee00640 1 -- 172.21.15.2:0/3289919620 >> 172.21.15.2:0/3289919620 conn(0x7f5f88066e60 msgr2=0x7f5f88153fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:12.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.008+0000 7f5f8ee00640 1 -- 172.21.15.2:0/3289919620 shutdown_connections 2024-08-17T02:24:12.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.008+0000 7f5f8ee00640 1 -- 172.21.15.2:0/3289919620 wait complete. 2024-08-17T02:24:12.024 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:24:12.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.177+0000 7fc4e9400640 1 Processor -- start 2024-08-17T02:24:12.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.178+0000 7fc4e9400640 1 -- start start 2024-08-17T02:24:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.179+0000 7fc4e9400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc4e4158ef0 0x7fc4e40ac220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.179+0000 7fc4e9400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc4e40ac760 0x7fc4e4066e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.179+0000 7fc4e9400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e40b0ec0 con 0x7fc4e4158b20 2024-08-17T02:24:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.179+0000 7fc4e9400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4e40acca0 con 0x7fc4e4158ef0 2024-08-17T02:24:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.179+0000 7fc4e9400640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4e40b0870 con 0x7fc4e40ac760 2024-08-17T02:24:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.179+0000 7fc4e3e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc4e4158b20 0x7fc4e40a9650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43416/0 (socket says 172.21.15.2:43416) 2024-08-17T02:24:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.179+0000 7fc4e3e00640 1 -- 172.21.15.2:0/2382504072 learned_addr learned my addr 172.21.15.2:0/2382504072 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.179+0000 7fc4e3400640 1 --2- 172.21.15.2:0/2382504072 >> v2:172.21.15.2:3300/0 conn(0x7fc4e4158ef0 0x7fc4e40ac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.179+0000 7fc4e8a00640 1 --2- 172.21.15.2:0/2382504072 >> v2:172.21.15.145:3300/0 conn(0x7fc4e40ac760 0x7fc4e4066e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.180+0000 7fc4e3400640 1 -- 172.21.15.2:0/2382504072 >> v2:172.21.15.145:3300/0 conn(0x7fc4e40ac760 msgr2=0x7fc4e4066e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:12.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.180+0000 7fc4e3400640 1 --2- 172.21.15.2:0/2382504072 >> v2:172.21.15.145:3300/0 conn(0x7fc4e40ac760 0x7fc4e4066e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.180+0000 7fc4e3400640 1 -- 172.21.15.2:0/2382504072 >> v1:172.21.15.2:6789/0 conn(0x7fc4e4158b20 legacy=0x7fc4e40a9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.180+0000 7fc4e3400640 1 -- 172.21.15.2:0/2382504072 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e40b0b50 con 0x7fc4e4158ef0 2024-08-17T02:24:12.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.181+0000 7fc4e3400640 1 --2- 172.21.15.2:0/2382504072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4e4158ef0 0x7fc4e40ac220 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc4e406dde0 tx=0x7fc4d00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd9a5999ca7a8431 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:12.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.181+0000 7fc4e2a00640 1 -- 172.21.15.2:0/2382504072 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d002adb0 con 0x7fc4e4158ef0 2024-08-17T02:24:12.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.181+0000 7fc4e2a00640 1 -- 172.21.15.2:0/2382504072 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d0032440 con 0x7fc4e4158ef0 2024-08-17T02:24:12.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.181+0000 7fc4e2a00640 1 -- 172.21.15.2:0/2382504072 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0032820 con 0x7fc4e4158ef0 2024-08-17T02:24:12.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.181+0000 7fc4e9400640 1 -- 172.21.15.2:0/2382504072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4e4158ef0 msgr2=0x7fc4e40ac220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.181+0000 7fc4e9400640 1 --2- 172.21.15.2:0/2382504072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4e4158ef0 0x7fc4e40ac220 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc4e406dde0 tx=0x7fc4d00090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.181+0000 7fc4e9400640 1 -- 172.21.15.2:0/2382504072 shutdown_connections 2024-08-17T02:24:12.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.181+0000 7fc4e9400640 1 --2- 172.21.15.2:0/2382504072 >> v2:172.21.15.145:3300/0 conn(0x7fc4e40ac760 0x7fc4e4066e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.181+0000 7fc4e9400640 1 --2- 172.21.15.2:0/2382504072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4e4158ef0 0x7fc4e40ac220 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.182+0000 7fc4e9400640 1 -- 172.21.15.2:0/2382504072 >> 172.21.15.2:0/2382504072 conn(0x7fc4e4095a70 msgr2=0x7fc4e4095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:12.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.182+0000 7fc4e9400640 1 -- 172.21.15.2:0/2382504072 shutdown_connections 2024-08-17T02:24:12.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.182+0000 7fc4e9400640 1 -- 172.21.15.2:0/2382504072 wait complete. 2024-08-17T02:24:12.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.183+0000 7fc4e9400640 1 Processor -- start 2024-08-17T02:24:12.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.183+0000 7fc4e9400640 1 -- start start 2024-08-17T02:24:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.184+0000 7fc4e9400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4e40ac760 0x7fc4e415a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.184+0000 7fc4e9400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4e4158b20 0x7fc4e414b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.184+0000 7fc4e9400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc4e4158ef0 0x7fc4e40afa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.184+0000 7fc4e9400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e415b7c0 con 0x7fc4e4158b20 2024-08-17T02:24:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.184+0000 7fc4e9400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e415abb0 con 0x7fc4e40ac760 2024-08-17T02:24:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.184+0000 7fc4e9400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e415ae90 con 0x7fc4e4158ef0 2024-08-17T02:24:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.184+0000 7fc4e3400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4e4158b20 0x7fc4e414b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.184+0000 7fc4e3400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4e4158b20 0x7fc4e414b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48870/0 (socket says 172.21.15.2:48870) 2024-08-17T02:24:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.184+0000 7fc4e3400640 1 -- 172.21.15.2:0/903890288 learned_addr learned my addr 172.21.15.2:0/903890288 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.184+0000 7fc4e3e00640 1 --2- 172.21.15.2:0/903890288 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4e40ac760 0x7fc4e415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.184+0000 7fc4e8a00640 1 --2- 172.21.15.2:0/903890288 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc4e4158ef0 0x7fc4e40afa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.185+0000 7fc4e3400640 1 -- 172.21.15.2:0/903890288 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc4e4158ef0 msgr2=0x7fc4e40afa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.185+0000 7fc4e3400640 1 --2- 172.21.15.2:0/903890288 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc4e4158ef0 0x7fc4e40afa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.185+0000 7fc4e3400640 1 -- 172.21.15.2:0/903890288 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4e40ac760 msgr2=0x7fc4e415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.185+0000 7fc4e3400640 1 --2- 172.21.15.2:0/903890288 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4e40ac760 0x7fc4e415a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.185+0000 7fc4e3400640 1 -- 172.21.15.2:0/903890288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d0009390 con 0x7fc4e4158b20 2024-08-17T02:24:12.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.185+0000 7fc4e3400640 1 --2- 172.21.15.2:0/903890288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4e4158b20 0x7fc4e414b310 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0009360 tx=0x7fc4d0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:12.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.185+0000 7fc4db400640 1 -- 172.21.15.2:0/903890288 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0031de0 con 0x7fc4e4158b20 2024-08-17T02:24:12.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.185+0000 7fc4db400640 1 -- 172.21.15.2:0/903890288 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d003d420 con 0x7fc4e4158b20 2024-08-17T02:24:12.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.185+0000 7fc4db400640 1 -- 172.21.15.2:0/903890288 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d003d7e0 con 0x7fc4e4158b20 2024-08-17T02:24:12.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.185+0000 7fc4e9400640 1 -- 172.21.15.2:0/903890288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e415b170 con 0x7fc4e4158b20 2024-08-17T02:24:12.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.185+0000 7fc4e9400640 1 -- 172.21.15.2:0/903890288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e40b1a20 con 0x7fc4e4158b20 2024-08-17T02:24:12.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.187+0000 7fc4e9400640 1 -- 172.21.15.2:0/903890288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e415b970 con 0x7fc4e4158b20 2024-08-17T02:24:12.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.187+0000 7fc4db400640 1 -- 172.21.15.2:0/903890288 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc4d0039040 con 0x7fc4e4158b20 2024-08-17T02:24:12.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.189+0000 7fc4db400640 1 --2- 172.21.15.2:0/903890288 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc4c4065150 0x7fc4c4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.189+0000 7fc4db400640 1 -- 172.21.15.2:0/903890288 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc4d00a23b0 con 0x7fc4e4158b20 2024-08-17T02:24:12.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.189+0000 7fc4e3e00640 1 --2- 172.21.15.2:0/903890288 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc4c4065150 0x7fc4c4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.190+0000 7fc4e3e00640 1 --2- 172.21.15.2:0/903890288 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc4c4065150 0x7fc4c4067600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4007880 tx=0x7fc4d4007e20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:12.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.193+0000 7fc4db400640 1 -- 172.21.15.2:0/903890288 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc4e415b970 con 0x7fc4e4158b20 2024-08-17T02:24:12.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.412+0000 7fc4e9400640 1 -- 172.21.15.2:0/903890288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc4e415b5f0 con 0x7fc4e4158b20 2024-08-17T02:24:12.412 INFO:tasks.ceph.mon.a.smithi002.stderr:2024-08-17T02:24:12.412+0000 7f7a23e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:24:12.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.417+0000 7fc4db400640 1 -- 172.21.15.2:0/903890288 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc4d0070480 con 0x7fc4e4158b20 2024-08-17T02:24:12.417 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:24:12.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.419+0000 7fc4e9400640 1 -- 172.21.15.2:0/903890288 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc4c4065150 msgr2=0x7fc4c4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.419+0000 7fc4e9400640 1 --2- 172.21.15.2:0/903890288 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc4c4065150 0x7fc4c4067600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4007880 tx=0x7fc4d4007e20 comp rx=0 tx=0).stop 2024-08-17T02:24:12.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.419+0000 7fc4e9400640 1 -- 172.21.15.2:0/903890288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4e4158b20 msgr2=0x7fc4e414b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.419+0000 7fc4e9400640 1 --2- 172.21.15.2:0/903890288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4e4158b20 0x7fc4e414b310 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0009360 tx=0x7fc4d0032000 comp rx=0 tx=0).stop 2024-08-17T02:24:12.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.419+0000 7fc4e9400640 1 -- 172.21.15.2:0/903890288 shutdown_connections 2024-08-17T02:24:12.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.419+0000 7fc4e9400640 1 --2- 172.21.15.2:0/903890288 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc4c4065150 0x7fc4c4067600 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.419+0000 7fc4e9400640 1 --2- 172.21.15.2:0/903890288 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc4e4158ef0 0x7fc4e40afa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.419+0000 7fc4e9400640 1 --2- 172.21.15.2:0/903890288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4e4158b20 0x7fc4e414b310 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.419+0000 7fc4e9400640 1 --2- 172.21.15.2:0/903890288 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4e40ac760 0x7fc4e415a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.419+0000 7fc4e9400640 1 -- 172.21.15.2:0/903890288 >> 172.21.15.2:0/903890288 conn(0x7fc4e4095a70 msgr2=0x7fc4e4156860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:12.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.419+0000 7fc4e9400640 1 -- 172.21.15.2:0/903890288 shutdown_connections 2024-08-17T02:24:12.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.419+0000 7fc4e9400640 1 -- 172.21.15.2:0/903890288 wait complete. 2024-08-17T02:24:12.435 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:24:12.468 INFO:tasks.ceph.mds.d.smithi145.stdout:starting mds.d at 2024-08-17T02:24:12.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.589+0000 7f7281800640 1 Processor -- start 2024-08-17T02:24:12.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.589+0000 7f7281800640 1 -- start start 2024-08-17T02:24:12.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.590+0000 7f7281800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f727c0aea20 0x7f727c0aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.590+0000 7f7281800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f727c0ca8e0 0x7f727c0cace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.590+0000 7f7281800640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f727c0af3a0 con 0x7f727c158b90 2024-08-17T02:24:12.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.590+0000 7f7281800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727c0afd20 con 0x7f727c0aea20 2024-08-17T02:24:12.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.590+0000 7f7281800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727c0affe0 con 0x7f727c0ca8e0 2024-08-17T02:24:12.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.590+0000 7f727a000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f727c0aea20 0x7f727c0aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.590+0000 7f727a000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f727c0aea20 0x7f727c0aee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48872/0 (socket says 172.21.15.2:48872) 2024-08-17T02:24:12.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.590+0000 7f727a000640 1 -- 172.21.15.2:0/3011895593 learned_addr learned my addr 172.21.15.2:0/3011895593 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:12.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.591+0000 7f727b400640 1 --2- 172.21.15.2:0/3011895593 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f727c0ca8e0 0x7f727c0cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.591+0000 7f727a000640 1 -- 172.21.15.2:0/3011895593 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f727c0ca8e0 msgr2=0x7f727c0cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:12.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.591+0000 7f727a000640 1 --2- 172.21.15.2:0/3011895593 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f727c0ca8e0 0x7f727c0cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.591+0000 7f727a000640 1 -- 172.21.15.2:0/3011895593 >> v1:172.21.15.145:6789/0 conn(0x7f727c158b90 legacy=0x7f727c0b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:12.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.591+0000 7f727a000640 1 -- 172.21.15.2:0/3011895593 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727c0b02c0 con 0x7f727c0aea20 2024-08-17T02:24:12.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.591+0000 7f727b400640 1 --2- 172.21.15.2:0/3011895593 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f727c0ca8e0 0x7f727c0cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:12.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.592+0000 7f727a000640 1 --2- 172.21.15.2:0/3011895593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f727c0aea20 0x7f727c0aee60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f727c0b56c0 tx=0x7f72680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b9c94ce1b6e2e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:12.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.592+0000 7f7279600640 1 -- 172.21.15.2:0/3011895593 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726802ad90 con 0x7f727c0aea20 2024-08-17T02:24:12.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.592+0000 7f7279600640 1 -- 172.21.15.2:0/3011895593 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7268032440 con 0x7f727c0aea20 2024-08-17T02:24:12.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.592+0000 7f7279600640 1 -- 172.21.15.2:0/3011895593 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7268032820 con 0x7f727c0aea20 2024-08-17T02:24:12.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.593+0000 7f7281800640 1 -- 172.21.15.2:0/3011895593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f727c0aea20 msgr2=0x7f727c0aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.593+0000 7f7281800640 1 --2- 172.21.15.2:0/3011895593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f727c0aea20 0x7f727c0aee60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f727c0b56c0 tx=0x7f72680091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.593+0000 7f7281800640 1 -- 172.21.15.2:0/3011895593 shutdown_connections 2024-08-17T02:24:12.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.593+0000 7f7281800640 1 --2- 172.21.15.2:0/3011895593 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f727c0ca8e0 0x7f727c0cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.593+0000 7f7281800640 1 --2- 172.21.15.2:0/3011895593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f727c0aea20 0x7f727c0aee60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.593+0000 7f7281800640 1 -- 172.21.15.2:0/3011895593 >> 172.21.15.2:0/3011895593 conn(0x7f727c06e590 msgr2=0x7f727c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:12.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.593+0000 7f7281800640 1 -- 172.21.15.2:0/3011895593 shutdown_connections 2024-08-17T02:24:12.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.593+0000 7f7281800640 1 -- 172.21.15.2:0/3011895593 wait complete. 2024-08-17T02:24:12.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.594+0000 7f7281800640 1 Processor -- start 2024-08-17T02:24:12.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.594+0000 7f7281800640 1 -- start start 2024-08-17T02:24:12.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.595+0000 7f7281800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f727c0aea20 0x7f727c0c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.595+0000 7f7281800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f727c0ca8e0 0x7f727c0c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.595+0000 7f7281800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f727c158b90 0x7f727c168fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.595+0000 7f7281800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c14f5d0 con 0x7f727c158b90 2024-08-17T02:24:12.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.595+0000 7f7281800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c16a000 con 0x7f727c0aea20 2024-08-17T02:24:12.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.595+0000 7f7281800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727c159750 con 0x7f727c0ca8e0 2024-08-17T02:24:12.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.595+0000 7f727b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f727c158b90 0x7f727c168fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.595+0000 7f727b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f727c158b90 0x7f727c168fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48874/0 (socket says 172.21.15.2:48874) 2024-08-17T02:24:12.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.595+0000 7f727b400640 1 -- 172.21.15.2:0/1883086562 learned_addr learned my addr 172.21.15.2:0/1883086562 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:12.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.595+0000 7f727a000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f727c0ca8e0 0x7f727c0c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.595+0000 7f727aa00640 1 --2- 172.21.15.2:0/1883086562 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f727c0aea20 0x7f727c0c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.596+0000 7f727b400640 1 -- 172.21.15.2:0/1883086562 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f727c0ca8e0 msgr2=0x7f727c0c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.596+0000 7f727b400640 1 --2- 172.21.15.2:0/1883086562 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f727c0ca8e0 0x7f727c0c93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.596+0000 7f727b400640 1 -- 172.21.15.2:0/1883086562 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f727c0aea20 msgr2=0x7f727c0c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.596+0000 7f727b400640 1 --2- 172.21.15.2:0/1883086562 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f727c0aea20 0x7f727c0c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.596+0000 7f727b400640 1 -- 172.21.15.2:0/1883086562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7268009450 con 0x7f727c158b90 2024-08-17T02:24:12.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.596+0000 7f727b400640 1 --2- 172.21.15.2:0/1883086562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f727c158b90 0x7f727c168fd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f727400a380 tx=0x7f7274007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:12.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.596+0000 7f7272000640 1 -- 172.21.15.2:0/1883086562 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727400d650 con 0x7f727c158b90 2024-08-17T02:24:12.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.596+0000 7f7272000640 1 -- 172.21.15.2:0/1883086562 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727400d7b0 con 0x7f727c158b90 2024-08-17T02:24:12.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.596+0000 7f7272000640 1 -- 172.21.15.2:0/1883086562 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727400db70 con 0x7f727c158b90 2024-08-17T02:24:12.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.596+0000 7f7281800640 1 -- 172.21.15.2:0/1883086562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f727c169d20 con 0x7f727c158b90 2024-08-17T02:24:12.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.597+0000 7f7281800640 1 -- 172.21.15.2:0/1883086562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727c1593e0 con 0x7f727c158b90 2024-08-17T02:24:12.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.598+0000 7f7281800640 1 -- 172.21.15.2:0/1883086562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f727c158f60 con 0x7f727c158b90 2024-08-17T02:24:12.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.598+0000 7f7272000640 1 -- 172.21.15.2:0/1883086562 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f727401e3b0 con 0x7f727c158b90 2024-08-17T02:24:12.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.599+0000 7f7272000640 1 --2- 172.21.15.2:0/1883086562 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f725c065150 0x7f725c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.599+0000 7f7272000640 1 -- 172.21.15.2:0/1883086562 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f7274082eb0 con 0x7f727c158b90 2024-08-17T02:24:12.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.599+0000 7f727aa00640 1 --2- 172.21.15.2:0/1883086562 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f725c065150 0x7f725c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.600+0000 7f727aa00640 1 --2- 172.21.15.2:0/1883086562 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f725c065150 0x7f725c067600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f726c007fd0 tx=0x7f726c007e10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:12.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.603+0000 7f7272000640 1 -- 172.21.15.2:0/1883086562 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f727c158f60 con 0x7f727c158b90 2024-08-17T02:24:12.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:12.823+0000 7f7281800640 1 -- 172.21.15.2:0/1883086562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f727c159900 con 0x7f727c158b90 2024-08-17T02:24:13.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.419+0000 7f7272000640 1 -- 172.21.15.2:0/1883086562 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f727c159900 con 0x7f727c158b90 2024-08-17T02:24:13.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.422+0000 7f7281800640 1 -- 172.21.15.2:0/1883086562 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f725c065150 msgr2=0x7f725c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.422+0000 7f7281800640 1 --2- 172.21.15.2:0/1883086562 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f725c065150 0x7f725c067600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f726c007fd0 tx=0x7f726c007e10 comp rx=0 tx=0).stop 2024-08-17T02:24:13.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.422+0000 7f7281800640 1 -- 172.21.15.2:0/1883086562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f727c158b90 msgr2=0x7f727c168fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.422+0000 7f7281800640 1 --2- 172.21.15.2:0/1883086562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f727c158b90 0x7f727c168fd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f727400a380 tx=0x7f7274007900 comp rx=0 tx=0).stop 2024-08-17T02:24:13.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.422+0000 7f7281800640 1 -- 172.21.15.2:0/1883086562 shutdown_connections 2024-08-17T02:24:13.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.422+0000 7f7281800640 1 --2- 172.21.15.2:0/1883086562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f727c158b90 0x7f727c168fd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.422+0000 7f7281800640 1 --2- 172.21.15.2:0/1883086562 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f725c065150 0x7f725c067600 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.422+0000 7f7281800640 1 --2- 172.21.15.2:0/1883086562 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f727c0ca8e0 0x7f727c0c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.422+0000 7f7281800640 1 --2- 172.21.15.2:0/1883086562 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f727c0aea20 0x7f727c0c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.422+0000 7f7281800640 1 -- 172.21.15.2:0/1883086562 >> 172.21.15.2:0/1883086562 conn(0x7f727c06e590 msgr2=0x7f727c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:13.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.422+0000 7f7281800640 1 -- 172.21.15.2:0/1883086562 shutdown_connections 2024-08-17T02:24:13.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.422+0000 7f7281800640 1 -- 172.21.15.2:0/1883086562 wait complete. 2024-08-17T02:24:13.441 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:24:13.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.602+0000 7f4e9e600640 1 Processor -- start 2024-08-17T02:24:13.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.602+0000 7f4e9e600640 1 -- start start 2024-08-17T02:24:13.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.604+0000 7f4e9e600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4e980cae20 0x7f4e980adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.604+0000 7f4e9e600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e980ca060 con 0x7f4e980ad780 2024-08-17T02:24:13.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.604+0000 7f4e9e600640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e980ca340 con 0x7f4e980ae6e0 2024-08-17T02:24:13.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.604+0000 7f4e9e600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e980ca620 con 0x7f4e980cae20 2024-08-17T02:24:13.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.604+0000 7f4e9d200640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4e980ad780 0x7f4e980af6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43432/0 (socket says 172.21.15.2:43432) 2024-08-17T02:24:13.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.604+0000 7f4e9d200640 1 -- 172.21.15.2:0/1410566421 learned_addr learned my addr 172.21.15.2:0/1410566421 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:13.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.604+0000 7f4e97e00640 1 --2- 172.21.15.2:0/1410566421 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4e980cae20 0x7f4e980adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.604+0000 7f4e97400640 1 -- 172.21.15.2:0/1410566421 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905776353 0 0) 0x7f4e980ca060 con 0x7f4e980ad780 2024-08-17T02:24:13.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.604+0000 7f4e97400640 1 -- 172.21.15.2:0/1410566421 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e800034e0 con 0x7f4e980ad780 2024-08-17T02:24:13.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.605+0000 7f4e97400640 1 -- 172.21.15.2:0/1410566421 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 792624977 0 0) 0x7f4e980ca340 con 0x7f4e980ae6e0 2024-08-17T02:24:13.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.605+0000 7f4e97400640 1 -- 172.21.15.2:0/1410566421 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e980ca060 con 0x7f4e980ae6e0 2024-08-17T02:24:13.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.605+0000 7f4e97400640 1 -- 172.21.15.2:0/1410566421 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 479180154 0 0) 0x7f4e800034e0 con 0x7f4e980ad780 2024-08-17T02:24:13.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.605+0000 7f4e97400640 1 -- 172.21.15.2:0/1410566421 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4e980cae20 msgr2=0x7f4e980adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:13.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.605+0000 7f4e97400640 1 --2- 172.21.15.2:0/1410566421 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4e980cae20 0x7f4e980adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.605+0000 7f4e97400640 1 -- 172.21.15.2:0/1410566421 >> v1:172.21.15.145:6789/0 conn(0x7f4e980ae6e0 legacy=0x7f4e98157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.605+0000 7f4e97400640 1 -- 172.21.15.2:0/1410566421 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e980ca900 con 0x7f4e980ad780 2024-08-17T02:24:13.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.605+0000 7f4e97400640 1 -- 172.21.15.2:0/1410566421 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7f4e8c001470 con 0x7f4e980ad780 2024-08-17T02:24:13.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.605+0000 7f4e97400640 1 -- 172.21.15.2:0/1410566421 >> v1:172.21.15.2:6789/0 conn(0x7f4e980ad780 legacy=0x7f4e980af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.605+0000 7f4e97400640 1 --2- 172.21.15.2:0/1410566421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e80003b90 0x7f4e80003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.605+0000 7f4e97400640 1 --2- 172.21.15.2:0/1410566421 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4e80004780 0x7f4e80004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.605+0000 7f4e97400640 1 --2- 172.21.15.2:0/1410566421 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4e80005130 0x7f4e8000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.605+0000 7f4e97400640 1 -- 172.21.15.2:0/1410566421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e980ca620 con 0x7f4e80003b90 2024-08-17T02:24:13.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.605+0000 7f4e97400640 1 -- 172.21.15.2:0/1410566421 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8000bff0 con 0x7f4e80005130 2024-08-17T02:24:13.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.605+0000 7f4e97400640 1 -- 172.21.15.2:0/1410566421 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8000c1b0 con 0x7f4e80004780 2024-08-17T02:24:13.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.605+0000 7f4e97e00640 1 --2- 172.21.15.2:0/1410566421 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4e980cae20 0x7f4e980adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:13.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.605+0000 7f4e9d200640 1 --2- 172.21.15.2:0/1410566421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e80003b90 0x7f4e80003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.605+0000 7f4e9dc00640 1 --2- 172.21.15.2:0/1410566421 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4e80005130 0x7f4e8000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.605+0000 7f4e97e00640 1 --2- 172.21.15.2:0/1410566421 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4e80004780 0x7f4e80004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.605+0000 7f4e9d200640 1 -- 172.21.15.2:0/1410566421 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4e80004780 msgr2=0x7f4e80004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:13.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.606+0000 7f4e9d200640 1 --2- 172.21.15.2:0/1410566421 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4e80004780 0x7f4e80004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.606+0000 7f4e9d200640 1 -- 172.21.15.2:0/1410566421 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4e80005130 msgr2=0x7f4e8000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:13.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.606+0000 7f4e9d200640 1 --2- 172.21.15.2:0/1410566421 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4e80005130 0x7f4e8000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.606+0000 7f4e9d200640 1 -- 172.21.15.2:0/1410566421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e800034e0 con 0x7f4e80003b90 2024-08-17T02:24:13.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.606+0000 7f4e9d200640 1 --2- 172.21.15.2:0/1410566421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e80003b90 0x7f4e80003f80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00c190 tx=0x7f4e8c001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e664c48a29b72c5a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:13.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.607+0000 7f4e97400640 1 -- 172.21.15.2:0/1410566421 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c005960 con 0x7f4e80003b90 2024-08-17T02:24:13.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.607+0000 7f4e97400640 1 -- 172.21.15.2:0/1410566421 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8c02d070 con 0x7f4e80003b90 2024-08-17T02:24:13.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.607+0000 7f4e97400640 1 -- 172.21.15.2:0/1410566421 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c005b20 con 0x7f4e80003b90 2024-08-17T02:24:13.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.607+0000 7f4e9e600640 1 -- 172.21.15.2:0/1410566421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e80003b90 msgr2=0x7f4e80003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.607+0000 7f4e9e600640 1 --2- 172.21.15.2:0/1410566421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e80003b90 0x7f4e80003f80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00c190 tx=0x7f4e8c001d40 comp rx=0 tx=0).stop 2024-08-17T02:24:13.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.607+0000 7f4e9dc00640 1 -- 172.21.15.2:0/1410566421 reap_dead start 2024-08-17T02:24:13.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.607+0000 7f4e9e600640 1 -- 172.21.15.2:0/1410566421 shutdown_connections 2024-08-17T02:24:13.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.607+0000 7f4e9e600640 1 -- 172.21.15.2:0/1410566421 >> 172.21.15.2:0/1410566421 conn(0x7f4e98066e60 msgr2=0x7f4e98067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:13.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.607+0000 7f4e9e600640 1 -- 172.21.15.2:0/1410566421 shutdown_connections 2024-08-17T02:24:13.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.608+0000 7f4e9e600640 1 -- 172.21.15.2:0/1410566421 wait complete. 2024-08-17T02:24:13.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.609+0000 7f4e9e600640 1 Processor -- start 2024-08-17T02:24:13.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.609+0000 7f4e9e600640 1 -- start start 2024-08-17T02:24:13.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.610+0000 7f4e9e600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4e80003b90 0x7f4e98168de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.610+0000 7f4e9e600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9814d730 0x7f4e98148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.610+0000 7f4e9e600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4e98149f10 0x7f4e980ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.610+0000 7f4e9e600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9814adb0 con 0x7f4e9814d730 2024-08-17T02:24:13.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.610+0000 7f4e9e600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9814b610 con 0x7f4e80003b90 2024-08-17T02:24:13.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.610+0000 7f4e9e600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9814a880 con 0x7f4e98149f10 2024-08-17T02:24:13.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.610+0000 7f4e97e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9814d730 0x7f4e98148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.610+0000 7f4e97e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9814d730 0x7f4e98148e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48884/0 (socket says 172.21.15.2:48884) 2024-08-17T02:24:13.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.610+0000 7f4e97e00640 1 -- 172.21.15.2:0/2612954989 learned_addr learned my addr 172.21.15.2:0/2612954989 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:13.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.610+0000 7f4e9d200640 1 --2- 172.21.15.2:0/2612954989 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4e80003b90 0x7f4e98168de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.610+0000 7f4e9dc00640 1 --2- 172.21.15.2:0/2612954989 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4e98149f10 0x7f4e980ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.610+0000 7f4e97e00640 1 -- 172.21.15.2:0/2612954989 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4e98149f10 msgr2=0x7f4e980ac310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.610+0000 7f4e97e00640 1 --2- 172.21.15.2:0/2612954989 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4e98149f10 0x7f4e980ac310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.610+0000 7f4e97e00640 1 -- 172.21.15.2:0/2612954989 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4e80003b90 msgr2=0x7f4e98168de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.610+0000 7f4e97e00640 1 --2- 172.21.15.2:0/2612954989 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4e80003b90 0x7f4e98168de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.610+0000 7f4e97e00640 1 -- 172.21.15.2:0/2612954989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9814afc0 con 0x7f4e9814d730 2024-08-17T02:24:13.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.610+0000 7f4e9d200640 1 --2- 172.21.15.2:0/2612954989 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4e80003b90 0x7f4e98168de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:13.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.611+0000 7f4e97e00640 1 --2- 172.21.15.2:0/2612954989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9814d730 0x7f4e98148e00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4e84011940 tx=0x7f4e84008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:13.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.611+0000 7f4e8be00640 1 -- 172.21.15.2:0/2612954989 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e84015670 con 0x7f4e9814d730 2024-08-17T02:24:13.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.611+0000 7f4e8be00640 1 -- 172.21.15.2:0/2612954989 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e840157d0 con 0x7f4e9814d730 2024-08-17T02:24:13.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.611+0000 7f4e9e600640 1 -- 172.21.15.2:0/2612954989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9814b2a0 con 0x7f4e9814d730 2024-08-17T02:24:13.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.611+0000 7f4e8be00640 1 -- 172.21.15.2:0/2612954989 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e84015b90 con 0x7f4e9814d730 2024-08-17T02:24:13.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.611+0000 7f4e9e600640 1 -- 172.21.15.2:0/2612954989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9814a5d0 con 0x7f4e9814d730 2024-08-17T02:24:13.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.612+0000 7f4e9e600640 1 -- 172.21.15.2:0/2612954989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e9814b7a0 con 0x7f4e9814d730 2024-08-17T02:24:13.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.613+0000 7f4e8be00640 1 -- 172.21.15.2:0/2612954989 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4e84013410 con 0x7f4e9814d730 2024-08-17T02:24:13.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.614+0000 7f4e8be00640 1 --2- 172.21.15.2:0/2612954989 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4e78065150 0x7f4e78067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.614+0000 7f4e8be00640 1 -- 172.21.15.2:0/2612954989 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f4e84082450 con 0x7f4e9814d730 2024-08-17T02:24:13.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.615+0000 7f4e9d200640 1 --2- 172.21.15.2:0/2612954989 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4e78065150 0x7f4e78067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.615+0000 7f4e9d200640 1 --2- 172.21.15.2:0/2612954989 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4e78065150 0x7f4e78067600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c032000 tx=0x7f4e8c033000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:13.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.618+0000 7f4e8be00640 1 -- 172.21.15.2:0/2612954989 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4e84050420 con 0x7f4e9814d730 2024-08-17T02:24:13.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:13.800+0000 7f4e9e600640 1 -- 172.21.15.2:0/2612954989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4e98063f10 con 0x7f4e9814d730 2024-08-17T02:24:14.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.591+0000 7f4e8be00640 1 -- 172.21.15.2:0/2612954989 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4e84053a40 con 0x7f4e9814d730 2024-08-17T02:24:14.592 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:24:14.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.594+0000 7f4e9e600640 1 -- 172.21.15.2:0/2612954989 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4e78065150 msgr2=0x7f4e78067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:14.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.594+0000 7f4e9e600640 1 --2- 172.21.15.2:0/2612954989 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4e78065150 0x7f4e78067600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c032000 tx=0x7f4e8c033000 comp rx=0 tx=0).stop 2024-08-17T02:24:14.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.594+0000 7f4e9e600640 1 -- 172.21.15.2:0/2612954989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9814d730 msgr2=0x7f4e98148e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:14.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.594+0000 7f4e9e600640 1 --2- 172.21.15.2:0/2612954989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9814d730 0x7f4e98148e00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4e84011940 tx=0x7f4e84008040 comp rx=0 tx=0).stop 2024-08-17T02:24:14.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.594+0000 7f4e9e600640 1 -- 172.21.15.2:0/2612954989 shutdown_connections 2024-08-17T02:24:14.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.594+0000 7f4e9e600640 1 --2- 172.21.15.2:0/2612954989 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4e78065150 0x7f4e78067600 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.594+0000 7f4e9e600640 1 --2- 172.21.15.2:0/2612954989 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4e98149f10 0x7f4e980ac310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.594+0000 7f4e9e600640 1 --2- 172.21.15.2:0/2612954989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9814d730 0x7f4e98148e00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.594+0000 7f4e9e600640 1 --2- 172.21.15.2:0/2612954989 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4e80003b90 0x7f4e98168de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.594+0000 7f4e9e600640 1 -- 172.21.15.2:0/2612954989 >> 172.21.15.2:0/2612954989 conn(0x7f4e98066e60 msgr2=0x7f4e981544b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:14.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.594+0000 7f4e9e600640 1 -- 172.21.15.2:0/2612954989 shutdown_connections 2024-08-17T02:24:14.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.595+0000 7f4e9e600640 1 -- 172.21.15.2:0/2612954989 wait complete. 2024-08-17T02:24:14.612 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:24:14.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.772+0000 7f6b42c00640 1 Processor -- start 2024-08-17T02:24:14.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.773+0000 7f6b42c00640 1 -- start start 2024-08-17T02:24:14.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.774+0000 7f6b42c00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6b3c156ab0 0x7f6b3c0cb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:14.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.774+0000 7f6b42c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6b3c06e100 0x7f6b3c160690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:14.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.774+0000 7f6b42c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b3c06e5c0 con 0x7f6b3c0cbc60 2024-08-17T02:24:14.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.774+0000 7f6b42c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b3c06e8a0 con 0x7f6b3c06e100 2024-08-17T02:24:14.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.774+0000 7f6b42c00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b3c06eb80 con 0x7f6b3c156ab0 2024-08-17T02:24:14.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.774+0000 7f6b42200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6b3c06e100 0x7f6b3c160690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:14.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.774+0000 7f6b42200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6b3c06e100 0x7f6b3c160690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46060/0 (socket says 172.21.15.2:46060) 2024-08-17T02:24:14.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.774+0000 7f6b42200640 1 -- 172.21.15.2:0/3638706398 learned_addr learned my addr 172.21.15.2:0/3638706398 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:14.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.774+0000 7f6b41800640 1 --2- 172.21.15.2:0/3638706398 >> v2:172.21.15.145:3300/0 conn(0x7f6b3c156ab0 0x7f6b3c0cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:14.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.775+0000 7f6b42200640 1 -- 172.21.15.2:0/3638706398 >> v2:172.21.15.145:3300/0 conn(0x7f6b3c156ab0 msgr2=0x7f6b3c0cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:14.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.775+0000 7f6b42200640 1 --2- 172.21.15.2:0/3638706398 >> v2:172.21.15.145:3300/0 conn(0x7f6b3c156ab0 0x7f6b3c0cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.775+0000 7f6b42200640 1 -- 172.21.15.2:0/3638706398 >> v1:172.21.15.2:6789/0 conn(0x7f6b3c0cbc60 legacy=0x7f6b3c067670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:14.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.775+0000 7f6b42200640 1 -- 172.21.15.2:0/3638706398 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3c06ee60 con 0x7f6b3c06e100 2024-08-17T02:24:14.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.776+0000 7f6b42200640 1 --2- 172.21.15.2:0/3638706398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b3c06e100 0x7f6b3c160690 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0ccdf0 tx=0x7f6b34009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8763cc7e347fecd7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:14.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.776+0000 7f6b3be00640 1 -- 172.21.15.2:0/3638706398 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3402e050 con 0x7f6b3c06e100 2024-08-17T02:24:14.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.776+0000 7f6b3be00640 1 -- 172.21.15.2:0/3638706398 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b34007400 con 0x7f6b3c06e100 2024-08-17T02:24:14.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.776+0000 7f6b3be00640 1 -- 172.21.15.2:0/3638706398 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b340077e0 con 0x7f6b3c06e100 2024-08-17T02:24:14.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.776+0000 7f6b42c00640 1 -- 172.21.15.2:0/3638706398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b3c06e100 msgr2=0x7f6b3c160690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:14.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.776+0000 7f6b42c00640 1 --2- 172.21.15.2:0/3638706398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b3c06e100 0x7f6b3c160690 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0ccdf0 tx=0x7f6b34009840 comp rx=0 tx=0).stop 2024-08-17T02:24:14.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.777+0000 7f6b42c00640 1 -- 172.21.15.2:0/3638706398 shutdown_connections 2024-08-17T02:24:14.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.777+0000 7f6b42c00640 1 --2- 172.21.15.2:0/3638706398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b3c06e100 0x7f6b3c160690 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.777+0000 7f6b42c00640 1 --2- 172.21.15.2:0/3638706398 >> v2:172.21.15.145:3300/0 conn(0x7f6b3c156ab0 0x7f6b3c0cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.777+0000 7f6b42c00640 1 -- 172.21.15.2:0/3638706398 >> 172.21.15.2:0/3638706398 conn(0x7f6b3c0cc040 msgr2=0x7f6b3c0cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:14.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.777+0000 7f6b42c00640 1 -- 172.21.15.2:0/3638706398 shutdown_connections 2024-08-17T02:24:14.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.777+0000 7f6b42c00640 1 -- 172.21.15.2:0/3638706398 wait complete. 2024-08-17T02:24:14.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.778+0000 7f6b42c00640 1 Processor -- start 2024-08-17T02:24:14.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.778+0000 7f6b42c00640 1 -- start start 2024-08-17T02:24:14.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.779+0000 7f6b42c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b3c06e100 0x7f6b3c0af0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:14.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.779+0000 7f6b42c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b3c156ab0 0x7f6b3c14ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:14.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.779+0000 7f6b42c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b3c0b0790 0x7f6b3c153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:14.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.779+0000 7f6b42c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c0af620 con 0x7f6b3c06e100 2024-08-17T02:24:14.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.779+0000 7f6b42c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c151ca0 con 0x7f6b3c0b0790 2024-08-17T02:24:14.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.779+0000 7f6b42c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c157600 con 0x7f6b3c156ab0 2024-08-17T02:24:14.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.779+0000 7f6b41800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b3c06e100 0x7f6b3c0af0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:14.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.779+0000 7f6b41800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b3c06e100 0x7f6b3c0af0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46066/0 (socket says 172.21.15.2:46066) 2024-08-17T02:24:14.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.779+0000 7f6b41800640 1 -- 172.21.15.2:0/2619590067 learned_addr learned my addr 172.21.15.2:0/2619590067 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:14.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.779+0000 7f6b42200640 1 --2- 172.21.15.2:0/2619590067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b3c0b0790 0x7f6b3c153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:14.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.779+0000 7f6b40e00640 1 --2- 172.21.15.2:0/2619590067 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b3c156ab0 0x7f6b3c14ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:14.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.780+0000 7f6b41800640 1 -- 172.21.15.2:0/2619590067 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b3c156ab0 msgr2=0x7f6b3c14ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:14.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.780+0000 7f6b41800640 1 --2- 172.21.15.2:0/2619590067 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b3c156ab0 0x7f6b3c14ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.780+0000 7f6b41800640 1 -- 172.21.15.2:0/2619590067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b3c0b0790 msgr2=0x7f6b3c153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:14.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.780+0000 7f6b41800640 1 --2- 172.21.15.2:0/2619590067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b3c0b0790 0x7f6b3c153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.780+0000 7f6b41800640 1 -- 172.21.15.2:0/2619590067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b34009ae0 con 0x7f6b3c06e100 2024-08-17T02:24:14.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.780+0000 7f6b42200640 1 --2- 172.21.15.2:0/2619590067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b3c0b0790 0x7f6b3c153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:14.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.780+0000 7f6b41800640 1 --2- 172.21.15.2:0/2619590067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b3c06e100 0x7f6b3c0af0e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000d890 tx=0x7f6b30008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:14.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.780+0000 7f6b38c00640 1 -- 172.21.15.2:0/2619590067 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3000de20 con 0x7f6b3c06e100 2024-08-17T02:24:14.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.780+0000 7f6b38c00640 1 -- 172.21.15.2:0/2619590067 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b300098b0 con 0x7f6b3c06e100 2024-08-17T02:24:14.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.780+0000 7f6b38c00640 1 -- 172.21.15.2:0/2619590067 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30009c50 con 0x7f6b3c06e100 2024-08-17T02:24:14.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.780+0000 7f6b42c00640 1 -- 172.21.15.2:0/2619590067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b3c0af830 con 0x7f6b3c06e100 2024-08-17T02:24:14.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.780+0000 7f6b42c00640 1 -- 172.21.15.2:0/2619590067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3c0afdf0 con 0x7f6b3c06e100 2024-08-17T02:24:14.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.781+0000 7f6b42c00640 1 -- 172.21.15.2:0/2619590067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b3c063f10 con 0x7f6b3c06e100 2024-08-17T02:24:14.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.782+0000 7f6b38c00640 1 -- 172.21.15.2:0/2619590067 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6b30014620 con 0x7f6b3c06e100 2024-08-17T02:24:14.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.783+0000 7f6b38c00640 1 --2- 172.21.15.2:0/2619590067 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6b1c065150 0x7f6b1c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:14.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.783+0000 7f6b38c00640 1 -- 172.21.15.2:0/2619590067 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f6b30082bd0 con 0x7f6b3c06e100 2024-08-17T02:24:14.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.783+0000 7f6b40e00640 1 --2- 172.21.15.2:0/2619590067 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6b1c065150 0x7f6b1c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:14.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.784+0000 7f6b40e00640 1 --2- 172.21.15.2:0/2619590067 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6b1c065150 0x7f6b1c067600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c099ef0 tx=0x7f6b28009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:14.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.787+0000 7f6b38c00640 1 -- 172.21.15.2:0/2619590067 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6b30050d50 con 0x7f6b3c06e100 2024-08-17T02:24:14.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:14.978+0000 7f6b42c00640 1 -- 172.21.15.2:0/2619590067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6b3c0a91c0 con 0x7f6b3c06e100 2024-08-17T02:24:15.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.594+0000 7f6b38c00640 1 -- 172.21.15.2:0/2619590067 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6b30009db0 con 0x7f6b3c06e100 2024-08-17T02:24:15.595 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2024-08-17T02:24:15.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.597+0000 7f6b42c00640 1 -- 172.21.15.2:0/2619590067 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6b1c065150 msgr2=0x7f6b1c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.597+0000 7f6b42c00640 1 --2- 172.21.15.2:0/2619590067 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6b1c065150 0x7f6b1c067600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c099ef0 tx=0x7f6b28009040 comp rx=0 tx=0).stop 2024-08-17T02:24:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.597+0000 7f6b42c00640 1 -- 172.21.15.2:0/2619590067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b3c06e100 msgr2=0x7f6b3c0af0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.597+0000 7f6b42c00640 1 --2- 172.21.15.2:0/2619590067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b3c06e100 0x7f6b3c0af0e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000d890 tx=0x7f6b30008040 comp rx=0 tx=0).stop 2024-08-17T02:24:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.597+0000 7f6b42c00640 1 -- 172.21.15.2:0/2619590067 shutdown_connections 2024-08-17T02:24:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.597+0000 7f6b42c00640 1 --2- 172.21.15.2:0/2619590067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b3c0b0790 0x7f6b3c153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.597+0000 7f6b42c00640 1 --2- 172.21.15.2:0/2619590067 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6b1c065150 0x7f6b1c067600 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.597+0000 7f6b42c00640 1 --2- 172.21.15.2:0/2619590067 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b3c156ab0 0x7f6b3c14ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.597+0000 7f6b42c00640 1 --2- 172.21.15.2:0/2619590067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b3c06e100 0x7f6b3c0af0e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.597+0000 7f6b42c00640 1 -- 172.21.15.2:0/2619590067 >> 172.21.15.2:0/2619590067 conn(0x7f6b3c0cc040 msgr2=0x7f6b3c0c8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.597+0000 7f6b42c00640 1 -- 172.21.15.2:0/2619590067 shutdown_connections 2024-08-17T02:24:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.597+0000 7f6b42c00640 1 -- 172.21.15.2:0/2619590067 wait complete. 2024-08-17T02:24:15.616 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:24:15.616 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-17T02:24:15.616 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:24:15.616 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:24:15.617 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:24:15.617 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-17T02:24:15.617 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:24:15.617 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:24:15.617 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:24:15.617 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-17T02:24:15.617 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:24:15.617 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:24:15.618 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:24:15.618 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-17T02:24:15.618 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:24:15.618 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:24:15.634 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:24:15.634 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:24:15.635 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:24:15.635 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:24:15.636 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:24:15.636 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:24:15.637 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:24:15.637 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:24:15.678 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:24:15.678 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:15.680 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:24:15.681 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:24:15.681 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:15.681 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:15.682 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:24:15.683 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:15.683 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-17T02:24:15.809 INFO:tasks.ceph.mds.b.smithi145.stdout:starting mds.b at 2024-08-17T02:24:15.809 INFO:tasks.ceph.mds.d.smithi145.stdout:starting mds.d at 2024-08-17T02:24:15.821 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2024-08-17T02:24:15.822 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2024-08-17T02:24:15.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.855+0000 7fb142400640 1 Processor -- start 2024-08-17T02:24:15.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.855+0000 7fb142400640 1 -- start start 2024-08-17T02:24:15.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.856+0000 7fb142400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb13c159100 0x7fb13c0aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:15.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.856+0000 7fb142400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb13c069d40 0x7fb13c0af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:15.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.856+0000 7fb142400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb13c0b14e0 con 0x7fb13c067f70 2024-08-17T02:24:15.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.856+0000 7fb142400640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb13c069210 con 0x7fb13c159100 2024-08-17T02:24:15.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.856+0000 7fb142400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c0694f0 con 0x7fb13c069d40 2024-08-17T02:24:15.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.857+0000 7fb13be00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb13c067f70 0x7fb13c0ccc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38464/0 (socket says 172.21.15.2:38464) 2024-08-17T02:24:15.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.857+0000 7fb13be00640 1 -- 172.21.15.2:0/3881369867 learned_addr learned my addr 172.21.15.2:0/3881369867 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:15.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.857+0000 7fb13b400640 1 --2- 172.21.15.2:0/3881369867 >> v2:172.21.15.145:3300/0 conn(0x7fb13c159100 0x7fb13c0aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:15.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.857+0000 7fb133e00640 1 --2- 172.21.15.2:0/3881369867 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb13c069d40 0x7fb13c0af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:15.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.857+0000 7fb13b400640 1 -- 172.21.15.2:0/3881369867 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb13c069d40 msgr2=0x7fb13c0af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:15.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.857+0000 7fb13b400640 1 --2- 172.21.15.2:0/3881369867 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb13c069d40 0x7fb13c0af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.857+0000 7fb13b400640 1 -- 172.21.15.2:0/3881369867 >> v1:172.21.15.2:6789/0 conn(0x7fb13c067f70 legacy=0x7fb13c0ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:15.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.857+0000 7fb13aa00640 1 -- 172.21.15.2:0/3881369867 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1973764285 0 0) 0x7fb13c0b14e0 con 0x7fb13c067f70 2024-08-17T02:24:15.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.857+0000 7fb13b400640 1 -- 172.21.15.2:0/3881369867 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c0697d0 con 0x7fb13c159100 2024-08-17T02:24:15.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.857+0000 7fb133e00640 1 --2- 172.21.15.2:0/3881369867 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb13c069d40 0x7fb13c0af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:15.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.858+0000 7fb13b400640 1 --2- 172.21.15.2:0/3881369867 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb13c159100 0x7fb13c0aeae0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009850 tx=0x7fb12c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afe5163592988d94 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:15.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.858+0000 7fb13aa00640 1 -- 172.21.15.2:0/3881369867 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c02ad00 con 0x7fb13c159100 2024-08-17T02:24:15.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.858+0000 7fb13aa00640 1 -- 172.21.15.2:0/3881369867 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12c02ae60 con 0x7fb13c159100 2024-08-17T02:24:15.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.858+0000 7fb13aa00640 1 -- 172.21.15.2:0/3881369867 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c032670 con 0x7fb13c159100 2024-08-17T02:24:15.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.859+0000 7fb142400640 1 -- 172.21.15.2:0/3881369867 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb13c159100 msgr2=0x7fb13c0aeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:15.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.859+0000 7fb142400640 1 --2- 172.21.15.2:0/3881369867 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb13c159100 0x7fb13c0aeae0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009850 tx=0x7fb12c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.859+0000 7fb142400640 1 -- 172.21.15.2:0/3881369867 shutdown_connections 2024-08-17T02:24:15.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.859+0000 7fb142400640 1 --2- 172.21.15.2:0/3881369867 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb13c069d40 0x7fb13c0af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.859+0000 7fb142400640 1 --2- 172.21.15.2:0/3881369867 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb13c159100 0x7fb13c0aeae0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.859+0000 7fb142400640 1 -- 172.21.15.2:0/3881369867 >> 172.21.15.2:0/3881369867 conn(0x7fb13c0ce5e0 msgr2=0x7fb13c095d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:15.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.859+0000 7fb142400640 1 -- 172.21.15.2:0/3881369867 shutdown_connections 2024-08-17T02:24:15.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.859+0000 7fb142400640 1 -- 172.21.15.2:0/3881369867 wait complete. 2024-08-17T02:24:15.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.860+0000 7fb142400640 1 Processor -- start 2024-08-17T02:24:15.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.861+0000 7fb142400640 1 -- start start 2024-08-17T02:24:15.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.861+0000 7fb142400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb13c067f70 0x7fb13c169100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:15.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.861+0000 7fb142400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb13c069d40 0x7fb13c09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:15.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.862+0000 7fb142400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb13c159100 0x7fb13c09af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:15.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.862+0000 7fb142400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c09a5b0 con 0x7fb13c067f70 2024-08-17T02:24:15.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.862+0000 7fb142400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c0999e0 con 0x7fb13c069d40 2024-08-17T02:24:15.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.862+0000 7fb142400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c099c80 con 0x7fb13c159100 2024-08-17T02:24:15.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.862+0000 7fb13b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb13c067f70 0x7fb13c169100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:15.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.862+0000 7fb13b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb13c067f70 0x7fb13c169100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46120/0 (socket says 172.21.15.2:46120) 2024-08-17T02:24:15.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.862+0000 7fb13b400640 1 -- 172.21.15.2:0/1338722014 learned_addr learned my addr 172.21.15.2:0/1338722014 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:15.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.862+0000 7fb133e00640 1 --2- 172.21.15.2:0/1338722014 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb13c069d40 0x7fb13c09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:15.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.862+0000 7fb13be00640 1 --2- 172.21.15.2:0/1338722014 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb13c159100 0x7fb13c09af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:15.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.862+0000 7fb133e00640 1 -- 172.21.15.2:0/1338722014 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb13c159100 msgr2=0x7fb13c09af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:15.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.862+0000 7fb133e00640 1 --2- 172.21.15.2:0/1338722014 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb13c159100 0x7fb13c09af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.862+0000 7fb133e00640 1 -- 172.21.15.2:0/1338722014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb13c067f70 msgr2=0x7fb13c169100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:15.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.862+0000 7fb133e00640 1 --2- 172.21.15.2:0/1338722014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb13c067f70 0x7fb13c169100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.862+0000 7fb133e00640 1 -- 172.21.15.2:0/1338722014 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb124009390 con 0x7fb13c069d40 2024-08-17T02:24:15.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.863+0000 7fb133e00640 1 --2- 172.21.15.2:0/1338722014 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb13c069d40 0x7fb13c09aa40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb12400ea50 tx=0x7fb1240090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:15.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.863+0000 7fb132a00640 1 -- 172.21.15.2:0/1338722014 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12400ca10 con 0x7fb13c069d40 2024-08-17T02:24:15.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.863+0000 7fb132a00640 1 -- 172.21.15.2:0/1338722014 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12400cb70 con 0x7fb13c069d40 2024-08-17T02:24:15.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.863+0000 7fb132a00640 1 -- 172.21.15.2:0/1338722014 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb124013470 con 0x7fb13c069d40 2024-08-17T02:24:15.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.863+0000 7fb142400640 1 -- 172.21.15.2:0/1338722014 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb12c009390 con 0x7fb13c069d40 2024-08-17T02:24:15.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.863+0000 7fb142400640 1 -- 172.21.15.2:0/1338722014 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb13c09a240 con 0x7fb13c069d40 2024-08-17T02:24:15.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.864+0000 7fb142400640 1 -- 172.21.15.2:0/1338722014 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb13c063fb0 con 0x7fb13c069d40 2024-08-17T02:24:15.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.865+0000 7fb132a00640 1 -- 172.21.15.2:0/1338722014 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb124013860 con 0x7fb13c069d40 2024-08-17T02:24:15.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.866+0000 7fb132a00640 1 --2- 172.21.15.2:0/1338722014 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb118065150 0x7fb118067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:15.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.866+0000 7fb132a00640 1 -- 172.21.15.2:0/1338722014 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb1240824c0 con 0x7fb13c069d40 2024-08-17T02:24:15.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.866+0000 7fb13b400640 1 --2- 172.21.15.2:0/1338722014 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb118065150 0x7fb118067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:15.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.867+0000 7fb13b400640 1 --2- 172.21.15.2:0/1338722014 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb118065150 0x7fb118067600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009130 tx=0x7fb12c032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:15.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:15.870+0000 7fb132a00640 1 -- 172.21.15.2:0/1338722014 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb124050890 con 0x7fb13c069d40 2024-08-17T02:24:16.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.067+0000 7fb142400640 1 -- 172.21.15.2:0/1338722014 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb13c062f50 con 0x7fb13c069d40 2024-08-17T02:24:16.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.613+0000 7fb132a00640 1 -- 172.21.15.2:0/1338722014 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb124053eb0 con 0x7fb13c069d40 2024-08-17T02:24:16.613 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blocklist entries 2024-08-17T02:24:16.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.615+0000 7fb142400640 1 -- 172.21.15.2:0/1338722014 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb118065150 msgr2=0x7fb118067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:16.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.615+0000 7fb142400640 1 --2- 172.21.15.2:0/1338722014 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb118065150 0x7fb118067600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009130 tx=0x7fb12c032000 comp rx=0 tx=0).stop 2024-08-17T02:24:16.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.615+0000 7fb142400640 1 -- 172.21.15.2:0/1338722014 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb13c069d40 msgr2=0x7fb13c09aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:16.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.615+0000 7fb142400640 1 --2- 172.21.15.2:0/1338722014 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb13c069d40 0x7fb13c09aa40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb12400ea50 tx=0x7fb1240090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:16.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.615+0000 7fb142400640 1 -- 172.21.15.2:0/1338722014 shutdown_connections 2024-08-17T02:24:16.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.615+0000 7fb142400640 1 --2- 172.21.15.2:0/1338722014 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb118065150 0x7fb118067600 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:16.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.615+0000 7fb142400640 1 --2- 172.21.15.2:0/1338722014 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb13c159100 0x7fb13c09af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:16.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.615+0000 7fb142400640 1 --2- 172.21.15.2:0/1338722014 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb13c069d40 0x7fb13c09aa40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:16.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.615+0000 7fb142400640 1 --2- 172.21.15.2:0/1338722014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb13c067f70 0x7fb13c169100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:16.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.615+0000 7fb142400640 1 -- 172.21.15.2:0/1338722014 >> 172.21.15.2:0/1338722014 conn(0x7fb13c0ce5e0 msgr2=0x7fb13c157ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:16.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.616+0000 7fb142400640 1 -- 172.21.15.2:0/1338722014 shutdown_connections 2024-08-17T02:24:16.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.616+0000 7fb142400640 1 -- 172.21.15.2:0/1338722014 wait complete. 2024-08-17T02:24:16.634 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-17T02:24:16.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.787+0000 7fb492200640 1 Processor -- start 2024-08-17T02:24:16.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.787+0000 7fb492200640 1 -- start start 2024-08-17T02:24:16.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.789+0000 7fb492200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb48c0ca050 0x7fb48c156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:16.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.789+0000 7fb492200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb48c0add30 0x7fb48c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:16.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.789+0000 7fb492200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb48c15b5e0 con 0x7fb48c0ad960 2024-08-17T02:24:16.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.789+0000 7fb492200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb48c0cb160 con 0x7fb48c0add30 2024-08-17T02:24:16.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.789+0000 7fb492200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c0b0d10 con 0x7fb48c0ca050 2024-08-17T02:24:16.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.789+0000 7fb48be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb48c0add30 0x7fb48c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:16.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.789+0000 7fb48b400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb48c0ad960 0x7fb48c156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38472/0 (socket says 172.21.15.2:38472) 2024-08-17T02:24:16.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.789+0000 7fb48b400640 1 -- 172.21.15.2:0/2610028168 learned_addr learned my addr 172.21.15.2:0/2610028168 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:16.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.789+0000 7fb48be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb48c0add30 0x7fb48c15b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46132/0 (socket says 172.21.15.2:46132) 2024-08-17T02:24:16.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.789+0000 7fb483e00640 1 --2- 172.21.15.2:0/2610028168 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb48c0ca050 0x7fb48c156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:16.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.789+0000 7fb48be00640 1 -- 172.21.15.2:0/2610028168 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb48c0ca050 msgr2=0x7fb48c156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:16.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.789+0000 7fb48be00640 1 --2- 172.21.15.2:0/2610028168 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb48c0ca050 0x7fb48c156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:16.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.789+0000 7fb48be00640 1 -- 172.21.15.2:0/2610028168 >> v1:172.21.15.2:6789/0 conn(0x7fb48c0ad960 legacy=0x7fb48c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:16.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.789+0000 7fb48aa00640 1 -- 172.21.15.2:0/2610028168 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1681357831 0 0) 0x7fb47c001110 con 0x7fb48c0ad960 2024-08-17T02:24:16.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.789+0000 7fb48be00640 1 -- 172.21.15.2:0/2610028168 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48c0ca550 con 0x7fb48c0add30 2024-08-17T02:24:16.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.789+0000 7fb483e00640 1 --2- 172.21.15.2:0/2610028168 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb48c0ca050 0x7fb48c156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:16.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.790+0000 7fb48be00640 1 --2- 172.21.15.2:0/2610028168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb48c0add30 0x7fb48c15b0a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb484009e60 tx=0x7fb484009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0db0b6c362c53d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:16.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.791+0000 7fb48aa00640 1 -- 172.21.15.2:0/2610028168 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb484007550 con 0x7fb48c0add30 2024-08-17T02:24:16.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.791+0000 7fb48aa00640 1 -- 172.21.15.2:0/2610028168 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48402d050 con 0x7fb48c0add30 2024-08-17T02:24:16.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.791+0000 7fb48aa00640 1 -- 172.21.15.2:0/2610028168 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb484007900 con 0x7fb48c0add30 2024-08-17T02:24:16.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.791+0000 7fb492200640 1 -- 172.21.15.2:0/2610028168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb48c0add30 msgr2=0x7fb48c15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:16.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.791+0000 7fb492200640 1 --2- 172.21.15.2:0/2610028168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb48c0add30 0x7fb48c15b0a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb484009e60 tx=0x7fb484009780 comp rx=0 tx=0).stop 2024-08-17T02:24:16.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.791+0000 7fb492200640 1 -- 172.21.15.2:0/2610028168 shutdown_connections 2024-08-17T02:24:16.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.791+0000 7fb492200640 1 --2- 172.21.15.2:0/2610028168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb48c0add30 0x7fb48c15b0a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:16.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.791+0000 7fb492200640 1 --2- 172.21.15.2:0/2610028168 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb48c0ca050 0x7fb48c156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:16.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.791+0000 7fb492200640 1 -- 172.21.15.2:0/2610028168 >> 172.21.15.2:0/2610028168 conn(0x7fb48c066e60 msgr2=0x7fb48c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:16.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.791+0000 7fb492200640 1 -- 172.21.15.2:0/2610028168 shutdown_connections 2024-08-17T02:24:16.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.791+0000 7fb492200640 1 -- 172.21.15.2:0/2610028168 wait complete. 2024-08-17T02:24:16.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.793+0000 7fb492200640 1 Processor -- start 2024-08-17T02:24:16.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.793+0000 7fb492200640 1 -- start start 2024-08-17T02:24:16.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.794+0000 7fb492200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb48c0ad960 0x7fb48c144a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:16.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.794+0000 7fb492200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb48c0add30 0x7fb48c06dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.794+0000 7fb492200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb48c0ca050 0x7fb48c06e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.794+0000 7fb492200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c06b1a0 con 0x7fb48c0add30 2024-08-17T02:24:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.794+0000 7fb492200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c06a590 con 0x7fb48c0ca050 2024-08-17T02:24:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.794+0000 7fb492200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c06a870 con 0x7fb48c0ad960 2024-08-17T02:24:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.794+0000 7fb483e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb48c0add30 0x7fb48c06dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.794+0000 7fb483e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb48c0add30 0x7fb48c06dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46136/0 (socket says 172.21.15.2:46136) 2024-08-17T02:24:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.794+0000 7fb483e00640 1 -- 172.21.15.2:0/1042973715 learned_addr learned my addr 172.21.15.2:0/1042973715 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.794+0000 7fb48b400640 1 --2- 172.21.15.2:0/1042973715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb48c0ad960 0x7fb48c144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.794+0000 7fb48be00640 1 --2- 172.21.15.2:0/1042973715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb48c0ca050 0x7fb48c06e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.794+0000 7fb483e00640 1 -- 172.21.15.2:0/1042973715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb48c0ad960 msgr2=0x7fb48c144a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.794+0000 7fb483e00640 1 --2- 172.21.15.2:0/1042973715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb48c0ad960 0x7fb48c144a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.794+0000 7fb483e00640 1 -- 172.21.15.2:0/1042973715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb48c0ca050 msgr2=0x7fb48c06e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.794+0000 7fb483e00640 1 --2- 172.21.15.2:0/1042973715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb48c0ca050 0x7fb48c06e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:16.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.794+0000 7fb483e00640 1 -- 172.21.15.2:0/1042973715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb484009a20 con 0x7fb48c0add30 2024-08-17T02:24:16.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.794+0000 7fb48b400640 1 --2- 172.21.15.2:0/1042973715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb48c0ad960 0x7fb48c144a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:16.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.795+0000 7fb483e00640 1 --2- 172.21.15.2:0/1042973715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb48c0add30 0x7fb48c06dfd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb47400d890 tx=0x7fb474008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:16.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.795+0000 7fb482a00640 1 -- 172.21.15.2:0/1042973715 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47400de20 con 0x7fb48c0add30 2024-08-17T02:24:16.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.795+0000 7fb482a00640 1 -- 172.21.15.2:0/1042973715 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4740098b0 con 0x7fb48c0add30 2024-08-17T02:24:16.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.795+0000 7fb482a00640 1 -- 172.21.15.2:0/1042973715 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb474009c50 con 0x7fb48c0add30 2024-08-17T02:24:16.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.795+0000 7fb492200640 1 -- 172.21.15.2:0/1042973715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb48c06ab50 con 0x7fb48c0add30 2024-08-17T02:24:16.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.795+0000 7fb492200640 1 -- 172.21.15.2:0/1042973715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48c144fa0 con 0x7fb48c0add30 2024-08-17T02:24:16.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.796+0000 7fb492200640 1 -- 172.21.15.2:0/1042973715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48c063fb0 con 0x7fb48c0add30 2024-08-17T02:24:16.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.797+0000 7fb482a00640 1 -- 172.21.15.2:0/1042973715 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb47401e460 con 0x7fb48c0add30 2024-08-17T02:24:16.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.798+0000 7fb482a00640 1 --2- 172.21.15.2:0/1042973715 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb468065150 0x7fb468067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:16.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.798+0000 7fb482a00640 1 -- 172.21.15.2:0/1042973715 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb474082840 con 0x7fb48c0add30 2024-08-17T02:24:16.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.798+0000 7fb48b400640 1 --2- 172.21.15.2:0/1042973715 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb468065150 0x7fb468067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:16.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.799+0000 7fb48b400640 1 --2- 172.21.15.2:0/1042973715 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb468065150 0x7fb468067600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb48c06bbb0 tx=0x7fb47c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:16.802+0000 7fb482a00640 1 -- 172.21.15.2:0/1042973715 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb474054640 con 0x7fb48c0add30 2024-08-17T02:24:17.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.050+0000 7fb492200640 1 -- 172.21.15.2:0/1042973715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb48c06b2e0 con 0x7fb48c0add30 2024-08-17T02:24:17.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.050+0000 7fb482a00640 1 -- 172.21.15.2:0/1042973715 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fb4740541d0 con 0x7fb48c0add30 2024-08-17T02:24:17.050 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:24:17.051 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-17T02:24:17.051 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2024-08-17T02:24:17.051 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.051 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2024-08-17T02:24:17.051 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBvCcBmb9GqJhAAjrQLZjEhK0srQETT3P69Ng==", 2024-08-17T02:24:17.051 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.051 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-08-17T02:24:17.051 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2024-08-17T02:24:17.051 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2024-08-17T02:24:17.051 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:24:17.051 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.052 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:17.052 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.052 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2024-08-17T02:24:17.052 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBvCcBmkROjORAAqWPiQxu1+5BIe95RedFjQg==", 2024-08-17T02:24:17.052 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.052 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-08-17T02:24:17.052 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2024-08-17T02:24:17.052 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2024-08-17T02:24:17.052 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:24:17.052 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.052 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:17.052 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.052 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.c", 2024-08-17T02:24:17.053 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBvCcBmI8MnMBAA9PSoSvdG6kH2HD+WdhsVGw==", 2024-08-17T02:24:17.053 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.053 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-08-17T02:24:17.053 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2024-08-17T02:24:17.053 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2024-08-17T02:24:17.053 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:24:17.053 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.053 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:17.053 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.053 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.d", 2024-08-17T02:24:17.053 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBwCcBmBSFRBxAAP1nEz2KnWwYlwcisXK0a9g==", 2024-08-17T02:24:17.053 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.053 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-08-17T02:24:17.053 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2024-08-17T02:24:17.054 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2024-08-17T02:24:17.054 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:24:17.054 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.054 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:17.054 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.054 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2024-08-17T02:24:17.054 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBxCcBmCrWGOBAAmZWigQg/P7akSJVjplcKvg==", 2024-08-17T02:24:17.054 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.054 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-08-17T02:24:17.054 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-08-17T02:24:17.054 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:24:17.055 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.055 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:17.055 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.055 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2024-08-17T02:24:17.055 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQB1CcBm7fhIARAANtK9JQfxZVBwT+oVkINk3w==", 2024-08-17T02:24:17.055 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.055 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-08-17T02:24:17.055 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-08-17T02:24:17.055 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:24:17.055 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.055 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2024-08-17T02:24:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQB4CcBmRF75BBAADNzPVcb2yvLXHgS+UmzWPQ==", 2024-08-17T02:24:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-08-17T02:24:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-08-17T02:24:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:24:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2024-08-17T02:24:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQB7CcBmDOTrBxAASyI0BQz8oCWUv+1qjIy/wg==", 2024-08-17T02:24:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.057 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-08-17T02:24:17.057 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-08-17T02:24:17.057 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:24:17.057 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.057 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:17.057 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.057 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2024-08-17T02:24:17.057 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCBCcBmNZCMABAA7+GJp5LfDxOX0FhF/gpYcA==", 2024-08-17T02:24:17.057 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.057 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-08-17T02:24:17.057 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-08-17T02:24:17.057 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:24:17.057 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.057 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:17.058 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.058 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2024-08-17T02:24:17.058 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCECcBmtORCBBAAn0lNM1S6REDpCCbjB94ooA==", 2024-08-17T02:24:17.058 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.058 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-08-17T02:24:17.058 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-08-17T02:24:17.058 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:24:17.058 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.058 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:17.058 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.058 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2024-08-17T02:24:17.058 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCHCcBm68hzCBAAFb21xFgI5LySVcHt1gP0aQ==", 2024-08-17T02:24:17.059 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.059 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-08-17T02:24:17.059 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-08-17T02:24:17.059 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:24:17.059 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.059 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:17.059 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.059 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2024-08-17T02:24:17.059 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCKCcBm8gaXDRAAK7SLxSJO9FXHBIQZB8ouQA==", 2024-08-17T02:24:17.059 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.059 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-08-17T02:24:17.060 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-08-17T02:24:17.060 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:24:17.060 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.060 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:17.060 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.060 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2024-08-17T02:24:17.060 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBwCcBmssdtDxAASkIYITbSqZHZouto8BcmZw==", 2024-08-17T02:24:17.060 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.060 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-08-17T02:24:17.060 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2024-08-17T02:24:17.060 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2024-08-17T02:24:17.060 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2024-08-17T02:24:17.060 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.061 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:17.061 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.061 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2024-08-17T02:24:17.061 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBwCcBmFSeSGxAAJsRcOdtuooES7d/9tdnz1A==", 2024-08-17T02:24:17.061 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.061 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-08-17T02:24:17.061 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2024-08-17T02:24:17.061 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2024-08-17T02:24:17.061 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2024-08-17T02:24:17.061 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.061 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:17.061 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.061 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2024-08-17T02:24:17.062 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBwCcBmNH6AFRAAXVSUQfj7HQae+UNNB3b52Q==", 2024-08-17T02:24:17.062 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.062 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-08-17T02:24:17.062 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2024-08-17T02:24:17.062 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2024-08-17T02:24:17.062 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2024-08-17T02:24:17.062 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.062 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:17.062 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.062 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.3", 2024-08-17T02:24:17.062 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBwCcBmwlOTIRAAKN1PcscSDN/CX7uH7vbEjQ==", 2024-08-17T02:24:17.062 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.062 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-08-17T02:24:17.063 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2024-08-17T02:24:17.063 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2024-08-17T02:24:17.063 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2024-08-17T02:24:17.063 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.063 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:17.063 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.063 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2024-08-17T02:24:17.063 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBuCcBmt4EYNBAAeiuMEhXV/JXVEMNSbWohVA==", 2024-08-17T02:24:17.063 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.063 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2024-08-17T02:24:17.063 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2024-08-17T02:24:17.063 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2024-08-17T02:24:17.064 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:24:17.064 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.064 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:17.064 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.064 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-mds", 2024-08-17T02:24:17.064 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCRCcBm5gYYIhAAhZpRAMLCLtrTEibbPBEmpg==", 2024-08-17T02:24:17.064 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.064 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-mds" 2024-08-17T02:24:17.064 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.064 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:17.064 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.064 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-mgr", 2024-08-17T02:24:17.064 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCRCcBmNBcYIhAAWtaNiHOb1b3ewJRBKyNebg==", 2024-08-17T02:24:17.064 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.065 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-mgr" 2024-08-17T02:24:17.065 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.065 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:17.065 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.065 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-osd", 2024-08-17T02:24:17.065 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCRCcBmjiYYIhAA+dxM4mHyQi+8KoSOvq6B7g==", 2024-08-17T02:24:17.065 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.065 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-osd" 2024-08-17T02:24:17.065 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.065 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:17.066 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.066 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-rbd", 2024-08-17T02:24:17.066 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCRCcBmSTUYIhAAcyrKjS1XHOwExetBzYpN7A==", 2024-08-17T02:24:17.066 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.066 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-rbd" 2024-08-17T02:24:17.066 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.066 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:17.066 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.066 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-08-17T02:24:17.066 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCRCcBmRD4YIhAA5S9+tQaGKDqRTHoOarRteA==", 2024-08-17T02:24:17.066 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.067 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-08-17T02:24:17.067 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.067 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:17.067 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.067 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-rgw", 2024-08-17T02:24:17.067 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCRCcBm1kYYIhAAJOt6xBZzZnobrEpForTuXg==", 2024-08-17T02:24:17.067 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.067 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-rgw" 2024-08-17T02:24:17.067 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.067 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:17.068 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.068 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2024-08-17T02:24:17.068 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBvCcBmtDxrIBAAolNgIbldebcVMGMphE133Q==", 2024-08-17T02:24:17.068 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.068 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2024-08-17T02:24:17.068 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2024-08-17T02:24:17.068 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:24:17.068 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.068 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:17.068 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:17.068 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2024-08-17T02:24:17.068 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBvCcBmB03dGRAAyO2HdzwzRHbPmPbrniDmdg==", 2024-08-17T02:24:17.068 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:24:17.069 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2024-08-17T02:24:17.069 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2024-08-17T02:24:17.069 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:24:17.069 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.069 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:17.069 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-08-17T02:24:17.069 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-17T02:24:17.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.052+0000 7fb492200640 1 -- 172.21.15.2:0/1042973715 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb468065150 msgr2=0x7fb468067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:17.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.052+0000 7fb492200640 1 --2- 172.21.15.2:0/1042973715 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb468065150 0x7fb468067600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb48c06bbb0 tx=0x7fb47c009040 comp rx=0 tx=0).stop 2024-08-17T02:24:17.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.052+0000 7fb492200640 1 -- 172.21.15.2:0/1042973715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb48c0add30 msgr2=0x7fb48c06dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:17.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.052+0000 7fb492200640 1 --2- 172.21.15.2:0/1042973715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb48c0add30 0x7fb48c06dfd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb47400d890 tx=0x7fb474008040 comp rx=0 tx=0).stop 2024-08-17T02:24:17.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.053+0000 7fb492200640 1 -- 172.21.15.2:0/1042973715 shutdown_connections 2024-08-17T02:24:17.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.053+0000 7fb492200640 1 --2- 172.21.15.2:0/1042973715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb48c0ca050 0x7fb48c06e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.053+0000 7fb492200640 1 --2- 172.21.15.2:0/1042973715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb48c0add30 0x7fb48c06dfd0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.053+0000 7fb492200640 1 --2- 172.21.15.2:0/1042973715 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb468065150 0x7fb468067600 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.053+0000 7fb492200640 1 --2- 172.21.15.2:0/1042973715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb48c0ad960 0x7fb48c144a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.053+0000 7fb492200640 1 -- 172.21.15.2:0/1042973715 >> 172.21.15.2:0/1042973715 conn(0x7fb48c066e60 msgr2=0x7fb48c1558b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:17.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.053+0000 7fb492200640 1 -- 172.21.15.2:0/1042973715 shutdown_connections 2024-08-17T02:24:17.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.053+0000 7fb492200640 1 -- 172.21.15.2:0/1042973715 wait complete. 2024-08-17T02:24:17.072 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-08-17T02:24:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.224+0000 7fc92f000640 1 Processor -- start 2024-08-17T02:24:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.224+0000 7fc92f000640 1 -- start start 2024-08-17T02:24:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.225+0000 7fc92f000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc9280ae910 0x7fc9280aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.225+0000 7fc92f000640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc928160720 0x7fc928162b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.225+0000 7fc92f000640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9280aab10 con 0x7fc9280ae540 2024-08-17T02:24:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.225+0000 7fc92f000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9280abfb0 con 0x7fc9280ae910 2024-08-17T02:24:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.225+0000 7fc92f000640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9280ac250 con 0x7fc928160720 2024-08-17T02:24:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.225+0000 7fc92d200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc9280ae910 0x7fc9280aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.225+0000 7fc92d200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc9280ae910 0x7fc9280aed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46146/0 (socket says 172.21.15.2:46146) 2024-08-17T02:24:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.225+0000 7fc92d200640 1 -- 172.21.15.2:0/1665424455 learned_addr learned my addr 172.21.15.2:0/1665424455 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.225+0000 7fc92e600640 1 --2- 172.21.15.2:0/1665424455 >> v2:172.21.15.145:3300/0 conn(0x7fc928160720 0x7fc928162b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.226+0000 7fc92d200640 1 -- 172.21.15.2:0/1665424455 >> v2:172.21.15.145:3300/0 conn(0x7fc928160720 msgr2=0x7fc928162b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:17.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.226+0000 7fc92d200640 1 --2- 172.21.15.2:0/1665424455 >> v2:172.21.15.145:3300/0 conn(0x7fc928160720 0x7fc928162b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.226+0000 7fc92d200640 1 -- 172.21.15.2:0/1665424455 >> v1:172.21.15.145:6789/0 conn(0x7fc9280ae540 legacy=0x7fc928068950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:17.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.226+0000 7fc92d200640 1 -- 172.21.15.2:0/1665424455 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9280693e0 con 0x7fc9280ae910 2024-08-17T02:24:17.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.227+0000 7fc92d200640 1 --2- 172.21.15.2:0/1665424455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9280ae910 0x7fc9280aed30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc9280b0000 tx=0x7fc9140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=271267ad36602a62 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:17.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.227+0000 7fc927e00640 1 -- 172.21.15.2:0/1665424455 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91402adf0 con 0x7fc9280ae910 2024-08-17T02:24:17.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.227+0000 7fc927e00640 1 -- 172.21.15.2:0/1665424455 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc914032440 con 0x7fc9280ae910 2024-08-17T02:24:17.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.227+0000 7fc927e00640 1 -- 172.21.15.2:0/1665424455 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc914032820 con 0x7fc9280ae910 2024-08-17T02:24:17.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.228+0000 7fc92f000640 1 -- 172.21.15.2:0/1665424455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9280ae910 msgr2=0x7fc9280aed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:17.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.228+0000 7fc92f000640 1 --2- 172.21.15.2:0/1665424455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9280ae910 0x7fc9280aed30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc9280b0000 tx=0x7fc9140091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.228+0000 7fc92f000640 1 -- 172.21.15.2:0/1665424455 shutdown_connections 2024-08-17T02:24:17.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.228+0000 7fc92f000640 1 --2- 172.21.15.2:0/1665424455 >> v2:172.21.15.145:3300/0 conn(0x7fc928160720 0x7fc928162b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.228+0000 7fc92f000640 1 --2- 172.21.15.2:0/1665424455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9280ae910 0x7fc9280aed30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.228+0000 7fc92f000640 1 -- 172.21.15.2:0/1665424455 >> 172.21.15.2:0/1665424455 conn(0x7fc9280ce400 msgr2=0x7fc928095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:17.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.228+0000 7fc92f000640 1 -- 172.21.15.2:0/1665424455 shutdown_connections 2024-08-17T02:24:17.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.228+0000 7fc92f000640 1 -- 172.21.15.2:0/1665424455 wait complete. 2024-08-17T02:24:17.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.229+0000 7fc92f000640 1 Processor -- start 2024-08-17T02:24:17.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.229+0000 7fc92f000640 1 -- start start 2024-08-17T02:24:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.230+0000 7fc92f000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9280ae540 0x7fc928155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.230+0000 7fc92f000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9280ae910 0x7fc928097bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.230+0000 7fc92f000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc928160720 0x7fc928099ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.230+0000 7fc92f000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9280992c0 con 0x7fc9280ae540 2024-08-17T02:24:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.230+0000 7fc92f000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc928155b60 con 0x7fc928160720 2024-08-17T02:24:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.230+0000 7fc92f000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9280986b0 con 0x7fc9280ae910 2024-08-17T02:24:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.230+0000 7fc92dc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9280ae540 0x7fc928155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.230+0000 7fc92dc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9280ae540 0x7fc928155620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46158/0 (socket says 172.21.15.2:46158) 2024-08-17T02:24:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.230+0000 7fc92dc00640 1 -- 172.21.15.2:0/2863214411 learned_addr learned my addr 172.21.15.2:0/2863214411 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.231+0000 7fc92e600640 1 --2- 172.21.15.2:0/2863214411 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc928160720 0x7fc928099ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.231+0000 7fc92d200640 1 --2- 172.21.15.2:0/2863214411 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9280ae910 0x7fc928097bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.231+0000 7fc92dc00640 1 -- 172.21.15.2:0/2863214411 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9280ae910 msgr2=0x7fc928097bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.231+0000 7fc92dc00640 1 --2- 172.21.15.2:0/2863214411 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9280ae910 0x7fc928097bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.231+0000 7fc92dc00640 1 -- 172.21.15.2:0/2863214411 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc928160720 msgr2=0x7fc928099ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.231+0000 7fc92dc00640 1 --2- 172.21.15.2:0/2863214411 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc928160720 0x7fc928099ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.231+0000 7fc92dc00640 1 -- 172.21.15.2:0/2863214411 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc914009450 con 0x7fc9280ae540 2024-08-17T02:24:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.231+0000 7fc92d200640 1 --2- 172.21.15.2:0/2863214411 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9280ae910 0x7fc928097bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.231+0000 7fc92e600640 1 --2- 172.21.15.2:0/2863214411 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc928160720 0x7fc928099ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:17.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.231+0000 7fc92dc00640 1 --2- 172.21.15.2:0/2863214411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9280ae540 0x7fc928155620 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc91c00c4c0 tx=0x7fc91c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:17.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.231+0000 7fc924c00640 1 -- 172.21.15.2:0/2863214411 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c011590 con 0x7fc9280ae540 2024-08-17T02:24:17.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.231+0000 7fc924c00640 1 -- 172.21.15.2:0/2863214411 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91c011710 con 0x7fc9280ae540 2024-08-17T02:24:17.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.231+0000 7fc924c00640 1 -- 172.21.15.2:0/2863214411 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c011ad0 con 0x7fc9280ae540 2024-08-17T02:24:17.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.231+0000 7fc92f000640 1 -- 172.21.15.2:0/2863214411 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc928098990 con 0x7fc9280ae540 2024-08-17T02:24:17.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.232+0000 7fc92f000640 1 -- 172.21.15.2:0/2863214411 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc928098f50 con 0x7fc9280ae540 2024-08-17T02:24:17.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.233+0000 7fc92f000640 1 -- 172.21.15.2:0/2863214411 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc928070720 con 0x7fc9280ae540 2024-08-17T02:24:17.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.233+0000 7fc924c00640 1 -- 172.21.15.2:0/2863214411 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc91c01b3b0 con 0x7fc9280ae540 2024-08-17T02:24:17.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.234+0000 7fc924c00640 1 --2- 172.21.15.2:0/2863214411 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc908065150 0x7fc908067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:17.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.234+0000 7fc924c00640 1 -- 172.21.15.2:0/2863214411 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc91c0816d0 con 0x7fc9280ae540 2024-08-17T02:24:17.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.235+0000 7fc92d200640 1 --2- 172.21.15.2:0/2863214411 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc908065150 0x7fc908067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:17.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.236+0000 7fc92d200640 1 --2- 172.21.15.2:0/2863214411 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc908065150 0x7fc908067600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc914034000 tx=0x7fc914032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:17.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.239+0000 7fc924c00640 1 -- 172.21.15.2:0/2863214411 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc91c04fa40 con 0x7fc9280ae540 2024-08-17T02:24:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.489+0000 7fc92f000640 1 -- 172.21.15.2:0/2863214411 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fc92806c1d0 con 0x7fc9280ae540 2024-08-17T02:24:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.493+0000 7fc924c00640 1 -- 172.21.15.2:0/2863214411 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc91c017020 con 0x7fc9280ae540 2024-08-17T02:24:17.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.495+0000 7fc92f000640 1 -- 172.21.15.2:0/2863214411 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc908065150 msgr2=0x7fc908067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:17.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.495+0000 7fc92f000640 1 --2- 172.21.15.2:0/2863214411 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc908065150 0x7fc908067600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc914034000 tx=0x7fc914032000 comp rx=0 tx=0).stop 2024-08-17T02:24:17.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.495+0000 7fc92f000640 1 -- 172.21.15.2:0/2863214411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9280ae540 msgr2=0x7fc928155620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:17.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.495+0000 7fc92f000640 1 --2- 172.21.15.2:0/2863214411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9280ae540 0x7fc928155620 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc91c00c4c0 tx=0x7fc91c007ef0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.495+0000 7fc92f000640 1 -- 172.21.15.2:0/2863214411 shutdown_connections 2024-08-17T02:24:17.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.495+0000 7fc92f000640 1 --2- 172.21.15.2:0/2863214411 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc928160720 0x7fc928099ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.495+0000 7fc92f000640 1 --2- 172.21.15.2:0/2863214411 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc908065150 0x7fc908067600 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.495+0000 7fc92f000640 1 --2- 172.21.15.2:0/2863214411 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9280ae910 0x7fc928097bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.495+0000 7fc92f000640 1 --2- 172.21.15.2:0/2863214411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9280ae540 0x7fc928155620 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.495+0000 7fc92f000640 1 -- 172.21.15.2:0/2863214411 >> 172.21.15.2:0/2863214411 conn(0x7fc9280ce400 msgr2=0x7fc9280b2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:17.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.495+0000 7fc92f000640 1 -- 172.21.15.2:0/2863214411 shutdown_connections 2024-08-17T02:24:17.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.495+0000 7fc92f000640 1 -- 172.21.15.2:0/2863214411 wait complete. 2024-08-17T02:24:17.510 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-08-17T02:24:17.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.665+0000 7eff1da00640 1 Processor -- start 2024-08-17T02:24:17.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.665+0000 7eff1da00640 1 -- start start 2024-08-17T02:24:17.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.667+0000 7eff1da00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7eff180ad960 0x7eff1815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:17.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.667+0000 7eff1da00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7eff180add30 0x7eff18156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:17.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.667+0000 7eff1da00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1815b5e0 con 0x7eff180ca050 2024-08-17T02:24:17.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.667+0000 7eff1da00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff180cb160 con 0x7eff180add30 2024-08-17T02:24:17.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.667+0000 7eff1da00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff180b0d10 con 0x7eff180ad960 2024-08-17T02:24:17.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.667+0000 7eff17400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7eff180add30 0x7eff18156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:17.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.667+0000 7eff17400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7eff180add30 0x7eff18156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:48820/0 (socket says 172.21.15.2:48820) 2024-08-17T02:24:17.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.667+0000 7eff16a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7eff180ad960 0x7eff1815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:17.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.667+0000 7eff17400640 1 -- 172.21.15.2:0/1309421708 learned_addr learned my addr 172.21.15.2:0/1309421708 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:17.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.668+0000 7eff17400640 1 -- 172.21.15.2:0/1309421708 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7eff180ad960 msgr2=0x7eff1815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:17.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.668+0000 7eff17400640 1 --2- 172.21.15.2:0/1309421708 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7eff180ad960 0x7eff1815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.668+0000 7eff17400640 1 -- 172.21.15.2:0/1309421708 >> v1:172.21.15.145:6789/0 conn(0x7eff180ca050 legacy=0x7eff18156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:17.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.668+0000 7eff17400640 1 -- 172.21.15.2:0/1309421708 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff180ca550 con 0x7eff180add30 2024-08-17T02:24:17.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.669+0000 7eff17400640 1 --2- 172.21.15.2:0/1309421708 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7eff180add30 0x7eff18156b30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7eff10009f20 tx=0x7eff10009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=564b2238643c2cf2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:17.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.669+0000 7eff16000640 1 -- 172.21.15.2:0/1309421708 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff10032450 con 0x7eff180add30 2024-08-17T02:24:17.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.669+0000 7eff16000640 1 -- 172.21.15.2:0/1309421708 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff100325b0 con 0x7eff180add30 2024-08-17T02:24:17.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.669+0000 7eff16000640 1 -- 172.21.15.2:0/1309421708 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff10032990 con 0x7eff180add30 2024-08-17T02:24:17.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.670+0000 7eff1da00640 1 -- 172.21.15.2:0/1309421708 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7eff180add30 msgr2=0x7eff18156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:17.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.670+0000 7eff1da00640 1 --2- 172.21.15.2:0/1309421708 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7eff180add30 0x7eff18156b30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7eff10009f20 tx=0x7eff10009840 comp rx=0 tx=0).stop 2024-08-17T02:24:17.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.670+0000 7eff1da00640 1 -- 172.21.15.2:0/1309421708 shutdown_connections 2024-08-17T02:24:17.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.670+0000 7eff1da00640 1 --2- 172.21.15.2:0/1309421708 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7eff180add30 0x7eff18156b30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.670+0000 7eff1da00640 1 --2- 172.21.15.2:0/1309421708 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7eff180ad960 0x7eff1815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.670+0000 7eff1da00640 1 -- 172.21.15.2:0/1309421708 >> 172.21.15.2:0/1309421708 conn(0x7eff18066e60 msgr2=0x7eff18067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:17.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.670+0000 7eff1da00640 1 -- 172.21.15.2:0/1309421708 shutdown_connections 2024-08-17T02:24:17.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.670+0000 7eff1da00640 1 -- 172.21.15.2:0/1309421708 wait complete. 2024-08-17T02:24:17.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.671+0000 7eff1da00640 1 Processor -- start 2024-08-17T02:24:17.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.671+0000 7eff1da00640 1 -- start start 2024-08-17T02:24:17.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.672+0000 7eff1da00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7eff180ad960 0x7eff1813fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:17.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.672+0000 7eff1da00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff180add30 0x7eff18157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:17.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.672+0000 7eff1da00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7eff180ca050 0x7eff18158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:17.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.672+0000 7eff1da00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1815bb50 con 0x7eff180add30 2024-08-17T02:24:17.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.672+0000 7eff1da00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff180a9c40 con 0x7eff180ca050 2024-08-17T02:24:17.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.672+0000 7eff1da00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff180a9f20 con 0x7eff180ad960 2024-08-17T02:24:17.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.673+0000 7eff0e000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff180add30 0x7eff18157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:17.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.673+0000 7eff0e000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff180add30 0x7eff18157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46174/0 (socket says 172.21.15.2:46174) 2024-08-17T02:24:17.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.673+0000 7eff0e000640 1 -- 172.21.15.2:0/2257649725 learned_addr learned my addr 172.21.15.2:0/2257649725 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:17.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.673+0000 7eff16a00640 1 --2- 172.21.15.2:0/2257649725 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7eff180ad960 0x7eff1813fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:17.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.673+0000 7eff17400640 1 --2- 172.21.15.2:0/2257649725 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7eff180ca050 0x7eff18158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:17.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.673+0000 7eff0e000640 1 -- 172.21.15.2:0/2257649725 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7eff180ad960 msgr2=0x7eff1813fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:17.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.673+0000 7eff0e000640 1 --2- 172.21.15.2:0/2257649725 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7eff180ad960 0x7eff1813fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.673+0000 7eff0e000640 1 -- 172.21.15.2:0/2257649725 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7eff180ca050 msgr2=0x7eff18158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:17.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.673+0000 7eff0e000640 1 --2- 172.21.15.2:0/2257649725 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7eff180ca050 0x7eff18158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.673+0000 7eff0e000640 1 -- 172.21.15.2:0/2257649725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff10009ae0 con 0x7eff180add30 2024-08-17T02:24:17.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.673+0000 7eff0e000640 1 --2- 172.21.15.2:0/2257649725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff180add30 0x7eff18157100 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7eff0000c490 tx=0x7eff00007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:17.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.673+0000 7eff0ea00640 1 -- 172.21.15.2:0/2257649725 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00011590 con 0x7eff180add30 2024-08-17T02:24:17.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.674+0000 7eff0ea00640 1 -- 172.21.15.2:0/2257649725 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff00011710 con 0x7eff180add30 2024-08-17T02:24:17.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.674+0000 7eff1da00640 1 -- 172.21.15.2:0/2257649725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff180aa200 con 0x7eff180add30 2024-08-17T02:24:17.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.674+0000 7eff0ea00640 1 -- 172.21.15.2:0/2257649725 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00011ad0 con 0x7eff180add30 2024-08-17T02:24:17.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.674+0000 7eff1da00640 1 -- 172.21.15.2:0/2257649725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1813ffd0 con 0x7eff180add30 2024-08-17T02:24:17.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.675+0000 7eff1da00640 1 -- 172.21.15.2:0/2257649725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1815bcc0 con 0x7eff180add30 2024-08-17T02:24:17.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.675+0000 7eff0ea00640 1 -- 172.21.15.2:0/2257649725 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7eff0001b3b0 con 0x7eff180add30 2024-08-17T02:24:17.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.676+0000 7eff0ea00640 1 --2- 172.21.15.2:0/2257649725 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7efef4065180 0x7efef4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:17.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.676+0000 7eff0ea00640 1 -- 172.21.15.2:0/2257649725 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7eff000812d0 con 0x7eff180add30 2024-08-17T02:24:17.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.677+0000 7eff16a00640 1 --2- 172.21.15.2:0/2257649725 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7efef4065180 0x7efef4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:17.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.677+0000 7eff16a00640 1 --2- 172.21.15.2:0/2257649725 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7efef4065180 0x7efef4067630 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7eff08009d20 tx=0x7eff080090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:17.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.680+0000 7eff0ea00640 1 -- 172.21.15.2:0/2257649725 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7eff0004f790 con 0x7eff180add30 2024-08-17T02:24:17.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.931+0000 7eff1da00640 1 -- 172.21.15.2:0/2257649725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7eff1815b5e0 con 0x7eff180add30 2024-08-17T02:24:17.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.935+0000 7eff0ea00640 1 -- 172.21.15.2:0/2257649725 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7eff1815b5e0 con 0x7eff180add30 2024-08-17T02:24:17.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.937+0000 7eff1da00640 1 -- 172.21.15.2:0/2257649725 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7efef4065180 msgr2=0x7efef4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:17.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.937+0000 7eff1da00640 1 --2- 172.21.15.2:0/2257649725 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7efef4065180 0x7efef4067630 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7eff08009d20 tx=0x7eff080090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.937+0000 7eff1da00640 1 -- 172.21.15.2:0/2257649725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff180add30 msgr2=0x7eff18157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:17.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.937+0000 7eff1da00640 1 --2- 172.21.15.2:0/2257649725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff180add30 0x7eff18157100 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7eff0000c490 tx=0x7eff00007ec0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.937+0000 7eff1da00640 1 -- 172.21.15.2:0/2257649725 shutdown_connections 2024-08-17T02:24:17.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.938+0000 7eff1da00640 1 --2- 172.21.15.2:0/2257649725 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7eff180ca050 0x7eff18158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.938+0000 7eff1da00640 1 --2- 172.21.15.2:0/2257649725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff180add30 0x7eff18157100 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.938+0000 7eff1da00640 1 --2- 172.21.15.2:0/2257649725 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7efef4065180 0x7efef4067630 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.938+0000 7eff1da00640 1 --2- 172.21.15.2:0/2257649725 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7eff180ad960 0x7eff1813fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.938+0000 7eff1da00640 1 -- 172.21.15.2:0/2257649725 >> 172.21.15.2:0/2257649725 conn(0x7eff18066e60 msgr2=0x7eff18154f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:17.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.938+0000 7eff1da00640 1 -- 172.21.15.2:0/2257649725 shutdown_connections 2024-08-17T02:24:17.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:17.938+0000 7eff1da00640 1 -- 172.21.15.2:0/2257649725 wait complete. 2024-08-17T02:24:17.953 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-08-17T02:24:18.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.105+0000 7f1973200640 1 Processor -- start 2024-08-17T02:24:18.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.105+0000 7f1973200640 1 -- start start 2024-08-17T02:24:18.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.106+0000 7f1973200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f196c0afca0 0x7f196c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:18.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.106+0000 7f1973200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f196c0acf10 0x7f196c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:18.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.107+0000 7f1973200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f196c15a4e0 con 0x7f196c1589a0 2024-08-17T02:24:18.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.107+0000 7f1973200640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196c0b0980 con 0x7f196c0acf10 2024-08-17T02:24:18.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.107+0000 7f1973200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c0c92b0 con 0x7f196c0afca0 2024-08-17T02:24:18.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.107+0000 7f1971200640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f196c1589a0 0x7f196c06d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38474/0 (socket says 172.21.15.2:38474) 2024-08-17T02:24:18.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.107+0000 7f1971200640 1 -- 172.21.15.2:0/2981689033 learned_addr learned my addr 172.21.15.2:0/2981689033 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:18.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.107+0000 7f196be00640 1 --2- 172.21.15.2:0/2981689033 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f196c0afca0 0x7f196c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:18.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.107+0000 7f1963e00640 1 --2- 172.21.15.2:0/2981689033 >> v2:172.21.15.145:3300/0 conn(0x7f196c0acf10 0x7f196c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:18.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.107+0000 7f196b400640 1 -- 172.21.15.2:0/2981689033 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2939775723 0 0) 0x7f1964001490 con 0x7f196c1589a0 2024-08-17T02:24:18.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.107+0000 7f196b400640 1 -- 172.21.15.2:0/2981689033 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19500034e0 con 0x7f196c1589a0 2024-08-17T02:24:18.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.108+0000 7f196b400640 1 -- 172.21.15.2:0/2981689033 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3779857150 0 0) 0x7f19500034e0 con 0x7f196c1589a0 2024-08-17T02:24:18.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.108+0000 7f196be00640 1 -- 172.21.15.2:0/2981689033 >> v2:172.21.15.145:3300/0 conn(0x7f196c0acf10 msgr2=0x7f196c159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:18.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.108+0000 7f196be00640 1 --2- 172.21.15.2:0/2981689033 >> v2:172.21.15.145:3300/0 conn(0x7f196c0acf10 0x7f196c159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:18.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.108+0000 7f196be00640 1 -- 172.21.15.2:0/2981689033 >> v1:172.21.15.2:6789/0 conn(0x7f196c1589a0 legacy=0x7f196c06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:18.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.108+0000 7f196be00640 1 -- 172.21.15.2:0/2981689033 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c0ad480 con 0x7f196c0afca0 2024-08-17T02:24:18.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.108+0000 7f1963e00640 1 --2- 172.21.15.2:0/2981689033 >> v2:172.21.15.145:3300/0 conn(0x7f196c0acf10 0x7f196c159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:18.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.109+0000 7f196be00640 1 --2- 172.21.15.2:0/2981689033 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f196c0afca0 0x7f196c0b0070 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f195c009880 tx=0x7f195c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92f8f915e370a4a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:18.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.109+0000 7f196b400640 1 -- 172.21.15.2:0/2981689033 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964001980 con 0x7f196c0afca0 2024-08-17T02:24:18.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.109+0000 7f196b400640 1 -- 172.21.15.2:0/2981689033 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195c02aa70 con 0x7f196c0afca0 2024-08-17T02:24:18.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.109+0000 7f196b400640 1 -- 172.21.15.2:0/2981689033 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c02adf0 con 0x7f196c0afca0 2024-08-17T02:24:18.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.109+0000 7f1973200640 1 -- 172.21.15.2:0/2981689033 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f196c0afca0 msgr2=0x7f196c0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:18.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.109+0000 7f1973200640 1 --2- 172.21.15.2:0/2981689033 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f196c0afca0 0x7f196c0b0070 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f195c009880 tx=0x7f195c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:18.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.110+0000 7f1973200640 1 -- 172.21.15.2:0/2981689033 shutdown_connections 2024-08-17T02:24:18.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.110+0000 7f1973200640 1 --2- 172.21.15.2:0/2981689033 >> v2:172.21.15.145:3300/0 conn(0x7f196c0acf10 0x7f196c159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:18.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.110+0000 7f1973200640 1 --2- 172.21.15.2:0/2981689033 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f196c0afca0 0x7f196c0b0070 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:18.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.110+0000 7f1973200640 1 -- 172.21.15.2:0/2981689033 >> 172.21.15.2:0/2981689033 conn(0x7f196c066e60 msgr2=0x7f196c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:18.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.110+0000 7f1973200640 1 -- 172.21.15.2:0/2981689033 shutdown_connections 2024-08-17T02:24:18.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.110+0000 7f1973200640 1 -- 172.21.15.2:0/2981689033 wait complete. 2024-08-17T02:24:18.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.111+0000 7f1973200640 1 Processor -- start 2024-08-17T02:24:18.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.111+0000 7f1973200640 1 -- start start 2024-08-17T02:24:18.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.112+0000 7f1973200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f196c0acf10 0x7f196c0c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:18.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.112+0000 7f1973200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f196c0afca0 0x7f196c14dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:18.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.112+0000 7f1973200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f196c1589a0 0x7f196c14cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:18.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.112+0000 7f1973200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c14e560 con 0x7f196c1589a0 2024-08-17T02:24:18.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.112+0000 7f1973200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c14cb50 con 0x7f196c0afca0 2024-08-17T02:24:18.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.112+0000 7f1973200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c14c220 con 0x7f196c0acf10 2024-08-17T02:24:18.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.112+0000 7f1971200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f196c1589a0 0x7f196c14cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:18.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.112+0000 7f1971200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f196c1589a0 0x7f196c14cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46182/0 (socket says 172.21.15.2:46182) 2024-08-17T02:24:18.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.112+0000 7f1971200640 1 -- 172.21.15.2:0/3098691718 learned_addr learned my addr 172.21.15.2:0/3098691718 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:18.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.112+0000 7f1963e00640 1 --2- 172.21.15.2:0/3098691718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f196c0afca0 0x7f196c14dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:18.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.112+0000 7f196be00640 1 --2- 172.21.15.2:0/3098691718 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f196c0acf10 0x7f196c0c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:18.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.113+0000 7f1971200640 1 -- 172.21.15.2:0/3098691718 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f196c0acf10 msgr2=0x7f196c0c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:18.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.113+0000 7f1971200640 1 --2- 172.21.15.2:0/3098691718 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f196c0acf10 0x7f196c0c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:18.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.113+0000 7f1971200640 1 -- 172.21.15.2:0/3098691718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f196c0afca0 msgr2=0x7f196c14dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:18.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.113+0000 7f1971200640 1 --2- 172.21.15.2:0/3098691718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f196c0afca0 0x7f196c14dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:18.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.113+0000 7f1971200640 1 -- 172.21.15.2:0/3098691718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1954009390 con 0x7f196c1589a0 2024-08-17T02:24:18.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.113+0000 7f1971200640 1 --2- 172.21.15.2:0/3098691718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f196c1589a0 0x7f196c14cfe0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f196400cb90 tx=0x7f1964007b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:18.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.113+0000 7f1963400640 1 -- 172.21.15.2:0/3098691718 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964004d30 con 0x7f196c1589a0 2024-08-17T02:24:18.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.114+0000 7f1963400640 1 -- 172.21.15.2:0/3098691718 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1964004e90 con 0x7f196c1589a0 2024-08-17T02:24:18.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.114+0000 7f1963400640 1 -- 172.21.15.2:0/3098691718 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196400a980 con 0x7f196c1589a0 2024-08-17T02:24:18.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.114+0000 7f1973200640 1 -- 172.21.15.2:0/3098691718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195c009390 con 0x7f196c1589a0 2024-08-17T02:24:18.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.114+0000 7f1973200640 1 -- 172.21.15.2:0/3098691718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196c14c7e0 con 0x7f196c1589a0 2024-08-17T02:24:18.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.115+0000 7f1973200640 1 -- 172.21.15.2:0/3098691718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196c14cd00 con 0x7f196c1589a0 2024-08-17T02:24:18.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.115+0000 7f1963400640 1 -- 172.21.15.2:0/3098691718 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1964007150 con 0x7f196c1589a0 2024-08-17T02:24:18.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.116+0000 7f1963400640 1 --2- 172.21.15.2:0/3098691718 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1948065150 0x7f1948067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:18.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.116+0000 7f1963400640 1 -- 172.21.15.2:0/3098691718 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1964081680 con 0x7f196c1589a0 2024-08-17T02:24:18.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.117+0000 7f196be00640 1 --2- 172.21.15.2:0/3098691718 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1948065150 0x7f1948067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:18.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.117+0000 7f196be00640 1 --2- 172.21.15.2:0/3098691718 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1948065150 0x7f1948067600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f195c034000 tx=0x7f195c032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:18.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.120+0000 7f1963400640 1 -- 172.21.15.2:0/3098691718 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f196404be40 con 0x7f196c1589a0 2024-08-17T02:24:18.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.375+0000 7f1973200640 1 -- 172.21.15.2:0/3098691718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f196c15a4e0 con 0x7f196c1589a0 2024-08-17T02:24:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.379+0000 7f1963400640 1 -- 172.21.15.2:0/3098691718 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f196c15a4e0 con 0x7f196c1589a0 2024-08-17T02:24:18.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.381+0000 7f1973200640 1 -- 172.21.15.2:0/3098691718 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1948065150 msgr2=0x7f1948067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:18.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.381+0000 7f1973200640 1 --2- 172.21.15.2:0/3098691718 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1948065150 0x7f1948067600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f195c034000 tx=0x7f195c032000 comp rx=0 tx=0).stop 2024-08-17T02:24:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.381+0000 7f1973200640 1 -- 172.21.15.2:0/3098691718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f196c1589a0 msgr2=0x7f196c14cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.381+0000 7f1973200640 1 --2- 172.21.15.2:0/3098691718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f196c1589a0 0x7f196c14cfe0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f196400cb90 tx=0x7f1964007b50 comp rx=0 tx=0).stop 2024-08-17T02:24:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.381+0000 7f1973200640 1 -- 172.21.15.2:0/3098691718 shutdown_connections 2024-08-17T02:24:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.381+0000 7f1973200640 1 --2- 172.21.15.2:0/3098691718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f196c1589a0 0x7f196c14cfe0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.381+0000 7f1973200640 1 --2- 172.21.15.2:0/3098691718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f196c0afca0 0x7f196c14dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.381+0000 7f1973200640 1 --2- 172.21.15.2:0/3098691718 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1948065150 0x7f1948067600 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.381+0000 7f1973200640 1 --2- 172.21.15.2:0/3098691718 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f196c0acf10 0x7f196c0c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.381+0000 7f1973200640 1 -- 172.21.15.2:0/3098691718 >> 172.21.15.2:0/3098691718 conn(0x7f196c066e60 msgr2=0x7f196c158de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.381+0000 7f1973200640 1 -- 172.21.15.2:0/3098691718 shutdown_connections 2024-08-17T02:24:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.381+0000 7f1973200640 1 -- 172.21.15.2:0/3098691718 wait complete. 2024-08-17T02:24:18.396 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-08-17T02:24:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.549+0000 7fa419a00640 1 Processor -- start 2024-08-17T02:24:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.549+0000 7fa419a00640 1 -- start start 2024-08-17T02:24:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.551+0000 7fa419a00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa4140aab40 0x7fa4140a9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.551+0000 7fa419a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4140a88e0 con 0x7fa414158bf0 2024-08-17T02:24:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.551+0000 7fa419a00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4140a9180 con 0x7fa41415a4d0 2024-08-17T02:24:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.551+0000 7fa419a00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa41415a0e0 con 0x7fa4140aab40 2024-08-17T02:24:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.551+0000 7fa412a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa414158bf0 0x7fa4140aa430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38486/0 (socket says 172.21.15.2:38486) 2024-08-17T02:24:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.551+0000 7fa412a00640 1 -- 172.21.15.2:0/442897143 learned_addr learned my addr 172.21.15.2:0/442897143 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.551+0000 7fa40be00640 1 --2- 172.21.15.2:0/442897143 >> v2:172.21.15.145:3300/0 conn(0x7fa4140aab40 0x7fa4140a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.551+0000 7fa412000640 1 -- 172.21.15.2:0/442897143 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1472560076 0 0) 0x7fa4140a88e0 con 0x7fa414158bf0 2024-08-17T02:24:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.551+0000 7fa412000640 1 -- 172.21.15.2:0/442897143 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3f80034e0 con 0x7fa414158bf0 2024-08-17T02:24:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.552+0000 7fa40be00640 1 -- 172.21.15.2:0/442897143 >> v1:172.21.15.145:6789/0 conn(0x7fa41415a4d0 legacy=0x7fa41415a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.552+0000 7fa412000640 1 -- 172.21.15.2:0/442897143 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 20850823 0 0) 0x7fa3f80034e0 con 0x7fa414158bf0 2024-08-17T02:24:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.552+0000 7fa40be00640 1 -- 172.21.15.2:0/442897143 >> v1:172.21.15.2:6789/0 conn(0x7fa414158bf0 legacy=0x7fa4140aa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.552+0000 7fa40be00640 1 -- 172.21.15.2:0/442897143 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4140a8b30 con 0x7fa4140aab40 2024-08-17T02:24:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.553+0000 7fa40be00640 1 --2- 172.21.15.2:0/442897143 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4140aab40 0x7fa4140a9610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc009850 tx=0x7fa3fc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1588e6fdc7c7172a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:18.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.553+0000 7fa412000640 1 -- 172.21.15.2:0/442897143 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa404001470 con 0x7fa4140aab40 2024-08-17T02:24:18.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.553+0000 7fa412000640 1 -- 172.21.15.2:0/442897143 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3fc02ab00 con 0x7fa4140aab40 2024-08-17T02:24:18.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.553+0000 7fa412000640 1 -- 172.21.15.2:0/442897143 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc02aea0 con 0x7fa4140aab40 2024-08-17T02:24:18.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.554+0000 7fa419a00640 1 -- 172.21.15.2:0/442897143 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4140aab40 msgr2=0x7fa4140a9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:18.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.554+0000 7fa419a00640 1 --2- 172.21.15.2:0/442897143 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4140aab40 0x7fa4140a9610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc009850 tx=0x7fa3fc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:18.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.554+0000 7fa419a00640 1 -- 172.21.15.2:0/442897143 shutdown_connections 2024-08-17T02:24:18.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.554+0000 7fa419a00640 1 --2- 172.21.15.2:0/442897143 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4140aab40 0x7fa4140a9610 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:18.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.554+0000 7fa419a00640 1 -- 172.21.15.2:0/442897143 >> 172.21.15.2:0/442897143 conn(0x7fa414066e60 msgr2=0x7fa414067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:18.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.554+0000 7fa419a00640 1 -- 172.21.15.2:0/442897143 shutdown_connections 2024-08-17T02:24:18.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.554+0000 7fa419a00640 1 -- 172.21.15.2:0/442897143 wait complete. 2024-08-17T02:24:18.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.556+0000 7fa419a00640 1 Processor -- start 2024-08-17T02:24:18.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.556+0000 7fa419a00640 1 -- start start 2024-08-17T02:24:18.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.556+0000 7fa419a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4140aab40 0x7fa414169900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.556+0000 7fa419a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa414158bf0 0x7fa4141568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.557+0000 7fa419a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa41415a4d0 0x7fa4140adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.557+0000 7fa419a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa414169e40 con 0x7fa4140aab40 2024-08-17T02:24:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.557+0000 7fa419a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4140cb6a0 con 0x7fa414158bf0 2024-08-17T02:24:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.557+0000 7fa419a00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4140c8ae0 con 0x7fa41415a4d0 2024-08-17T02:24:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.557+0000 7fa412a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4140aab40 0x7fa414169900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.557+0000 7fa412a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4140aab40 0x7fa414169900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46198/0 (socket says 172.21.15.2:46198) 2024-08-17T02:24:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.557+0000 7fa412a00640 1 -- 172.21.15.2:0/1879286871 learned_addr learned my addr 172.21.15.2:0/1879286871 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.557+0000 7fa40be00640 1 --2- 172.21.15.2:0/1879286871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa414158bf0 0x7fa4141568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.557+0000 7fa413400640 1 --2- 172.21.15.2:0/1879286871 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa41415a4d0 0x7fa4140adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.557+0000 7fa412a00640 1 -- 172.21.15.2:0/1879286871 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa41415a4d0 msgr2=0x7fa4140adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.557+0000 7fa412a00640 1 --2- 172.21.15.2:0/1879286871 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa41415a4d0 0x7fa4140adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.557+0000 7fa412a00640 1 -- 172.21.15.2:0/1879286871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa414158bf0 msgr2=0x7fa4141568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.557+0000 7fa412a00640 1 --2- 172.21.15.2:0/1879286871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa414158bf0 0x7fa4141568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.557+0000 7fa412a00640 1 -- 172.21.15.2:0/1879286871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3fc009390 con 0x7fa4140aab40 2024-08-17T02:24:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.557+0000 7fa413400640 1 --2- 172.21.15.2:0/1879286871 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa41415a4d0 0x7fa4140adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.557+0000 7fa412a00640 1 --2- 172.21.15.2:0/1879286871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4140aab40 0x7fa414169900 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa40400cbc0 tx=0x7fa404001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.558+0000 7fa40a000640 1 -- 172.21.15.2:0/1879286871 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa404007360 con 0x7fa4140aab40 2024-08-17T02:24:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.558+0000 7fa40a000640 1 -- 172.21.15.2:0/1879286871 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4040074e0 con 0x7fa4140aab40 2024-08-17T02:24:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.558+0000 7fa40a000640 1 -- 172.21.15.2:0/1879286871 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4040049f0 con 0x7fa4140aab40 2024-08-17T02:24:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.558+0000 7fa419a00640 1 -- 172.21.15.2:0/1879286871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa41416c1f0 con 0x7fa4140aab40 2024-08-17T02:24:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.558+0000 7fa419a00640 1 -- 172.21.15.2:0/1879286871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4140cad70 con 0x7fa4140aab40 2024-08-17T02:24:18.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.559+0000 7fa419a00640 1 -- 172.21.15.2:0/1879286871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa414063fb0 con 0x7fa4140aab40 2024-08-17T02:24:18.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.560+0000 7fa40a000640 1 -- 172.21.15.2:0/1879286871 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa40400a640 con 0x7fa4140aab40 2024-08-17T02:24:18.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.561+0000 7fa40a000640 1 --2- 172.21.15.2:0/1879286871 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa3f0065150 0x7fa3f0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:18.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.561+0000 7fa40a000640 1 -- 172.21.15.2:0/1879286871 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa404081730 con 0x7fa4140aab40 2024-08-17T02:24:18.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.561+0000 7fa40be00640 1 --2- 172.21.15.2:0/1879286871 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa3f0065150 0x7fa3f0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.562+0000 7fa40be00640 1 --2- 172.21.15.2:0/1879286871 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa3f0065150 0x7fa3f0067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc034000 tx=0x7fa3fc032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:18.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.565+0000 7fa40a000640 1 -- 172.21.15.2:0/1879286871 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa40404fbe0 con 0x7fa4140aab40 2024-08-17T02:24:18.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.818+0000 7fa419a00640 1 -- 172.21.15.2:0/1879286871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fa4140af310 con 0x7fa4140aab40 2024-08-17T02:24:18.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.822+0000 7fa40a000640 1 -- 172.21.15.2:0/1879286871 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa404018020 con 0x7fa4140aab40 2024-08-17T02:24:18.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.824+0000 7fa419a00640 1 -- 172.21.15.2:0/1879286871 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa3f0065150 msgr2=0x7fa3f0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:18.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.824+0000 7fa419a00640 1 --2- 172.21.15.2:0/1879286871 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa3f0065150 0x7fa3f0067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc034000 tx=0x7fa3fc032000 comp rx=0 tx=0).stop 2024-08-17T02:24:18.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.824+0000 7fa419a00640 1 -- 172.21.15.2:0/1879286871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4140aab40 msgr2=0x7fa414169900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:18.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.824+0000 7fa419a00640 1 --2- 172.21.15.2:0/1879286871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4140aab40 0x7fa414169900 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa40400cbc0 tx=0x7fa404001b80 comp rx=0 tx=0).stop 2024-08-17T02:24:18.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.824+0000 7fa419a00640 1 -- 172.21.15.2:0/1879286871 shutdown_connections 2024-08-17T02:24:18.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.824+0000 7fa419a00640 1 --2- 172.21.15.2:0/1879286871 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa3f0065150 0x7fa3f0067600 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:18.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.824+0000 7fa419a00640 1 --2- 172.21.15.2:0/1879286871 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa41415a4d0 0x7fa4140adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:18.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.824+0000 7fa419a00640 1 --2- 172.21.15.2:0/1879286871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa414158bf0 0x7fa4141568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:18.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.824+0000 7fa419a00640 1 --2- 172.21.15.2:0/1879286871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4140aab40 0x7fa414169900 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:18.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.824+0000 7fa419a00640 1 -- 172.21.15.2:0/1879286871 >> 172.21.15.2:0/1879286871 conn(0x7fa414066e60 msgr2=0x7fa41415b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:18.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.824+0000 7fa419a00640 1 -- 172.21.15.2:0/1879286871 shutdown_connections 2024-08-17T02:24:18.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.824+0000 7fa419a00640 1 -- 172.21.15.2:0/1879286871 wait complete. 2024-08-17T02:24:18.840 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-08-17T02:24:18.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.993+0000 7f581fe00640 1 Processor -- start 2024-08-17T02:24:18.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.993+0000 7f581fe00640 1 -- start start 2024-08-17T02:24:18.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.994+0000 7f581fe00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f58200680a0 0x7f5820068470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:18.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.994+0000 7f581fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f582015bbf0 0x7f582015c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:18.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.994+0000 7f581fe00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582015c590 con 0x7f582006ea70 2024-08-17T02:24:18.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.994+0000 7f581fe00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58200c8370 con 0x7f582015bbf0 2024-08-17T02:24:18.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.994+0000 7f581fe00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58200c76f0 con 0x7f58200680a0 2024-08-17T02:24:18.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.994+0000 7f581f400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f582015bbf0 0x7f582015c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:18.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.994+0000 7f581f400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f582015bbf0 0x7f582015c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46212/0 (socket says 172.21.15.2:46212) 2024-08-17T02:24:18.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.994+0000 7f581f400640 1 -- 172.21.15.2:0/4287509238 learned_addr learned my addr 172.21.15.2:0/4287509238 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.995+0000 7f581ea00640 1 --2- 172.21.15.2:0/4287509238 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f58200680a0 0x7f5820068470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.995+0000 7f581f400640 1 -- 172.21.15.2:0/4287509238 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f58200680a0 msgr2=0x7f5820068470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.995+0000 7f581f400640 1 --2- 172.21.15.2:0/4287509238 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f58200680a0 0x7f5820068470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.995+0000 7f581f400640 1 -- 172.21.15.2:0/4287509238 >> v1:172.21.15.145:6789/0 conn(0x7f582006ea70 legacy=0x7f58200c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.995+0000 7f581f400640 1 -- 172.21.15.2:0/4287509238 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58200c79d0 con 0x7f582015bbf0 2024-08-17T02:24:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.996+0000 7f581f400640 1 --2- 172.21.15.2:0/4287509238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f582015bbf0 0x7f582015c050 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5818009f20 tx=0x7f5818009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0e3d35b971db9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.996+0000 7f581e000640 1 -- 172.21.15.2:0/4287509238 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5818031400 con 0x7f582015bbf0 2024-08-17T02:24:18.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.996+0000 7f581e000640 1 -- 172.21.15.2:0/4287509238 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581802d050 con 0x7f582015bbf0 2024-08-17T02:24:18.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.996+0000 7f581e000640 1 -- 172.21.15.2:0/4287509238 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58180317d0 con 0x7f582015bbf0 2024-08-17T02:24:18.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.996+0000 7f581fe00640 1 -- 172.21.15.2:0/4287509238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f582015bbf0 msgr2=0x7f582015c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:18.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.996+0000 7f581fe00640 1 --2- 172.21.15.2:0/4287509238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f582015bbf0 0x7f582015c050 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5818009f20 tx=0x7f5818009840 comp rx=0 tx=0).stop 2024-08-17T02:24:18.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.997+0000 7f581fe00640 1 -- 172.21.15.2:0/4287509238 shutdown_connections 2024-08-17T02:24:18.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.997+0000 7f581fe00640 1 --2- 172.21.15.2:0/4287509238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f582015bbf0 0x7f582015c050 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:18.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.997+0000 7f581fe00640 1 --2- 172.21.15.2:0/4287509238 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f58200680a0 0x7f5820068470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:18.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.997+0000 7f581fe00640 1 -- 172.21.15.2:0/4287509238 >> 172.21.15.2:0/4287509238 conn(0x7f582006ded0 msgr2=0x7f582006e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:18.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.997+0000 7f581fe00640 1 -- 172.21.15.2:0/4287509238 shutdown_connections 2024-08-17T02:24:18.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.997+0000 7f581fe00640 1 -- 172.21.15.2:0/4287509238 wait complete. 2024-08-17T02:24:18.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.998+0000 7f581fe00640 1 Processor -- start 2024-08-17T02:24:18.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.998+0000 7f581fe00640 1 -- start start 2024-08-17T02:24:19.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.999+0000 7f581fe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f58200680a0 0x7f58200a95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:19.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.999+0000 7f581fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f582006ea70 0x7f5820149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.999+0000 7f581fe00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f582015bbf0 0x7f58200c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.999+0000 7f581fe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58200c4bf0 con 0x7f582006ea70 2024-08-17T02:24:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.999+0000 7f581fe00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58200a9ae0 con 0x7f58200680a0 2024-08-17T02:24:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.999+0000 7f581fe00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582014a080 con 0x7f582015bbf0 2024-08-17T02:24:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.999+0000 7f5817e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f582006ea70 0x7f5820149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.999+0000 7f5817e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f582006ea70 0x7f5820149b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46218/0 (socket says 172.21.15.2:46218) 2024-08-17T02:24:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:18.999+0000 7f5817e00640 1 -- 172.21.15.2:0/318533721 learned_addr learned my addr 172.21.15.2:0/318533721 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.000+0000 7f581ea00640 1 --2- 172.21.15.2:0/318533721 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f58200680a0 0x7f58200a95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.000+0000 7f581f400640 1 --2- 172.21.15.2:0/318533721 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f582015bbf0 0x7f58200c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.000+0000 7f5817e00640 1 -- 172.21.15.2:0/318533721 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f582015bbf0 msgr2=0x7f58200c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.000+0000 7f5817e00640 1 --2- 172.21.15.2:0/318533721 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f582015bbf0 0x7f58200c6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.000+0000 7f5817e00640 1 -- 172.21.15.2:0/318533721 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f58200680a0 msgr2=0x7f58200a95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.000+0000 7f5817e00640 1 --2- 172.21.15.2:0/318533721 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f58200680a0 0x7f58200a95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.000+0000 7f5817e00640 1 -- 172.21.15.2:0/318533721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5818009ae0 con 0x7f582006ea70 2024-08-17T02:24:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.000+0000 7f581ea00640 1 --2- 172.21.15.2:0/318533721 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f58200680a0 0x7f58200a95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.000+0000 7f581f400640 1 --2- 172.21.15.2:0/318533721 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f582015bbf0 0x7f58200c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.000+0000 7f5817e00640 1 --2- 172.21.15.2:0/318533721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f582006ea70 0x7f5820149b40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f580800c590 tx=0x7f5808007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.000+0000 7f5816000640 1 -- 172.21.15.2:0/318533721 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5808011590 con 0x7f582006ea70 2024-08-17T02:24:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.000+0000 7f5816000640 1 -- 172.21.15.2:0/318533721 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5808011710 con 0x7f582006ea70 2024-08-17T02:24:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.000+0000 7f5816000640 1 -- 172.21.15.2:0/318533721 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5808011ad0 con 0x7f582006ea70 2024-08-17T02:24:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.000+0000 7f581fe00640 1 -- 172.21.15.2:0/318533721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58200c5a50 con 0x7f582006ea70 2024-08-17T02:24:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.001+0000 7f581fe00640 1 -- 172.21.15.2:0/318533721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58200c5ca0 con 0x7f582006ea70 2024-08-17T02:24:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.002+0000 7f581fe00640 1 -- 172.21.15.2:0/318533721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5820070720 con 0x7f582006ea70 2024-08-17T02:24:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.002+0000 7f5816000640 1 -- 172.21.15.2:0/318533721 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f580801b3b0 con 0x7f582006ea70 2024-08-17T02:24:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.003+0000 7f5816000640 1 --2- 172.21.15.2:0/318533721 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f57fc065150 0x7f57fc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.003+0000 7f5816000640 1 -- 172.21.15.2:0/318533721 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5808081630 con 0x7f582006ea70 2024-08-17T02:24:19.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.004+0000 7f581ea00640 1 --2- 172.21.15.2:0/318533721 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f57fc065150 0x7f57fc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:19.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.005+0000 7f581ea00640 1 --2- 172.21.15.2:0/318533721 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f57fc065150 0x7f57fc067600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f581000bb80 tx=0x7f5810008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:19.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.007+0000 7f5816000640 1 -- 172.21.15.2:0/318533721 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f580804f9a0 con 0x7f582006ea70 2024-08-17T02:24:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.254+0000 7f581fe00640 1 -- 172.21.15.2:0/318533721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f58200c10e0 con 0x7f582006ea70 2024-08-17T02:24:19.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.258+0000 7f5816000640 1 -- 172.21.15.2:0/318533721 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f58080170a0 con 0x7f582006ea70 2024-08-17T02:24:19.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.260+0000 7f581fe00640 1 -- 172.21.15.2:0/318533721 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f57fc065150 msgr2=0x7f57fc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:19.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.260+0000 7f581fe00640 1 --2- 172.21.15.2:0/318533721 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f57fc065150 0x7f57fc067600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f581000bb80 tx=0x7f5810008040 comp rx=0 tx=0).stop 2024-08-17T02:24:19.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.260+0000 7f581fe00640 1 -- 172.21.15.2:0/318533721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f582006ea70 msgr2=0x7f5820149b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:19.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.260+0000 7f581fe00640 1 --2- 172.21.15.2:0/318533721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f582006ea70 0x7f5820149b40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f580800c590 tx=0x7f5808007ef0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.260+0000 7f581fe00640 1 -- 172.21.15.2:0/318533721 shutdown_connections 2024-08-17T02:24:19.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.260+0000 7f581fe00640 1 --2- 172.21.15.2:0/318533721 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f57fc065150 0x7f57fc067600 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.260+0000 7f581fe00640 1 --2- 172.21.15.2:0/318533721 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f582015bbf0 0x7f58200c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.260+0000 7f581fe00640 1 --2- 172.21.15.2:0/318533721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f582006ea70 0x7f5820149b40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.260+0000 7f581fe00640 1 --2- 172.21.15.2:0/318533721 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f58200680a0 0x7f58200a95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.260+0000 7f581fe00640 1 -- 172.21.15.2:0/318533721 >> 172.21.15.2:0/318533721 conn(0x7f582006ded0 msgr2=0x7f58200b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:19.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.260+0000 7f581fe00640 1 -- 172.21.15.2:0/318533721 shutdown_connections 2024-08-17T02:24:19.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.261+0000 7f581fe00640 1 -- 172.21.15.2:0/318533721 wait complete. 2024-08-17T02:24:19.276 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-08-17T02:24:19.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.429+0000 7fe903200640 1 Processor -- start 2024-08-17T02:24:19.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.429+0000 7fe903200640 1 -- start start 2024-08-17T02:24:19.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.430+0000 7fe903200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe8fc0ad960 0x7fe8fc15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:19.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.430+0000 7fe903200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe8fc0ca050 0x7fe8fc156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:19.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.430+0000 7fe903200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8fc15b5e0 con 0x7fe8fc0add30 2024-08-17T02:24:19.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.430+0000 7fe903200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8fc0cb160 con 0x7fe8fc0ca050 2024-08-17T02:24:19.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.431+0000 7fe903200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc0b0d10 con 0x7fe8fc0ad960 2024-08-17T02:24:19.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.431+0000 7fe8f3e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe8fc0ca050 0x7fe8fc156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:19.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.431+0000 7fe8f3e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe8fc0ca050 0x7fe8fc156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46234/0 (socket says 172.21.15.2:46234) 2024-08-17T02:24:19.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.431+0000 7fe8f3e00640 1 -- 172.21.15.2:0/33643150 learned_addr learned my addr 172.21.15.2:0/33643150 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:19.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.431+0000 7fe901200640 1 --1- 172.21.15.2:0/33643150 >> v1:172.21.15.2:6789/0 conn(0x7fe8fc0add30 0x7fe8fc156960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38490/0 (socket says 172.21.15.2:38490) 2024-08-17T02:24:19.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.431+0000 7fe8fbe00640 1 --2- 172.21.15.2:0/33643150 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe8fc0ad960 0x7fe8fc15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:19.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.431+0000 7fe8f3e00640 1 -- 172.21.15.2:0/33643150 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe8fc0ad960 msgr2=0x7fe8fc15b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:19.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.431+0000 7fe8f3e00640 1 --2- 172.21.15.2:0/33643150 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe8fc0ad960 0x7fe8fc15b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.431+0000 7fe8f3e00640 1 -- 172.21.15.2:0/33643150 >> v1:172.21.15.2:6789/0 conn(0x7fe8fc0add30 legacy=0x7fe8fc156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:19.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.431+0000 7fe8f3e00640 1 -- 172.21.15.2:0/33643150 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8fc0ca550 con 0x7fe8fc0ca050 2024-08-17T02:24:19.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.432+0000 7fe8f3e00640 1 --2- 172.21.15.2:0/33643150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8fc0ca050 0x7fe8fc156420 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4009910 tx=0x7fe8e40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f085dd7b070bbf68 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:19.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.433+0000 7fe8fb400640 1 -- 172.21.15.2:0/33643150 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4032440 con 0x7fe8fc0ca050 2024-08-17T02:24:19.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.433+0000 7fe8fb400640 1 -- 172.21.15.2:0/33643150 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e40325a0 con 0x7fe8fc0ca050 2024-08-17T02:24:19.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.433+0000 7fe8fb400640 1 -- 172.21.15.2:0/33643150 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4032980 con 0x7fe8fc0ca050 2024-08-17T02:24:19.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.433+0000 7fe903200640 1 -- 172.21.15.2:0/33643150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8fc0ca050 msgr2=0x7fe8fc156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:19.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.433+0000 7fe903200640 1 --2- 172.21.15.2:0/33643150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8fc0ca050 0x7fe8fc156420 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4009910 tx=0x7fe8e40091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.433+0000 7fe903200640 1 -- 172.21.15.2:0/33643150 shutdown_connections 2024-08-17T02:24:19.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.433+0000 7fe903200640 1 --2- 172.21.15.2:0/33643150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8fc0ca050 0x7fe8fc156420 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.433+0000 7fe903200640 1 --2- 172.21.15.2:0/33643150 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe8fc0ad960 0x7fe8fc15b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.433+0000 7fe903200640 1 -- 172.21.15.2:0/33643150 >> 172.21.15.2:0/33643150 conn(0x7fe8fc066e60 msgr2=0x7fe8fc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:19.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.433+0000 7fe903200640 1 -- 172.21.15.2:0/33643150 shutdown_connections 2024-08-17T02:24:19.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.433+0000 7fe903200640 1 -- 172.21.15.2:0/33643150 wait complete. 2024-08-17T02:24:19.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.435+0000 7fe903200640 1 Processor -- start 2024-08-17T02:24:19.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.435+0000 7fe903200640 1 -- start start 2024-08-17T02:24:19.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.436+0000 7fe903200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe8fc0ad960 0x7fe8fc154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:19.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.436+0000 7fe903200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe8fc0add30 0x7fe8fc158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:19.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.436+0000 7fe903200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8fc0ca050 0x7fe8fc1592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:19.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.436+0000 7fe903200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc159d60 con 0x7fe8fc0ca050 2024-08-17T02:24:19.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.436+0000 7fe903200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc0abbb0 con 0x7fe8fc0ad960 2024-08-17T02:24:19.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.436+0000 7fe903200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc159810 con 0x7fe8fc0add30 2024-08-17T02:24:19.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.436+0000 7fe901200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8fc0ca050 0x7fe8fc1592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:19.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.436+0000 7fe901200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8fc0ca050 0x7fe8fc1592d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46250/0 (socket says 172.21.15.2:46250) 2024-08-17T02:24:19.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.436+0000 7fe901200640 1 -- 172.21.15.2:0/3568632287 learned_addr learned my addr 172.21.15.2:0/3568632287 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:19.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.436+0000 7fe8f3e00640 1 --2- 172.21.15.2:0/3568632287 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe8fc0add30 0x7fe8fc158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:19.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.436+0000 7fe8fbe00640 1 --2- 172.21.15.2:0/3568632287 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe8fc0ad960 0x7fe8fc154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:19.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.436+0000 7fe901200640 1 -- 172.21.15.2:0/3568632287 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe8fc0add30 msgr2=0x7fe8fc158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:19.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.436+0000 7fe901200640 1 --2- 172.21.15.2:0/3568632287 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe8fc0add30 0x7fe8fc158d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.436+0000 7fe901200640 1 -- 172.21.15.2:0/3568632287 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe8fc0ad960 msgr2=0x7fe8fc154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:19.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.437+0000 7fe901200640 1 --2- 172.21.15.2:0/3568632287 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe8fc0ad960 0x7fe8fc154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.437+0000 7fe901200640 1 -- 172.21.15.2:0/3568632287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e4009450 con 0x7fe8fc0ca050 2024-08-17T02:24:19.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.437+0000 7fe901200640 1 --2- 172.21.15.2:0/3568632287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8fc0ca050 0x7fe8fc1592d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe8f400c970 tx=0x7fe8f4001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:19.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.437+0000 7fe8f3400640 1 -- 172.21.15.2:0/3568632287 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4005d60 con 0x7fe8fc0ca050 2024-08-17T02:24:19.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.437+0000 7fe8f3400640 1 -- 172.21.15.2:0/3568632287 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f400a640 con 0x7fe8fc0ca050 2024-08-17T02:24:19.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.437+0000 7fe8f3400640 1 -- 172.21.15.2:0/3568632287 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f400aa00 con 0x7fe8fc0ca050 2024-08-17T02:24:19.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.437+0000 7fe903200640 1 -- 172.21.15.2:0/3568632287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8fc159a80 con 0x7fe8fc0ca050 2024-08-17T02:24:19.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.437+0000 7fe903200640 1 -- 172.21.15.2:0/3568632287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8fc0ab840 con 0x7fe8fc0ca050 2024-08-17T02:24:19.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.438+0000 7fe903200640 1 -- 172.21.15.2:0/3568632287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8fc063fb0 con 0x7fe8fc0ca050 2024-08-17T02:24:19.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.439+0000 7fe8f3400640 1 -- 172.21.15.2:0/3568632287 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe8f40070f0 con 0x7fe8fc0ca050 2024-08-17T02:24:19.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.440+0000 7fe8f3400640 1 --2- 172.21.15.2:0/3568632287 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe8d8065150 0x7fe8d8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:19.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.440+0000 7fe8f3400640 1 -- 172.21.15.2:0/3568632287 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe8f4081c30 con 0x7fe8fc0ca050 2024-08-17T02:24:19.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.440+0000 7fe8fbe00640 1 --2- 172.21.15.2:0/3568632287 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe8d8065150 0x7fe8d8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:19.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.441+0000 7fe8fbe00640 1 --2- 172.21.15.2:0/3568632287 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe8d8065150 0x7fe8d8067600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec007ba0 tx=0x7fe8ec008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:19.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.443+0000 7fe8f3400640 1 -- 172.21.15.2:0/3568632287 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe8f40500d0 con 0x7fe8fc0ca050 2024-08-17T02:24:19.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.693+0000 7fe903200640 1 -- 172.21.15.2:0/3568632287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fe8fc15b5e0 con 0x7fe8fc0ca050 2024-08-17T02:24:19.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.696+0000 7fe8f3400640 1 -- 172.21.15.2:0/3568632287 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe8fc15b5e0 con 0x7fe8fc0ca050 2024-08-17T02:24:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.699+0000 7fe903200640 1 -- 172.21.15.2:0/3568632287 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe8d8065150 msgr2=0x7fe8d8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.699+0000 7fe903200640 1 --2- 172.21.15.2:0/3568632287 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe8d8065150 0x7fe8d8067600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec007ba0 tx=0x7fe8ec008040 comp rx=0 tx=0).stop 2024-08-17T02:24:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.699+0000 7fe903200640 1 -- 172.21.15.2:0/3568632287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8fc0ca050 msgr2=0x7fe8fc1592d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.699+0000 7fe903200640 1 --2- 172.21.15.2:0/3568632287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8fc0ca050 0x7fe8fc1592d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe8f400c970 tx=0x7fe8f4001690 comp rx=0 tx=0).stop 2024-08-17T02:24:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.699+0000 7fe903200640 1 -- 172.21.15.2:0/3568632287 shutdown_connections 2024-08-17T02:24:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.699+0000 7fe903200640 1 --2- 172.21.15.2:0/3568632287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8fc0ca050 0x7fe8fc1592d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.699+0000 7fe903200640 1 --2- 172.21.15.2:0/3568632287 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe8d8065150 0x7fe8d8067600 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.699+0000 7fe903200640 1 --2- 172.21.15.2:0/3568632287 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe8fc0add30 0x7fe8fc158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.699+0000 7fe903200640 1 --2- 172.21.15.2:0/3568632287 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe8fc0ad960 0x7fe8fc154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.699+0000 7fe903200640 1 -- 172.21.15.2:0/3568632287 >> 172.21.15.2:0/3568632287 conn(0x7fe8fc066e60 msgr2=0x7fe8fc1532f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.699+0000 7fe903200640 1 -- 172.21.15.2:0/3568632287 shutdown_connections 2024-08-17T02:24:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.699+0000 7fe903200640 1 -- 172.21.15.2:0/3568632287 wait complete. 2024-08-17T02:24:19.714 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:19.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.866+0000 7f4be7200640 1 Processor -- start 2024-08-17T02:24:19.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.866+0000 7f4be7200640 1 -- start start 2024-08-17T02:24:19.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.867+0000 7f4be7200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f4be00ad960 0x7f4be015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:19.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.867+0000 7f4be7200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be015b5e0 con 0x7f4be00ca050 2024-08-17T02:24:19.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.867+0000 7f4be7200640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be00cb160 con 0x7f4be00add30 2024-08-17T02:24:19.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.867+0000 7f4be7200640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be00b0d10 con 0x7f4be00ad960 2024-08-17T02:24:19.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.867+0000 7f4bd7e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4be00ca050 0x7f4be0156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38492/0 (socket says 172.21.15.2:38492) 2024-08-17T02:24:19.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.867+0000 7f4bd7e00640 1 -- 172.21.15.2:0/314851507 learned_addr learned my addr 172.21.15.2:0/314851507 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:19.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.868+0000 7f4bdfe00640 1 --2- 172.21.15.2:0/314851507 >> v2:172.21.15.145:3300/0 conn(0x7f4be00ad960 0x7f4be015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:19.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.868+0000 7f4bdf400640 1 -- 172.21.15.2:0/314851507 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850584764 0 0) 0x7f4bc8001110 con 0x7f4be00ca050 2024-08-17T02:24:19.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.868+0000 7f4bdf400640 1 -- 172.21.15.2:0/314851507 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bc40034e0 con 0x7f4be00ca050 2024-08-17T02:24:19.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.868+0000 7f4bdf400640 1 -- 172.21.15.2:0/314851507 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2260406248 0 0) 0x7f4bc40034e0 con 0x7f4be00ca050 2024-08-17T02:24:19.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.868+0000 7f4bdf400640 1 -- 172.21.15.2:0/314851507 >> v2:172.21.15.145:3300/0 conn(0x7f4be00ad960 msgr2=0x7f4be015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:19.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.868+0000 7f4bdf400640 1 --2- 172.21.15.2:0/314851507 >> v2:172.21.15.145:3300/0 conn(0x7f4be00ad960 0x7f4be015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.868+0000 7f4bdf400640 1 -- 172.21.15.2:0/314851507 >> v1:172.21.15.145:6789/0 conn(0x7f4be00add30 legacy=0x7f4be00aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:19.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.868+0000 7f4bdf400640 1 -- 172.21.15.2:0/314851507 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be00ca550 con 0x7f4be00ca050 2024-08-17T02:24:19.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.868+0000 7f4bdf400640 1 -- 172.21.15.2:0/314851507 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7f4bc8001600 con 0x7f4be00ca050 2024-08-17T02:24:19.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.868+0000 7f4bdf400640 1 -- 172.21.15.2:0/314851507 >> v1:172.21.15.2:6789/0 conn(0x7f4be00ca050 legacy=0x7f4be0156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:19.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.868+0000 7f4bdf400640 1 --2- 172.21.15.2:0/314851507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4bc40039d0 0x7f4bc4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:19.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.868+0000 7f4bdf400640 1 --2- 172.21.15.2:0/314851507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4bc4004780 0x7f4bc4004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:19.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.868+0000 7f4bdf400640 1 --2- 172.21.15.2:0/314851507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc4005130 0x7f4bc400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:19.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.868+0000 7f4bdf400640 1 -- 172.21.15.2:0/314851507 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be00b0d10 con 0x7f4bc4005130 2024-08-17T02:24:19.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.868+0000 7f4bdf400640 1 -- 172.21.15.2:0/314851507 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc400c040 con 0x7f4bc4004780 2024-08-17T02:24:19.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.868+0000 7f4bdf400640 1 -- 172.21.15.2:0/314851507 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc400c200 con 0x7f4bc40039d0 2024-08-17T02:24:19.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.868+0000 7f4bdfe00640 1 --2- 172.21.15.2:0/314851507 >> v2:172.21.15.145:3300/0 conn(0x7f4be00ad960 0x7f4be015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:19.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.869+0000 7f4be5200640 1 --2- 172.21.15.2:0/314851507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc4005130 0x7f4bc400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:19.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.869+0000 7f4bd7e00640 1 --2- 172.21.15.2:0/314851507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4bc4004780 0x7f4bc4004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:19.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.869+0000 7f4bdfe00640 1 --2- 172.21.15.2:0/314851507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4bc40039d0 0x7f4bc4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:19.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.869+0000 7f4be5200640 1 -- 172.21.15.2:0/314851507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4bc40039d0 msgr2=0x7f4bc4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:19.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.869+0000 7f4be5200640 1 --2- 172.21.15.2:0/314851507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4bc40039d0 0x7f4bc4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.869+0000 7f4be5200640 1 -- 172.21.15.2:0/314851507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4bc4004780 msgr2=0x7f4bc4004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:19.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.869+0000 7f4be5200640 1 --2- 172.21.15.2:0/314851507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4bc4004780 0x7f4bc4004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.869+0000 7f4be5200640 1 -- 172.21.15.2:0/314851507 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc40034e0 con 0x7f4bc4005130 2024-08-17T02:24:19.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.870+0000 7f4be5200640 1 -- 172.21.15.2:0/314851507 reap_dead start 2024-08-17T02:24:19.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.870+0000 7f4be5200640 1 --2- 172.21.15.2:0/314851507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc4005130 0x7f4bc400b9d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8001f20 tx=0x7f4bd8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7a67248a2c4a85 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:19.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.870+0000 7f4bdf400640 1 -- 172.21.15.2:0/314851507 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd802aca0 con 0x7f4bc4005130 2024-08-17T02:24:19.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.870+0000 7f4bdf400640 1 -- 172.21.15.2:0/314851507 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd802ae20 con 0x7f4bc4005130 2024-08-17T02:24:19.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.870+0000 7f4bdf400640 1 -- 172.21.15.2:0/314851507 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8032680 con 0x7f4bc4005130 2024-08-17T02:24:19.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.871+0000 7f4be7200640 1 -- 172.21.15.2:0/314851507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc4005130 msgr2=0x7f4bc400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:19.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.871+0000 7f4be7200640 1 --2- 172.21.15.2:0/314851507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc4005130 0x7f4bc400b9d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8001f20 tx=0x7f4bd8007f90 comp rx=0 tx=0).stop 2024-08-17T02:24:19.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.871+0000 7f4be7200640 1 -- 172.21.15.2:0/314851507 shutdown_connections 2024-08-17T02:24:19.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.871+0000 7f4be7200640 1 --2- 172.21.15.2:0/314851507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc4005130 0x7f4bc400b9d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.871+0000 7f4be7200640 1 -- 172.21.15.2:0/314851507 >> 172.21.15.2:0/314851507 conn(0x7f4be0066e60 msgr2=0x7f4be0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:19.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.871+0000 7f4be7200640 1 -- 172.21.15.2:0/314851507 shutdown_connections 2024-08-17T02:24:19.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.871+0000 7f4be7200640 1 -- 172.21.15.2:0/314851507 wait complete. 2024-08-17T02:24:19.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.872+0000 7f4be7200640 1 Processor -- start 2024-08-17T02:24:19.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.873+0000 7f4be7200640 1 -- start start 2024-08-17T02:24:19.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.873+0000 7f4be7200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc4005130 0x7f4be016a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:19.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.873+0000 7f4be7200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4be0151fa0 0x7f4be0169270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:19.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.873+0000 7f4be7200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4be01697b0 0x7f4be016bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:19.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.873+0000 7f4be7200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be016a280 con 0x7f4bc4005130 2024-08-17T02:24:19.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.873+0000 7f4be7200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be00ac0d0 con 0x7f4be01697b0 2024-08-17T02:24:19.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.873+0000 7f4be7200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be0169cc0 con 0x7f4be0151fa0 2024-08-17T02:24:19.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.874+0000 7f4bdfe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc4005130 0x7f4be016a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:19.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.874+0000 7f4bdfe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc4005130 0x7f4be016a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46270/0 (socket says 172.21.15.2:46270) 2024-08-17T02:24:19.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.874+0000 7f4bdfe00640 1 -- 172.21.15.2:0/1403325107 learned_addr learned my addr 172.21.15.2:0/1403325107 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:19.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.874+0000 7f4bd7e00640 1 --2- 172.21.15.2:0/1403325107 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4be0151fa0 0x7f4be0169270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:19.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.874+0000 7f4be5200640 1 --2- 172.21.15.2:0/1403325107 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4be01697b0 0x7f4be016bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:19.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.874+0000 7f4bdfe00640 1 -- 172.21.15.2:0/1403325107 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4be0151fa0 msgr2=0x7f4be0169270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:19.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.874+0000 7f4bdfe00640 1 --2- 172.21.15.2:0/1403325107 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4be0151fa0 0x7f4be0169270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.874+0000 7f4bdfe00640 1 -- 172.21.15.2:0/1403325107 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4be01697b0 msgr2=0x7f4be016bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:19.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.874+0000 7f4bdfe00640 1 --2- 172.21.15.2:0/1403325107 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4be01697b0 0x7f4be016bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.874+0000 7f4bdfe00640 1 -- 172.21.15.2:0/1403325107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be0169fa0 con 0x7f4bc4005130 2024-08-17T02:24:19.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.874+0000 7f4bd7e00640 1 --2- 172.21.15.2:0/1403325107 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4be0151fa0 0x7f4be0169270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:19.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.874+0000 7f4be5200640 1 --2- 172.21.15.2:0/1403325107 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4be01697b0 0x7f4be016bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:19.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.874+0000 7f4bdfe00640 1 --2- 172.21.15.2:0/1403325107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc4005130 0x7f4be016a440 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00118e0 tx=0x7f4bd0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:19.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.875+0000 7f4bd7400640 1 -- 172.21.15.2:0/1403325107 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0011ed0 con 0x7f4bc4005130 2024-08-17T02:24:19.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.875+0000 7f4bd7400640 1 -- 172.21.15.2:0/1403325107 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd000f9d0 con 0x7f4bc4005130 2024-08-17T02:24:19.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.875+0000 7f4bd7400640 1 -- 172.21.15.2:0/1403325107 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd000fd90 con 0x7f4bc4005130 2024-08-17T02:24:19.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.875+0000 7f4be7200640 1 -- 172.21.15.2:0/1403325107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be00a8a80 con 0x7f4bc4005130 2024-08-17T02:24:19.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.875+0000 7f4be7200640 1 -- 172.21.15.2:0/1403325107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be00afcd0 con 0x7f4bc4005130 2024-08-17T02:24:19.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.876+0000 7f4be7200640 1 -- 172.21.15.2:0/1403325107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be00a88e0 con 0x7f4bc4005130 2024-08-17T02:24:19.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.877+0000 7f4bd7400640 1 -- 172.21.15.2:0/1403325107 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4bd0015670 con 0x7f4bc4005130 2024-08-17T02:24:19.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.878+0000 7f4bd7400640 1 --2- 172.21.15.2:0/1403325107 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4bbc065150 0x7f4bbc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:19.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.878+0000 7f4bd7400640 1 -- 172.21.15.2:0/1403325107 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4bd0082ad0 con 0x7f4bc4005130 2024-08-17T02:24:19.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.879+0000 7f4bd7e00640 1 --2- 172.21.15.2:0/1403325107 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4bbc065150 0x7f4bbc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:19.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.879+0000 7f4bd7e00640 1 --2- 172.21.15.2:0/1403325107 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4bbc065150 0x7f4bbc067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8000e10 tx=0x7f4bc8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:19.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:19.882+0000 7f4bd7400640 1 -- 172.21.15.2:0/1403325107 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4be00a88e0 con 0x7f4bc4005130 2024-08-17T02:24:20.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.069+0000 7f4be7200640 1 -- 172.21.15.2:0/1403325107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4be00a88e0 con 0x7f4bc4005130 2024-08-17T02:24:20.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.070+0000 7f4bd7400640 1 -- 172.21.15.2:0/1403325107 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12086 (secure 0 0 0) 0x7f4be00a88e0 con 0x7f4bc4005130 2024-08-17T02:24:20.070 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:24:20.070 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:24:16.616470+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:20.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.072+0000 7f4be7200640 1 -- 172.21.15.2:0/1403325107 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4bbc065150 msgr2=0x7f4bbc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:20.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.072+0000 7f4be7200640 1 --2- 172.21.15.2:0/1403325107 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4bbc065150 0x7f4bbc067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8000e10 tx=0x7f4bc8009040 comp rx=0 tx=0).stop 2024-08-17T02:24:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.072+0000 7f4be7200640 1 -- 172.21.15.2:0/1403325107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc4005130 msgr2=0x7f4be016a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.072+0000 7f4be7200640 1 --2- 172.21.15.2:0/1403325107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc4005130 0x7f4be016a440 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00118e0 tx=0x7f4bd0008040 comp rx=0 tx=0).stop 2024-08-17T02:24:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.072+0000 7f4be7200640 1 -- 172.21.15.2:0/1403325107 shutdown_connections 2024-08-17T02:24:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.072+0000 7f4be7200640 1 --2- 172.21.15.2:0/1403325107 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4be01697b0 0x7f4be016bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.072+0000 7f4be7200640 1 --2- 172.21.15.2:0/1403325107 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4bbc065150 0x7f4bbc067600 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.072+0000 7f4be7200640 1 --2- 172.21.15.2:0/1403325107 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4be0151fa0 0x7f4be0169270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.072+0000 7f4be7200640 1 --2- 172.21.15.2:0/1403325107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc4005130 0x7f4be016a440 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.072+0000 7f4be7200640 1 -- 172.21.15.2:0/1403325107 >> 172.21.15.2:0/1403325107 conn(0x7f4be0066e60 msgr2=0x7f4be01548d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.072+0000 7f4be7200640 1 -- 172.21.15.2:0/1403325107 shutdown_connections 2024-08-17T02:24:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.072+0000 7f4be7200640 1 -- 172.21.15.2:0/1403325107 wait complete. 2024-08-17T02:24:20.087 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:23:26.107978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:24:20.087 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:24:20.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.242+0000 7f9242000640 1 Processor -- start 2024-08-17T02:24:20.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.242+0000 7f9242000640 1 -- start start 2024-08-17T02:24:20.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.243+0000 7f9242000640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f923c0ad640 0x7f923c0ada10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:20.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.243+0000 7f9242000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f923c0aff50 0x7f923c0a8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:20.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.243+0000 7f9242000640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f923c15d8f0 con 0x7f923c0b0910 2024-08-17T02:24:20.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.243+0000 7f9242000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f923c15cce0 con 0x7f923c0aff50 2024-08-17T02:24:20.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.243+0000 7f9242000640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f923c15cfc0 con 0x7f923c0ad640 2024-08-17T02:24:20.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.243+0000 7f923be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f923c0aff50 0x7f923c0a8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:20.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.243+0000 7f923be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f923c0aff50 0x7f923c0a8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46278/0 (socket says 172.21.15.2:46278) 2024-08-17T02:24:20.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.243+0000 7f923be00640 1 -- 172.21.15.2:0/44096933 learned_addr learned my addr 172.21.15.2:0/44096933 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:20.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.244+0000 7f923be00640 1 -- 172.21.15.2:0/44096933 >> v2:172.21.15.145:3300/0 conn(0x7f923c0ad640 msgr2=0x7f923c0ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:20.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.244+0000 7f923b400640 1 --2- 172.21.15.2:0/44096933 >> v2:172.21.15.145:3300/0 conn(0x7f923c0ad640 0x7f923c0ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:20.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.244+0000 7f923be00640 1 --2- 172.21.15.2:0/44096933 >> v2:172.21.15.145:3300/0 conn(0x7f923c0ad640 0x7f923c0ada10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.244+0000 7f923be00640 1 -- 172.21.15.2:0/44096933 >> v1:172.21.15.145:6789/0 conn(0x7f923c0b0910 legacy=0x7f923c0a7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:20.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.244+0000 7f923be00640 1 -- 172.21.15.2:0/44096933 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c15d2a0 con 0x7f923c0aff50 2024-08-17T02:24:20.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.244+0000 7f923b400640 1 --2- 172.21.15.2:0/44096933 >> v2:172.21.15.145:3300/0 conn(0x7f923c0ad640 0x7f923c0ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:20.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.245+0000 7f923be00640 1 --2- 172.21.15.2:0/44096933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f923c0aff50 0x7f923c0a8380 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f923c06a820 tx=0x7f9234009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe680e05c944f6d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:20.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.245+0000 7f923aa00640 1 -- 172.21.15.2:0/44096933 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9234007400 con 0x7f923c0aff50 2024-08-17T02:24:20.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.245+0000 7f923aa00640 1 -- 172.21.15.2:0/44096933 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9234007560 con 0x7f923c0aff50 2024-08-17T02:24:20.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.245+0000 7f923aa00640 1 -- 172.21.15.2:0/44096933 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9234007940 con 0x7f923c0aff50 2024-08-17T02:24:20.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.245+0000 7f9242000640 1 -- 172.21.15.2:0/44096933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f923c0aff50 msgr2=0x7f923c0a8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:20.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.245+0000 7f9242000640 1 --2- 172.21.15.2:0/44096933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f923c0aff50 0x7f923c0a8380 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f923c06a820 tx=0x7f9234009840 comp rx=0 tx=0).stop 2024-08-17T02:24:20.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.246+0000 7f9242000640 1 -- 172.21.15.2:0/44096933 shutdown_connections 2024-08-17T02:24:20.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.246+0000 7f9242000640 1 --2- 172.21.15.2:0/44096933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f923c0aff50 0x7f923c0a8380 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.246+0000 7f9242000640 1 --2- 172.21.15.2:0/44096933 >> v2:172.21.15.145:3300/0 conn(0x7f923c0ad640 0x7f923c0ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.246+0000 7f9242000640 1 -- 172.21.15.2:0/44096933 >> 172.21.15.2:0/44096933 conn(0x7f923c0b3800 msgr2=0x7f923c066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:20.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.246+0000 7f9242000640 1 -- 172.21.15.2:0/44096933 shutdown_connections 2024-08-17T02:24:20.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.246+0000 7f9242000640 1 -- 172.21.15.2:0/44096933 wait complete. 2024-08-17T02:24:20.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.247+0000 7f9242000640 1 Processor -- start 2024-08-17T02:24:20.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.247+0000 7f9242000640 1 -- start start 2024-08-17T02:24:20.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.248+0000 7f9242000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f923c0ad640 0x7f923c146770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:20.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.248+0000 7f9242000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f923c0aff50 0x7f923c096050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:20.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.248+0000 7f9242000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f923c0b0910 0x7f923c0ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:20.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.248+0000 7f9242000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c0cbad0 con 0x7f923c0aff50 2024-08-17T02:24:20.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.248+0000 7f9242000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c146cb0 con 0x7f923c0ad640 2024-08-17T02:24:20.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.248+0000 7f9242000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923c0cc8c0 con 0x7f923c0b0910 2024-08-17T02:24:20.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.248+0000 7f9233e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f923c0aff50 0x7f923c096050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:20.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.248+0000 7f9233e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f923c0aff50 0x7f923c096050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46284/0 (socket says 172.21.15.2:46284) 2024-08-17T02:24:20.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.248+0000 7f9233e00640 1 -- 172.21.15.2:0/3722976137 learned_addr learned my addr 172.21.15.2:0/3722976137 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:20.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.248+0000 7f923b400640 1 --2- 172.21.15.2:0/3722976137 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f923c0ad640 0x7f923c146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:20.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.248+0000 7f923be00640 1 --2- 172.21.15.2:0/3722976137 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f923c0b0910 0x7f923c0ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:20.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.249+0000 7f9233e00640 1 -- 172.21.15.2:0/3722976137 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f923c0b0910 msgr2=0x7f923c0ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:20.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.249+0000 7f9233e00640 1 --2- 172.21.15.2:0/3722976137 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f923c0b0910 0x7f923c0ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.249+0000 7f9233e00640 1 -- 172.21.15.2:0/3722976137 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f923c0ad640 msgr2=0x7f923c146770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:20.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.249+0000 7f9233e00640 1 --2- 172.21.15.2:0/3722976137 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f923c0ad640 0x7f923c146770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.249+0000 7f9233e00640 1 -- 172.21.15.2:0/3722976137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9234009ae0 con 0x7f923c0aff50 2024-08-17T02:24:20.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.249+0000 7f923be00640 1 --2- 172.21.15.2:0/3722976137 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f923c0b0910 0x7f923c0ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:20.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.249+0000 7f9233e00640 1 --2- 172.21.15.2:0/3722976137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f923c0aff50 0x7f923c096050 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f922400c510 tx=0x7f9224007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:20.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.249+0000 7f9232a00640 1 -- 172.21.15.2:0/3722976137 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9224011590 con 0x7f923c0aff50 2024-08-17T02:24:20.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.249+0000 7f9232a00640 1 -- 172.21.15.2:0/3722976137 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9224011710 con 0x7f923c0aff50 2024-08-17T02:24:20.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.249+0000 7f9242000640 1 -- 172.21.15.2:0/3722976137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f923c0cbcb0 con 0x7f923c0aff50 2024-08-17T02:24:20.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.249+0000 7f9232a00640 1 -- 172.21.15.2:0/3722976137 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9224011ad0 con 0x7f923c0aff50 2024-08-17T02:24:20.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.249+0000 7f9242000640 1 -- 172.21.15.2:0/3722976137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f923c0cc270 con 0x7f923c0aff50 2024-08-17T02:24:20.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.251+0000 7f9242000640 1 -- 172.21.15.2:0/3722976137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f923c063fb0 con 0x7f923c0aff50 2024-08-17T02:24:20.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.251+0000 7f9232a00640 1 -- 172.21.15.2:0/3722976137 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f922401c460 con 0x7f923c0aff50 2024-08-17T02:24:20.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.252+0000 7f9232a00640 1 --2- 172.21.15.2:0/3722976137 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9218065150 0x7f9218067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:20.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.252+0000 7f9232a00640 1 -- 172.21.15.2:0/3722976137 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9224081de0 con 0x7f923c0aff50 2024-08-17T02:24:20.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.253+0000 7f923b400640 1 --2- 172.21.15.2:0/3722976137 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9218065150 0x7f9218067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:20.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.254+0000 7f923b400640 1 --2- 172.21.15.2:0/3722976137 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9218065150 0x7f9218067600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f922c00ac20 tx=0x7f922c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:20.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.256+0000 7f9232a00640 1 -- 172.21.15.2:0/3722976137 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9224050150 con 0x7f923c0aff50 2024-08-17T02:24:20.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.436+0000 7f9242000640 1 -- 172.21.15.2:0/3722976137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f923c067810 con 0x7f923c0aff50 2024-08-17T02:24:20.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.436+0000 7f9232a00640 1 -- 172.21.15.2:0/3722976137 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9224053770 con 0x7f923c0aff50 2024-08-17T02:24:20.437 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-17T02:24:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.438+0000 7f9242000640 1 -- 172.21.15.2:0/3722976137 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9218065150 msgr2=0x7f9218067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.438+0000 7f9242000640 1 --2- 172.21.15.2:0/3722976137 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9218065150 0x7f9218067600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f922c00ac20 tx=0x7f922c008040 comp rx=0 tx=0).stop 2024-08-17T02:24:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.438+0000 7f9242000640 1 -- 172.21.15.2:0/3722976137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f923c0aff50 msgr2=0x7f923c096050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.438+0000 7f9242000640 1 --2- 172.21.15.2:0/3722976137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f923c0aff50 0x7f923c096050 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f922400c510 tx=0x7f9224007ea0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.438+0000 7f9242000640 1 -- 172.21.15.2:0/3722976137 shutdown_connections 2024-08-17T02:24:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.438+0000 7f9242000640 1 --2- 172.21.15.2:0/3722976137 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9218065150 0x7f9218067600 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.438+0000 7f9242000640 1 --2- 172.21.15.2:0/3722976137 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f923c0b0910 0x7f923c0ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.438+0000 7f9242000640 1 --2- 172.21.15.2:0/3722976137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f923c0aff50 0x7f923c096050 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.438+0000 7f9242000640 1 --2- 172.21.15.2:0/3722976137 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f923c0ad640 0x7f923c146770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.438+0000 7f9242000640 1 -- 172.21.15.2:0/3722976137 >> 172.21.15.2:0/3722976137 conn(0x7f923c0b3800 msgr2=0x7f923c0b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.438+0000 7f9242000640 1 -- 172.21.15.2:0/3722976137 shutdown_connections 2024-08-17T02:24:20.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.438+0000 7f9242000640 1 -- 172.21.15.2:0/3722976137 wait complete. 2024-08-17T02:24:20.453 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:24:20.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.605+0000 7f0117800640 1 Processor -- start 2024-08-17T02:24:20.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.605+0000 7f0117800640 1 -- start start 2024-08-17T02:24:20.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.607+0000 7f0117800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0110158a20 0x7f01100a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:20.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.607+0000 7f0117800640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f011006dee0 0x7f01100afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:20.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.607+0000 7f0117800640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01100aed90 con 0x7f01100ae860 2024-08-17T02:24:20.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.607+0000 7f0117800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01100af070 con 0x7f0110158a20 2024-08-17T02:24:20.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.607+0000 7f0117800640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01100af350 con 0x7f011006dee0 2024-08-17T02:24:20.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.607+0000 7f0114e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0110158a20 0x7f01100a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:20.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.607+0000 7f0114e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0110158a20 0x7f01100a89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46290/0 (socket says 172.21.15.2:46290) 2024-08-17T02:24:20.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.607+0000 7f0114e00640 1 -- 172.21.15.2:0/2279313444 learned_addr learned my addr 172.21.15.2:0/2279313444 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:20.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.607+0000 7f0115800640 1 --2- 172.21.15.2:0/2279313444 >> v2:172.21.15.145:3300/0 conn(0x7f011006dee0 0x7f01100afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:20.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.607+0000 7f0114e00640 1 -- 172.21.15.2:0/2279313444 >> v2:172.21.15.145:3300/0 conn(0x7f011006dee0 msgr2=0x7f01100afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:20.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.607+0000 7f0114e00640 1 --2- 172.21.15.2:0/2279313444 >> v2:172.21.15.145:3300/0 conn(0x7f011006dee0 0x7f01100afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.607+0000 7f0114e00640 1 -- 172.21.15.2:0/2279313444 >> v1:172.21.15.145:6789/0 conn(0x7f01100ae860 legacy=0x7f011006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:20.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.608+0000 7f0114e00640 1 -- 172.21.15.2:0/2279313444 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01100af630 con 0x7f0110158a20 2024-08-17T02:24:20.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.609+0000 7f0114e00640 1 --2- 172.21.15.2:0/2279313444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0110158a20 0x7f01100a89c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f011006eba0 tx=0x7f01000091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa212856c53e00db server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:20.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.609+0000 7f010fe00640 1 -- 172.21.15.2:0/2279313444 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010002ae80 con 0x7f0110158a20 2024-08-17T02:24:20.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.609+0000 7f010fe00640 1 -- 172.21.15.2:0/2279313444 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0100032440 con 0x7f0110158a20 2024-08-17T02:24:20.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.609+0000 7f010fe00640 1 -- 172.21.15.2:0/2279313444 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0100032800 con 0x7f0110158a20 2024-08-17T02:24:20.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.609+0000 7f0117800640 1 -- 172.21.15.2:0/2279313444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0110158a20 msgr2=0x7f01100a89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:20.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.609+0000 7f0117800640 1 --2- 172.21.15.2:0/2279313444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0110158a20 0x7f01100a89c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f011006eba0 tx=0x7f01000091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.609+0000 7f0117800640 1 -- 172.21.15.2:0/2279313444 shutdown_connections 2024-08-17T02:24:20.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.609+0000 7f0117800640 1 --2- 172.21.15.2:0/2279313444 >> v2:172.21.15.145:3300/0 conn(0x7f011006dee0 0x7f01100afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.609+0000 7f0117800640 1 --2- 172.21.15.2:0/2279313444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0110158a20 0x7f01100a89c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.609+0000 7f0117800640 1 -- 172.21.15.2:0/2279313444 >> 172.21.15.2:0/2279313444 conn(0x7f0110066e60 msgr2=0x7f0110067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.610+0000 7f0117800640 1 -- 172.21.15.2:0/2279313444 shutdown_connections 2024-08-17T02:24:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.610+0000 7f0117800640 1 -- 172.21.15.2:0/2279313444 wait complete. 2024-08-17T02:24:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.611+0000 7f0117800640 1 Processor -- start 2024-08-17T02:24:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.611+0000 7f0117800640 1 -- start start 2024-08-17T02:24:20.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.612+0000 7f0117800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f011006dee0 0x7f01100ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:20.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.612+0000 7f0117800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f01100ae860 0x7f011015b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:20.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.612+0000 7f0117800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0110158a20 0x7f011015bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:20.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.612+0000 7f0117800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01101598c0 con 0x7f011006dee0 2024-08-17T02:24:20.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.612+0000 7f0117800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0110156dd0 con 0x7f0110158a20 2024-08-17T02:24:20.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.612+0000 7f0117800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0110158fd0 con 0x7f01100ae860 2024-08-17T02:24:20.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.612+0000 7f0114e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f011006dee0 0x7f01100ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:20.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.612+0000 7f0114e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f011006dee0 0x7f01100ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46294/0 (socket says 172.21.15.2:46294) 2024-08-17T02:24:20.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.612+0000 7f0114e00640 1 -- 172.21.15.2:0/4086684996 learned_addr learned my addr 172.21.15.2:0/4086684996 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:20.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.613+0000 7f0107e00640 1 --2- 172.21.15.2:0/4086684996 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f01100ae860 0x7f011015b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:20.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.613+0000 7f0115800640 1 --2- 172.21.15.2:0/4086684996 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0110158a20 0x7f011015bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:20.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.613+0000 7f0114e00640 1 -- 172.21.15.2:0/4086684996 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f01100ae860 msgr2=0x7f011015b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:20.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.613+0000 7f0114e00640 1 --2- 172.21.15.2:0/4086684996 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f01100ae860 0x7f011015b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.613+0000 7f0114e00640 1 -- 172.21.15.2:0/4086684996 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0110158a20 msgr2=0x7f011015bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:20.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.613+0000 7f0114e00640 1 --2- 172.21.15.2:0/4086684996 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0110158a20 0x7f011015bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.613+0000 7f0114e00640 1 -- 172.21.15.2:0/4086684996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0100009450 con 0x7f011006dee0 2024-08-17T02:24:20.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.613+0000 7f0107e00640 1 --2- 172.21.15.2:0/4086684996 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f01100ae860 0x7f011015b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:20.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.613+0000 7f0115800640 1 --2- 172.21.15.2:0/4086684996 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0110158a20 0x7f011015bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:20.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.613+0000 7f0114e00640 1 --2- 172.21.15.2:0/4086684996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f011006dee0 0x7f01100ca8e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0100009210 tx=0x7f0100032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:20.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.613+0000 7f010cc00640 1 -- 172.21.15.2:0/4086684996 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0100031de0 con 0x7f011006dee0 2024-08-17T02:24:20.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.613+0000 7f010cc00640 1 -- 172.21.15.2:0/4086684996 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0100000c40 con 0x7f011006dee0 2024-08-17T02:24:20.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.613+0000 7f010cc00640 1 -- 172.21.15.2:0/4086684996 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010003d670 con 0x7f011006dee0 2024-08-17T02:24:20.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.613+0000 7f0117800640 1 -- 172.21.15.2:0/4086684996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0110159270 con 0x7f011006dee0 2024-08-17T02:24:20.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.614+0000 7f0117800640 1 -- 172.21.15.2:0/4086684996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01100cae20 con 0x7f011006dee0 2024-08-17T02:24:20.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.615+0000 7f0117800640 1 -- 172.21.15.2:0/4086684996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01100cb060 con 0x7f011006dee0 2024-08-17T02:24:20.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.615+0000 7f010cc00640 1 -- 172.21.15.2:0/4086684996 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0100039040 con 0x7f011006dee0 2024-08-17T02:24:20.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.616+0000 7f010cc00640 1 --2- 172.21.15.2:0/4086684996 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f00ec065180 0x7f00ec067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:20.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.616+0000 7f010cc00640 1 -- 172.21.15.2:0/4086684996 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f01000a1ff0 con 0x7f011006dee0 2024-08-17T02:24:20.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.617+0000 7f0107e00640 1 --2- 172.21.15.2:0/4086684996 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f00ec065180 0x7f00ec067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:20.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.617+0000 7f0107e00640 1 --2- 172.21.15.2:0/4086684996 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f00ec065180 0x7f00ec067630 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f011015ce70 tx=0x7f00f8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:20.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.620+0000 7f010cc00640 1 -- 172.21.15.2:0/4086684996 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f01100cb060 con 0x7f011006dee0 2024-08-17T02:24:20.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.807+0000 7f0117800640 1 -- 172.21.15.2:0/4086684996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f01100cb060 con 0x7f011006dee0 2024-08-17T02:24:20.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.807+0000 7f010cc00640 1 -- 172.21.15.2:0/4086684996 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0100042060 con 0x7f011006dee0 2024-08-17T02:24:20.807 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:24:20.807 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2024-08-17T02:24:20.808 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:20.808 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2024-08-17T02:24:20.808 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2024-08-17T02:24:20.808 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:20.808 INFO:teuthology.orchestra.run.smithi002.stdout:] 2024-08-17T02:24:20.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.809+0000 7f0117800640 1 -- 172.21.15.2:0/4086684996 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f00ec065180 msgr2=0x7f00ec067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:20.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.809+0000 7f0117800640 1 --2- 172.21.15.2:0/4086684996 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f00ec065180 0x7f00ec067630 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f011015ce70 tx=0x7f00f8009040 comp rx=0 tx=0).stop 2024-08-17T02:24:20.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.809+0000 7f0117800640 1 -- 172.21.15.2:0/4086684996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f011006dee0 msgr2=0x7f01100ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:20.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.809+0000 7f0117800640 1 --2- 172.21.15.2:0/4086684996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f011006dee0 0x7f01100ca8e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0100009210 tx=0x7f0100032000 comp rx=0 tx=0).stop 2024-08-17T02:24:20.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.809+0000 7f0117800640 1 -- 172.21.15.2:0/4086684996 shutdown_connections 2024-08-17T02:24:20.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.809+0000 7f0117800640 1 --2- 172.21.15.2:0/4086684996 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0110158a20 0x7f011015bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.809+0000 7f0117800640 1 --2- 172.21.15.2:0/4086684996 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f00ec065180 0x7f00ec067630 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.809+0000 7f0117800640 1 --2- 172.21.15.2:0/4086684996 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f01100ae860 0x7f011015b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.809+0000 7f0117800640 1 --2- 172.21.15.2:0/4086684996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f011006dee0 0x7f01100ca8e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.809+0000 7f0117800640 1 -- 172.21.15.2:0/4086684996 >> 172.21.15.2:0/4086684996 conn(0x7f0110066e60 msgr2=0x7f01100ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:20.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.809+0000 7f0117800640 1 -- 172.21.15.2:0/4086684996 shutdown_connections 2024-08-17T02:24:20.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.809+0000 7f0117800640 1 -- 172.21.15.2:0/4086684996 wait complete. 2024-08-17T02:24:20.825 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:24:20.825 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:24:20.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.979+0000 7fdcb3e00640 1 Processor -- start 2024-08-17T02:24:20.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.979+0000 7fdcb3e00640 1 -- start start 2024-08-17T02:24:20.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.980+0000 7fdcb3e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdcac1589a0 0x7fdcac0acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:20.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.980+0000 7fdcb3e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdcac0aef70 0x7fdcac158d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:20.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.980+0000 7fdcb3e00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fdcac159b40 0x7fdcac06e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:20.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.980+0000 7fdcb3e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcac0cd450 con 0x7fdcac0aef70 2024-08-17T02:24:20.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.980+0000 7fdcb3e00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcac0af3c0 con 0x7fdcac159b40 2024-08-17T02:24:20.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.980+0000 7fdcb3e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac0ad380 con 0x7fdcac1589a0 2024-08-17T02:24:20.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.981+0000 7fdcb0a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdcac0aef70 0x7fdcac158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:20.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.981+0000 7fdcb0a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdcac0aef70 0x7fdcac158d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46306/0 (socket says 172.21.15.2:46306) 2024-08-17T02:24:20.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.981+0000 7fdcb0a00640 1 -- 172.21.15.2:0/2768627785 learned_addr learned my addr 172.21.15.2:0/2768627785 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:20.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.981+0000 7fdcb1400640 1 --2- 172.21.15.2:0/2768627785 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdcac1589a0 0x7fdcac0acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:20.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.981+0000 7fdcb1e00640 1 --2- 172.21.15.2:0/2768627785 >> v2:172.21.15.145:3300/0 conn(0x7fdcac159b40 0x7fdcac06e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:20.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.981+0000 7fdcb0a00640 1 -- 172.21.15.2:0/2768627785 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdcac1589a0 msgr2=0x7fdcac0acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:20.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.981+0000 7fdcb0a00640 1 --2- 172.21.15.2:0/2768627785 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdcac1589a0 0x7fdcac0acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.981+0000 7fdcb0a00640 1 -- 172.21.15.2:0/2768627785 >> v2:172.21.15.145:3300/0 conn(0x7fdcac159b40 msgr2=0x7fdcac06e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:20.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.981+0000 7fdcb0a00640 1 --2- 172.21.15.2:0/2768627785 >> v2:172.21.15.145:3300/0 conn(0x7fdcac159b40 0x7fdcac06e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.981+0000 7fdcb0a00640 1 -- 172.21.15.2:0/2768627785 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac0ad660 con 0x7fdcac0aef70 2024-08-17T02:24:20.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.982+0000 7fdcb0a00640 1 --2- 172.21.15.2:0/2768627785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcac0aef70 0x7fdcac158d70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdcac069460 tx=0x7fdc980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df021b588a9de7f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:20.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.982+0000 7fdcabe00640 1 -- 172.21.15.2:0/2768627785 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9802add0 con 0x7fdcac0aef70 2024-08-17T02:24:20.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.982+0000 7fdcabe00640 1 -- 172.21.15.2:0/2768627785 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc98032440 con 0x7fdcac0aef70 2024-08-17T02:24:20.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.982+0000 7fdcabe00640 1 -- 172.21.15.2:0/2768627785 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98032820 con 0x7fdcac0aef70 2024-08-17T02:24:20.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.983+0000 7fdcb3e00640 1 -- 172.21.15.2:0/2768627785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcac0aef70 msgr2=0x7fdcac158d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:20.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.983+0000 7fdcb3e00640 1 --2- 172.21.15.2:0/2768627785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcac0aef70 0x7fdcac158d70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdcac069460 tx=0x7fdc980091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.983+0000 7fdcb3e00640 1 -- 172.21.15.2:0/2768627785 shutdown_connections 2024-08-17T02:24:20.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.983+0000 7fdcb3e00640 1 --2- 172.21.15.2:0/2768627785 >> v2:172.21.15.145:3300/0 conn(0x7fdcac159b40 0x7fdcac06e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.983+0000 7fdcb3e00640 1 --2- 172.21.15.2:0/2768627785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcac0aef70 0x7fdcac158d70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.983+0000 7fdcb3e00640 1 --2- 172.21.15.2:0/2768627785 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdcac1589a0 0x7fdcac0acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.983+0000 7fdcb3e00640 1 -- 172.21.15.2:0/2768627785 >> 172.21.15.2:0/2768627785 conn(0x7fdcac06c760 msgr2=0x7fdcac06cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:20.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.983+0000 7fdcb3e00640 1 -- 172.21.15.2:0/2768627785 shutdown_connections 2024-08-17T02:24:20.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.983+0000 7fdcb3e00640 1 -- 172.21.15.2:0/2768627785 wait complete. 2024-08-17T02:24:20.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.984+0000 7fdcb3e00640 1 Processor -- start 2024-08-17T02:24:20.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.985+0000 7fdcb3e00640 1 -- start start 2024-08-17T02:24:20.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.985+0000 7fdcb3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcac0aef70 0x7fdcac142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:20.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.985+0000 7fdcb3e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdcac1589a0 0x7fdcac1436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:20.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.985+0000 7fdcb3e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdcac159b40 0x7fdcac0c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:20.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.986+0000 7fdcb3e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac0c8940 con 0x7fdcac0aef70 2024-08-17T02:24:20.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.986+0000 7fdcb3e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac0c7d30 con 0x7fdcac159b40 2024-08-17T02:24:20.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.986+0000 7fdcb3e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac0c8010 con 0x7fdcac1589a0 2024-08-17T02:24:20.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.986+0000 7fdcb1400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcac0aef70 0x7fdcac142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:20.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.986+0000 7fdcb1400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcac0aef70 0x7fdcac142e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46318/0 (socket says 172.21.15.2:46318) 2024-08-17T02:24:20.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.986+0000 7fdcb1400640 1 -- 172.21.15.2:0/550250199 learned_addr learned my addr 172.21.15.2:0/550250199 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:20.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.986+0000 7fdcb1400640 1 -- 172.21.15.2:0/550250199 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdcac1589a0 msgr2=0x7fdcac1436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:20.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.986+0000 7fdcb1400640 1 --2- 172.21.15.2:0/550250199 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdcac1589a0 0x7fdcac1436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.986+0000 7fdcb1400640 1 -- 172.21.15.2:0/550250199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdcac159b40 msgr2=0x7fdcac0c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:20.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.986+0000 7fdcb1400640 1 --2- 172.21.15.2:0/550250199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdcac159b40 0x7fdcac0c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:20.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.986+0000 7fdcb1400640 1 -- 172.21.15.2:0/550250199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc98009450 con 0x7fdcac0aef70 2024-08-17T02:24:20.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.986+0000 7fdcb1400640 1 --2- 172.21.15.2:0/550250199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcac0aef70 0x7fdcac142e20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdca000e900 tx=0x7fdca00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:20.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.987+0000 7fdca8c00640 1 -- 172.21.15.2:0/550250199 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca000c8e0 con 0x7fdcac0aef70 2024-08-17T02:24:20.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.987+0000 7fdca8c00640 1 -- 172.21.15.2:0/550250199 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca000ca40 con 0x7fdcac0aef70 2024-08-17T02:24:20.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.987+0000 7fdca8c00640 1 -- 172.21.15.2:0/550250199 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca000cde0 con 0x7fdcac0aef70 2024-08-17T02:24:20.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.987+0000 7fdcb3e00640 1 -- 172.21.15.2:0/550250199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcac0c82f0 con 0x7fdcac0aef70 2024-08-17T02:24:20.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.987+0000 7fdcb3e00640 1 -- 172.21.15.2:0/550250199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcac143360 con 0x7fdcac0aef70 2024-08-17T02:24:20.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.988+0000 7fdcb3e00640 1 -- 172.21.15.2:0/550250199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcac063fb0 con 0x7fdcac0aef70 2024-08-17T02:24:20.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.989+0000 7fdca8c00640 1 -- 172.21.15.2:0/550250199 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdca0013680 con 0x7fdcac0aef70 2024-08-17T02:24:20.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.989+0000 7fdca8c00640 1 --2- 172.21.15.2:0/550250199 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fdc8c065180 0x7fdc8c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:20.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.989+0000 7fdca8c00640 1 -- 172.21.15.2:0/550250199 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fdca00822f0 con 0x7fdcac0aef70 2024-08-17T02:24:20.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.990+0000 7fdcb0a00640 1 --2- 172.21.15.2:0/550250199 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fdc8c065180 0x7fdc8c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:20.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.991+0000 7fdcb0a00640 1 --2- 172.21.15.2:0/550250199 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fdc8c065180 0x7fdc8c067630 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdc98034000 tx=0x7fdc98032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:20.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:20.993+0000 7fdca8c00640 1 -- 172.21.15.2:0/550250199 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdca0050660 con 0x7fdcac0aef70 2024-08-17T02:24:21.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.175+0000 7fdcb3e00640 1 -- 172.21.15.2:0/550250199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fdcac06cd10 con 0x7fdcac0aef70 2024-08-17T02:24:21.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.708+0000 7fdca8c00640 1 -- 172.21.15.2:0/550250199 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7fdca0053c80 con 0x7fdcac0aef70 2024-08-17T02:24:21.708 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2024-08-17T02:24:21.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.711+0000 7fdcb3e00640 1 -- 172.21.15.2:0/550250199 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fdc8c065180 msgr2=0x7fdc8c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:21.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.711+0000 7fdcb3e00640 1 --2- 172.21.15.2:0/550250199 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fdc8c065180 0x7fdc8c067630 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdc98034000 tx=0x7fdc98032000 comp rx=0 tx=0).stop 2024-08-17T02:24:21.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.711+0000 7fdcb3e00640 1 -- 172.21.15.2:0/550250199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcac0aef70 msgr2=0x7fdcac142e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:21.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.711+0000 7fdcb3e00640 1 --2- 172.21.15.2:0/550250199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcac0aef70 0x7fdcac142e20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdca000e900 tx=0x7fdca00090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.711+0000 7fdcb3e00640 1 -- 172.21.15.2:0/550250199 shutdown_connections 2024-08-17T02:24:21.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.711+0000 7fdcb3e00640 1 --2- 172.21.15.2:0/550250199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdcac159b40 0x7fdcac0c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.711+0000 7fdcb3e00640 1 --2- 172.21.15.2:0/550250199 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fdc8c065180 0x7fdc8c067630 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.711+0000 7fdcb3e00640 1 --2- 172.21.15.2:0/550250199 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdcac1589a0 0x7fdcac1436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.711+0000 7fdcb3e00640 1 --2- 172.21.15.2:0/550250199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcac0aef70 0x7fdcac142e20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.711+0000 7fdcb3e00640 1 -- 172.21.15.2:0/550250199 >> 172.21.15.2:0/550250199 conn(0x7fdcac06c760 msgr2=0x7fdcac0b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:21.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.712+0000 7fdcb3e00640 1 -- 172.21.15.2:0/550250199 shutdown_connections 2024-08-17T02:24:21.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.712+0000 7fdcb3e00640 1 -- 172.21.15.2:0/550250199 wait complete. 2024-08-17T02:24:21.733 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:24:21.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.893+0000 7f08cec00640 1 Processor -- start 2024-08-17T02:24:21.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.893+0000 7f08cec00640 1 -- start start 2024-08-17T02:24:21.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.895+0000 7f08cec00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f08c80cab00 0x7f08c8068310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:21.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.895+0000 7f08cec00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08c8069cd0 0x7f08c8068850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:21.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.895+0000 7f08cec00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c80cb360 con 0x7f08c80c2720 2024-08-17T02:24:21.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.895+0000 7f08cec00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c80ccde0 con 0x7f08c80cab00 2024-08-17T02:24:21.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.895+0000 7f08cec00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c80cd0c0 con 0x7f08c8069cd0 2024-08-17T02:24:21.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.895+0000 7f08ce200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08c8069cd0 0x7f08c8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:21.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.895+0000 7f08cce00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f08c80cab00 0x7f08c8068310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:21.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.895+0000 7f08ce200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08c8069cd0 0x7f08c8068850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:55064/0 (socket says 172.21.15.2:55064) 2024-08-17T02:24:21.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.895+0000 7f08ce200640 1 -- 172.21.15.2:0/291157744 learned_addr learned my addr 172.21.15.2:0/291157744 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:21.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.896+0000 7f08ce200640 1 -- 172.21.15.2:0/291157744 >> v2:172.21.15.145:3300/0 conn(0x7f08c80cab00 msgr2=0x7f08c8068310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:21.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.896+0000 7f08ce200640 1 --2- 172.21.15.2:0/291157744 >> v2:172.21.15.145:3300/0 conn(0x7f08c80cab00 0x7f08c8068310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.896+0000 7f08ce200640 1 -- 172.21.15.2:0/291157744 >> v1:172.21.15.145:6789/0 conn(0x7f08c80c2720 legacy=0x7f08c80c2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:21.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.896+0000 7f08ce200640 1 -- 172.21.15.2:0/291157744 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c80cd3a0 con 0x7f08c8069cd0 2024-08-17T02:24:21.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.897+0000 7f08ce200640 1 --2- 172.21.15.2:0/291157744 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08c8069cd0 0x7f08c8068850 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f08c0009f20 tx=0x7f08c0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16f55ebe3269bb2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:21.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.897+0000 7f08c7e00640 1 -- 172.21.15.2:0/291157744 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c0033410 con 0x7f08c8069cd0 2024-08-17T02:24:21.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.897+0000 7f08c7e00640 1 -- 172.21.15.2:0/291157744 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c0033570 con 0x7f08c8069cd0 2024-08-17T02:24:21.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.897+0000 7f08c7e00640 1 -- 172.21.15.2:0/291157744 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c0033950 con 0x7f08c8069cd0 2024-08-17T02:24:21.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.898+0000 7f08cec00640 1 -- 172.21.15.2:0/291157744 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08c8069cd0 msgr2=0x7f08c8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:21.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.898+0000 7f08cec00640 1 --2- 172.21.15.2:0/291157744 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08c8069cd0 0x7f08c8068850 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f08c0009f20 tx=0x7f08c0009840 comp rx=0 tx=0).stop 2024-08-17T02:24:21.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.898+0000 7f08cec00640 1 -- 172.21.15.2:0/291157744 shutdown_connections 2024-08-17T02:24:21.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.898+0000 7f08cec00640 1 --2- 172.21.15.2:0/291157744 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08c8069cd0 0x7f08c8068850 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.898+0000 7f08cec00640 1 --2- 172.21.15.2:0/291157744 >> v2:172.21.15.145:3300/0 conn(0x7f08c80cab00 0x7f08c8068310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.898+0000 7f08cec00640 1 -- 172.21.15.2:0/291157744 >> 172.21.15.2:0/291157744 conn(0x7f08c80ce400 msgr2=0x7f08c80ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:21.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.898+0000 7f08cec00640 1 -- 172.21.15.2:0/291157744 shutdown_connections 2024-08-17T02:24:21.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.898+0000 7f08cec00640 1 -- 172.21.15.2:0/291157744 wait complete. 2024-08-17T02:24:21.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.899+0000 7f08cec00640 1 Processor -- start 2024-08-17T02:24:21.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.899+0000 7f08cec00640 1 -- start start 2024-08-17T02:24:21.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.900+0000 7f08cec00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08c8069cd0 0x7f08c816cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:21.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.900+0000 7f08cec00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08c80c2720 0x7f08c8157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:21.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.900+0000 7f08cec00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08c80cab00 0x7f08c8157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:21.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.900+0000 7f08cec00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c8169990 con 0x7f08c8069cd0 2024-08-17T02:24:21.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.900+0000 7f08cec00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c8168df0 con 0x7f08c80c2720 2024-08-17T02:24:21.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.900+0000 7f08cec00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c8169060 con 0x7f08c80cab00 2024-08-17T02:24:21.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.900+0000 7f08cd800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08c8069cd0 0x7f08c816cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:21.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.900+0000 7f08cd800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08c8069cd0 0x7f08c816cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46332/0 (socket says 172.21.15.2:46332) 2024-08-17T02:24:21.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.900+0000 7f08cd800640 1 -- 172.21.15.2:0/1833756570 learned_addr learned my addr 172.21.15.2:0/1833756570 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:21.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.901+0000 7f08cce00640 1 --2- 172.21.15.2:0/1833756570 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08c80c2720 0x7f08c8157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:21.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.901+0000 7f08ce200640 1 --2- 172.21.15.2:0/1833756570 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08c80cab00 0x7f08c8157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:21.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.901+0000 7f08cd800640 1 -- 172.21.15.2:0/1833756570 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08c80cab00 msgr2=0x7f08c8157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:21.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.901+0000 7f08cd800640 1 --2- 172.21.15.2:0/1833756570 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08c80cab00 0x7f08c8157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.901+0000 7f08cd800640 1 -- 172.21.15.2:0/1833756570 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08c80c2720 msgr2=0x7f08c8157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:21.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.901+0000 7f08cd800640 1 --2- 172.21.15.2:0/1833756570 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08c80c2720 0x7f08c8157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.901+0000 7f08cd800640 1 -- 172.21.15.2:0/1833756570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c0009ae0 con 0x7f08c8069cd0 2024-08-17T02:24:21.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.901+0000 7f08cce00640 1 --2- 172.21.15.2:0/1833756570 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08c80c2720 0x7f08c8157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:21.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.901+0000 7f08cd800640 1 --2- 172.21.15.2:0/1833756570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08c8069cd0 0x7f08c816cd30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f08bc00c560 tx=0x7f08bc007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:21.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.901+0000 7f08c4c00640 1 -- 172.21.15.2:0/1833756570 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc011590 con 0x7f08c8069cd0 2024-08-17T02:24:21.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.901+0000 7f08cec00640 1 -- 172.21.15.2:0/1833756570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c8169340 con 0x7f08c8069cd0 2024-08-17T02:24:21.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.901+0000 7f08c4c00640 1 -- 172.21.15.2:0/1833756570 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08bc011710 con 0x7f08c8069cd0 2024-08-17T02:24:21.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.901+0000 7f08c4c00640 1 -- 172.21.15.2:0/1833756570 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc011ad0 con 0x7f08c8069cd0 2024-08-17T02:24:21.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.902+0000 7f08cec00640 1 -- 172.21.15.2:0/1833756570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c81559e0 con 0x7f08c8069cd0 2024-08-17T02:24:21.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.903+0000 7f08cec00640 1 -- 172.21.15.2:0/1833756570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c8070720 con 0x7f08c8069cd0 2024-08-17T02:24:21.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.904+0000 7f08c4c00640 1 -- 172.21.15.2:0/1833756570 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f08bc01b3b0 con 0x7f08c8069cd0 2024-08-17T02:24:21.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.905+0000 7f08c4c00640 1 --2- 172.21.15.2:0/1833756570 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f08a8065180 0x7f08a8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:21.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.905+0000 7f08c4c00640 1 -- 172.21.15.2:0/1833756570 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f08bc0818d0 con 0x7f08c8069cd0 2024-08-17T02:24:21.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.906+0000 7f08cce00640 1 --2- 172.21.15.2:0/1833756570 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f08a8065180 0x7f08a8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:21.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.907+0000 7f08cce00640 1 --2- 172.21.15.2:0/1833756570 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f08a8065180 0x7f08a8067630 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f08c8098c10 tx=0x7f08b4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:21.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:21.910+0000 7f08c4c00640 1 -- 172.21.15.2:0/1833756570 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f08bc04fad0 con 0x7f08c8069cd0 2024-08-17T02:24:22.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.094+0000 7f08cec00640 1 -- 172.21.15.2:0/1833756570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f08c806cd20 con 0x7f08c8069cd0 2024-08-17T02:24:22.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.715+0000 7f08c4c00640 1 -- 172.21.15.2:0/1833756570 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7f08bc017070 con 0x7f08c8069cd0 2024-08-17T02:24:22.716 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2024-08-17T02:24:22.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.722+0000 7f08cec00640 1 -- 172.21.15.2:0/1833756570 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f08a8065180 msgr2=0x7f08a8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.722+0000 7f08cec00640 1 --2- 172.21.15.2:0/1833756570 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f08a8065180 0x7f08a8067630 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f08c8098c10 tx=0x7f08b4008040 comp rx=0 tx=0).stop 2024-08-17T02:24:22.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.722+0000 7f08cec00640 1 -- 172.21.15.2:0/1833756570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08c8069cd0 msgr2=0x7f08c816cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.722+0000 7f08cec00640 1 --2- 172.21.15.2:0/1833756570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08c8069cd0 0x7f08c816cd30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f08bc00c560 tx=0x7f08bc007ef0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.722+0000 7f08cec00640 1 -- 172.21.15.2:0/1833756570 shutdown_connections 2024-08-17T02:24:22.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.722+0000 7f08cec00640 1 --2- 172.21.15.2:0/1833756570 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f08a8065180 0x7f08a8067630 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.722+0000 7f08cec00640 1 --2- 172.21.15.2:0/1833756570 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08c80cab00 0x7f08c8157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.722+0000 7f08cec00640 1 --2- 172.21.15.2:0/1833756570 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08c80c2720 0x7f08c8157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.722+0000 7f08cec00640 1 --2- 172.21.15.2:0/1833756570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08c8069cd0 0x7f08c816cd30 secure :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f08bc00c560 tx=0x7f08bc007ef0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.722+0000 7f08cec00640 1 -- 172.21.15.2:0/1833756570 >> 172.21.15.2:0/1833756570 conn(0x7f08c80ce400 msgr2=0x7f08c80c9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:22.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.723+0000 7f08cec00640 1 -- 172.21.15.2:0/1833756570 shutdown_connections 2024-08-17T02:24:22.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.724+0000 7f08cec00640 1 -- 172.21.15.2:0/1833756570 wait complete. 2024-08-17T02:24:22.753 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:24:22.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.911+0000 7fec07200640 1 Processor -- start 2024-08-17T02:24:22.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.911+0000 7fec07200640 1 -- start start 2024-08-17T02:24:22.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.912+0000 7fec07200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fec000ad960 0x7fec0015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.912+0000 7fec07200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fec000ca050 0x7fec00156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.912+0000 7fec07200640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec0015b5e0 con 0x7fec000add30 2024-08-17T02:24:22.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.912+0000 7fec07200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec000cb160 con 0x7fec000ca050 2024-08-17T02:24:22.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.912+0000 7fec07200640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec000b0d10 con 0x7fec000ad960 2024-08-17T02:24:22.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.913+0000 7febff400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fec000ca050 0x7fec00156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.913+0000 7febff400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fec000ca050 0x7fec00156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46348/0 (socket says 172.21.15.2:46348) 2024-08-17T02:24:22.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.913+0000 7febff400640 1 -- 172.21.15.2:0/4110922256 learned_addr learned my addr 172.21.15.2:0/4110922256 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:22.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.913+0000 7febffe00640 1 --2- 172.21.15.2:0/4110922256 >> v2:172.21.15.145:3300/0 conn(0x7fec000ad960 0x7fec0015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.913+0000 7febff400640 1 -- 172.21.15.2:0/4110922256 >> v2:172.21.15.145:3300/0 conn(0x7fec000ad960 msgr2=0x7fec0015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:22.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.913+0000 7febff400640 1 --2- 172.21.15.2:0/4110922256 >> v2:172.21.15.145:3300/0 conn(0x7fec000ad960 0x7fec0015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.913+0000 7febff400640 1 -- 172.21.15.2:0/4110922256 >> v1:172.21.15.145:6789/0 conn(0x7fec000add30 legacy=0x7fec00156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:22.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.913+0000 7febff400640 1 -- 172.21.15.2:0/4110922256 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec000ca550 con 0x7fec000ca050 2024-08-17T02:24:22.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.914+0000 7febff400640 1 --2- 172.21.15.2:0/4110922256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec000ca050 0x7fec00156420 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fec000cc910 tx=0x7febec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27eeab4faca7dfbd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:22.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.914+0000 7febfea00640 1 -- 172.21.15.2:0/4110922256 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec02ae60 con 0x7fec000ca050 2024-08-17T02:24:22.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.914+0000 7febfea00640 1 -- 172.21.15.2:0/4110922256 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec032440 con 0x7fec000ca050 2024-08-17T02:24:22.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.914+0000 7febfea00640 1 -- 172.21.15.2:0/4110922256 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec0327e0 con 0x7fec000ca050 2024-08-17T02:24:22.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.915+0000 7fec07200640 1 -- 172.21.15.2:0/4110922256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec000ca050 msgr2=0x7fec00156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.915+0000 7fec07200640 1 --2- 172.21.15.2:0/4110922256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec000ca050 0x7fec00156420 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fec000cc910 tx=0x7febec0091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.915+0000 7fec07200640 1 -- 172.21.15.2:0/4110922256 shutdown_connections 2024-08-17T02:24:22.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.915+0000 7fec07200640 1 --2- 172.21.15.2:0/4110922256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec000ca050 0x7fec00156420 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.915+0000 7fec07200640 1 --2- 172.21.15.2:0/4110922256 >> v2:172.21.15.145:3300/0 conn(0x7fec000ad960 0x7fec0015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.915+0000 7fec07200640 1 -- 172.21.15.2:0/4110922256 >> 172.21.15.2:0/4110922256 conn(0x7fec00066e60 msgr2=0x7fec00067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:22.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.915+0000 7fec07200640 1 -- 172.21.15.2:0/4110922256 shutdown_connections 2024-08-17T02:24:22.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.915+0000 7fec07200640 1 -- 172.21.15.2:0/4110922256 wait complete. 2024-08-17T02:24:22.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.916+0000 7fec07200640 1 Processor -- start 2024-08-17T02:24:22.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.917+0000 7fec07200640 1 -- start start 2024-08-17T02:24:22.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.917+0000 7fec07200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec000ad960 0x7fec00159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.917+0000 7fec07200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec000add30 0x7fec001673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.917+0000 7fec07200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec000ca050 0x7fec00168590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.917+0000 7fec07200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0016a7f0 con 0x7fec000ad960 2024-08-17T02:24:22.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.917+0000 7fec07200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec000a5b60 con 0x7fec000add30 2024-08-17T02:24:22.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.917+0000 7fec07200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec00168360 con 0x7fec000ca050 2024-08-17T02:24:22.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.918+0000 7febffe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec000ad960 0x7fec00159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.918+0000 7febffe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec000ad960 0x7fec00159890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46354/0 (socket says 172.21.15.2:46354) 2024-08-17T02:24:22.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.918+0000 7febffe00640 1 -- 172.21.15.2:0/1189305944 learned_addr learned my addr 172.21.15.2:0/1189305944 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:22.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.918+0000 7febff400640 1 --2- 172.21.15.2:0/1189305944 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec000add30 0x7fec001673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.918+0000 7fec05200640 1 --2- 172.21.15.2:0/1189305944 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec000ca050 0x7fec00168590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.918+0000 7febffe00640 1 -- 172.21.15.2:0/1189305944 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec000ca050 msgr2=0x7fec00168590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.918+0000 7febffe00640 1 --2- 172.21.15.2:0/1189305944 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec000ca050 0x7fec00168590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.918+0000 7febffe00640 1 -- 172.21.15.2:0/1189305944 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec000add30 msgr2=0x7fec001673c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.918+0000 7febffe00640 1 --2- 172.21.15.2:0/1189305944 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec000add30 0x7fec001673c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.918+0000 7febffe00640 1 -- 172.21.15.2:0/1189305944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec009450 con 0x7fec000ad960 2024-08-17T02:24:22.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.918+0000 7febffe00640 1 --2- 172.21.15.2:0/1189305944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec000ad960 0x7fec00159890 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7febf000d8c0 tx=0x7febf0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:22.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.919+0000 7febf7400640 1 -- 172.21.15.2:0/1189305944 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf000de50 con 0x7fec000ad960 2024-08-17T02:24:22.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.919+0000 7febf7400640 1 -- 172.21.15.2:0/1189305944 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf00098b0 con 0x7fec000ad960 2024-08-17T02:24:22.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.919+0000 7febf7400640 1 -- 172.21.15.2:0/1189305944 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf0009c50 con 0x7fec000ad960 2024-08-17T02:24:22.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.919+0000 7fec07200640 1 -- 172.21.15.2:0/1189305944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec000a4690 con 0x7fec000ad960 2024-08-17T02:24:22.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.919+0000 7fec07200640 1 -- 172.21.15.2:0/1189305944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec00167da0 con 0x7fec000ad960 2024-08-17T02:24:22.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.920+0000 7fec07200640 1 -- 172.21.15.2:0/1189305944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec00063fb0 con 0x7fec000ad960 2024-08-17T02:24:22.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.921+0000 7febf7400640 1 -- 172.21.15.2:0/1189305944 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7febf0014620 con 0x7fec000ad960 2024-08-17T02:24:22.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.922+0000 7febf7400640 1 --2- 172.21.15.2:0/1189305944 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7febe0065150 0x7febe0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.922+0000 7febf7400640 1 -- 172.21.15.2:0/1189305944 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5605+0+0 (secure 0 0 0) 0x7febf0082b50 con 0x7fec000ad960 2024-08-17T02:24:22.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.922+0000 7febff400640 1 --2- 172.21.15.2:0/1189305944 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7febe0065150 0x7febe0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.923+0000 7febff400640 1 --2- 172.21.15.2:0/1189305944 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7febe0065150 0x7febe0067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7febec034000 tx=0x7febec032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:22.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:22.927+0000 7febf7400640 1 -- 172.21.15.2:0/1189305944 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7febf0050c80 con 0x7fec000ad960 2024-08-17T02:24:23.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.150+0000 7fec07200640 1 -- 172.21.15.2:0/1189305944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fec00152840 con 0x7fec000ad960 2024-08-17T02:24:23.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.719+0000 7febf7400640 1 -- 172.21.15.2:0/1189305944 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7febf00542a0 con 0x7fec000ad960 2024-08-17T02:24:23.720 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 4 and data pool 5 2024-08-17T02:24:23.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.724+0000 7fec07200640 1 -- 172.21.15.2:0/1189305944 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7febe0065150 msgr2=0x7febe0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.724+0000 7fec07200640 1 --2- 172.21.15.2:0/1189305944 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7febe0065150 0x7febe0067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7febec034000 tx=0x7febec032000 comp rx=0 tx=0).stop 2024-08-17T02:24:23.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.724+0000 7fec07200640 1 -- 172.21.15.2:0/1189305944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec000ad960 msgr2=0x7fec00159890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.724+0000 7fec07200640 1 --2- 172.21.15.2:0/1189305944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec000ad960 0x7fec00159890 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7febf000d8c0 tx=0x7febf0008040 comp rx=0 tx=0).stop 2024-08-17T02:24:23.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.727+0000 7fec07200640 1 -- 172.21.15.2:0/1189305944 shutdown_connections 2024-08-17T02:24:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.727+0000 7fec07200640 1 --2- 172.21.15.2:0/1189305944 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7febe0065150 0x7febe0067600 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.727+0000 7fec07200640 1 --2- 172.21.15.2:0/1189305944 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec000ca050 0x7fec00168590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.727+0000 7fec07200640 1 --2- 172.21.15.2:0/1189305944 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec000add30 0x7fec001673c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.727+0000 7fec07200640 1 --2- 172.21.15.2:0/1189305944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec000ad960 0x7fec00159890 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.728+0000 7fec07200640 1 -- 172.21.15.2:0/1189305944 >> 172.21.15.2:0/1189305944 conn(0x7fec00066e60 msgr2=0x7fec00153360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.728+0000 7fec07200640 1 -- 172.21.15.2:0/1189305944 shutdown_connections 2024-08-17T02:24:23.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.728+0000 7fec07200640 1 -- 172.21.15.2:0/1189305944 wait complete. 2024-08-17T02:24:23.768 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:23.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.922+0000 7f97cc000640 1 Processor -- start 2024-08-17T02:24:23.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.922+0000 7f97cc000640 1 -- start start 2024-08-17T02:24:23.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.923+0000 7f97cc000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f97c40ae860 0x7f97c406d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.923+0000 7f97cc000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f97c4158df0 0x7f97c406dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.923+0000 7f97cc000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c40aed90 con 0x7f97c4158a20 2024-08-17T02:24:23.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.923+0000 7f97cc000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c40af070 con 0x7f97c40ae860 2024-08-17T02:24:23.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.923+0000 7f97cc000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c40af350 con 0x7f97c4158df0 2024-08-17T02:24:23.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.923+0000 7f97c8c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f97c40ae860 0x7f97c406d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.924+0000 7f97c8c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f97c40ae860 0x7f97c406d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46356/0 (socket says 172.21.15.2:46356) 2024-08-17T02:24:23.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.924+0000 7f97c8c00640 1 -- 172.21.15.2:0/636545672 learned_addr learned my addr 172.21.15.2:0/636545672 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:23.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.924+0000 7f97c9600640 1 --1- 172.21.15.2:0/636545672 >> v1:172.21.15.2:6789/0 conn(0x7f97c4158a20 0x7f97c40a89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38508/0 (socket says 172.21.15.2:38508) 2024-08-17T02:24:23.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.924+0000 7f97ca000640 1 --2- 172.21.15.2:0/636545672 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f97c4158df0 0x7f97c406dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.924+0000 7f97c8c00640 1 -- 172.21.15.2:0/636545672 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f97c4158df0 msgr2=0x7f97c406dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:23.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.924+0000 7f97c8c00640 1 --2- 172.21.15.2:0/636545672 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f97c4158df0 0x7f97c406dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.924+0000 7f97c8c00640 1 -- 172.21.15.2:0/636545672 >> v1:172.21.15.2:6789/0 conn(0x7f97c4158a20 legacy=0x7f97c40a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.924+0000 7f97c8c00640 1 -- 172.21.15.2:0/636545672 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c40af630 con 0x7f97c40ae860 2024-08-17T02:24:23.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.924+0000 7f97c3e00640 1 -- 172.21.15.2:0/636545672 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413439090 0 0) 0x7f97c40aed90 con 0x7f97c4158a20 2024-08-17T02:24:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.925+0000 7f97c8c00640 1 --2- 172.21.15.2:0/636545672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97c40ae860 0x7f97c406d7d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f97b0009910 tx=0x7f97b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63764bc2492ae27 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.925+0000 7f97c3e00640 1 -- 172.21.15.2:0/636545672 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b002ae40 con 0x7f97c40ae860 2024-08-17T02:24:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.925+0000 7f97c3e00640 1 -- 172.21.15.2:0/636545672 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b0032440 con 0x7f97c40ae860 2024-08-17T02:24:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.925+0000 7f97c3e00640 1 -- 172.21.15.2:0/636545672 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b00327e0 con 0x7f97c40ae860 2024-08-17T02:24:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.926+0000 7f97cc000640 1 -- 172.21.15.2:0/636545672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97c40ae860 msgr2=0x7f97c406d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.926+0000 7f97cc000640 1 --2- 172.21.15.2:0/636545672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97c40ae860 0x7f97c406d7d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f97b0009910 tx=0x7f97b00091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.926+0000 7f97cc000640 1 -- 172.21.15.2:0/636545672 shutdown_connections 2024-08-17T02:24:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.926+0000 7f97cc000640 1 --2- 172.21.15.2:0/636545672 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f97c4158df0 0x7f97c406dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.926+0000 7f97cc000640 1 --2- 172.21.15.2:0/636545672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97c40ae860 0x7f97c406d7d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.926+0000 7f97cc000640 1 -- 172.21.15.2:0/636545672 >> 172.21.15.2:0/636545672 conn(0x7f97c4066e60 msgr2=0x7f97c4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:23.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.926+0000 7f97cc000640 1 -- 172.21.15.2:0/636545672 shutdown_connections 2024-08-17T02:24:23.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.926+0000 7f97cc000640 1 -- 172.21.15.2:0/636545672 wait complete. 2024-08-17T02:24:23.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.927+0000 7f97cc000640 1 Processor -- start 2024-08-17T02:24:23.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.928+0000 7f97cc000640 1 -- start start 2024-08-17T02:24:23.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.928+0000 7f97cc000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97c40ae860 0x7f97c41693c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.928+0000 7f97cc000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f97c4158a20 0x7f97c413d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.929+0000 7f97cc000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f97c4158df0 0x7f97c4157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.929+0000 7f97cc000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c4152140 con 0x7f97c40ae860 2024-08-17T02:24:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.929+0000 7f97cc000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c4151810 con 0x7f97c4158a20 2024-08-17T02:24:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.929+0000 7f97cc000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c4151af0 con 0x7f97c4158df0 2024-08-17T02:24:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.929+0000 7f97c9600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97c40ae860 0x7f97c41693c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.929+0000 7f97c9600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97c40ae860 0x7f97c41693c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46358/0 (socket says 172.21.15.2:46358) 2024-08-17T02:24:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.929+0000 7f97c9600640 1 -- 172.21.15.2:0/679888974 learned_addr learned my addr 172.21.15.2:0/679888974 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.929+0000 7f97c9600640 1 -- 172.21.15.2:0/679888974 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f97c4158df0 msgr2=0x7f97c4157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.929+0000 7f97c9600640 1 --2- 172.21.15.2:0/679888974 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f97c4158df0 0x7f97c4157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.929+0000 7f97c9600640 1 -- 172.21.15.2:0/679888974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f97c4158a20 msgr2=0x7f97c413d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.929+0000 7f97c9600640 1 --2- 172.21.15.2:0/679888974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f97c4158a20 0x7f97c413d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.929+0000 7f97c9600640 1 -- 172.21.15.2:0/679888974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b0009450 con 0x7f97c40ae860 2024-08-17T02:24:23.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.929+0000 7f97c9600640 1 --2- 172.21.15.2:0/679888974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97c40ae860 0x7f97c41693c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f97b800c5d0 tx=0x7f97b8007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:23.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.930+0000 7f97c0c00640 1 -- 172.21.15.2:0/679888974 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b80073d0 con 0x7f97c40ae860 2024-08-17T02:24:23.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.930+0000 7f97c0c00640 1 -- 172.21.15.2:0/679888974 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b8007550 con 0x7f97c40ae860 2024-08-17T02:24:23.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.930+0000 7f97cc000640 1 -- 172.21.15.2:0/679888974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c4151dd0 con 0x7f97c40ae860 2024-08-17T02:24:23.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.930+0000 7f97c0c00640 1 -- 172.21.15.2:0/679888974 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b80049f0 con 0x7f97c40ae860 2024-08-17T02:24:23.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.930+0000 7f97cc000640 1 -- 172.21.15.2:0/679888974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c4169900 con 0x7f97c40ae860 2024-08-17T02:24:23.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.931+0000 7f97cc000640 1 -- 172.21.15.2:0/679888974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c4063fb0 con 0x7f97c40ae860 2024-08-17T02:24:23.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.932+0000 7f97c0c00640 1 -- 172.21.15.2:0/679888974 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f97b801c3b0 con 0x7f97c40ae860 2024-08-17T02:24:23.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.933+0000 7f97c0c00640 1 --2- 172.21.15.2:0/679888974 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f97a4065180 0x7f97a4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.933+0000 7f97c0c00640 1 -- 172.21.15.2:0/679888974 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f97b8081970 con 0x7f97c40ae860 2024-08-17T02:24:23.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.933+0000 7f97c8c00640 1 --2- 172.21.15.2:0/679888974 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f97a4065180 0x7f97a4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.934+0000 7f97c8c00640 1 --2- 172.21.15.2:0/679888974 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f97a4065180 0x7f97a4067630 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f97b0034000 tx=0x7f97b0032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:23.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:23.936+0000 7f97c0c00640 1 -- 172.21.15.2:0/679888974 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f97b804fad0 con 0x7f97c40ae860 2024-08-17T02:24:24.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.121+0000 7f97cc000640 1 -- 172.21.15.2:0/679888974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97c406e4c0 con 0x7f97c40ae860 2024-08-17T02:24:24.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.122+0000 7f97c0c00640 1 -- 172.21.15.2:0/679888974 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f97b80530f0 con 0x7f97c40ae860 2024-08-17T02:24:24.122 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:24:24.122 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":31,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:24:23.150873+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:21.215146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:22.134466+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:24.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.123+0000 7f97cc000640 1 -- 172.21.15.2:0/679888974 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f97a4065180 msgr2=0x7f97a4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:24.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.123+0000 7f97cc000640 1 --2- 172.21.15.2:0/679888974 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f97a4065180 0x7f97a4067630 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f97b0034000 tx=0x7f97b0032000 comp rx=0 tx=0).stop 2024-08-17T02:24:24.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.123+0000 7f97cc000640 1 -- 172.21.15.2:0/679888974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97c40ae860 msgr2=0x7f97c41693c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:24.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.123+0000 7f97cc000640 1 --2- 172.21.15.2:0/679888974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97c40ae860 0x7f97c41693c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f97b800c5d0 tx=0x7f97b8007d80 comp rx=0 tx=0).stop 2024-08-17T02:24:24.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.124+0000 7f97cc000640 1 -- 172.21.15.2:0/679888974 shutdown_connections 2024-08-17T02:24:24.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.124+0000 7f97cc000640 1 --2- 172.21.15.2:0/679888974 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f97a4065180 0x7f97a4067630 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.124+0000 7f97cc000640 1 --2- 172.21.15.2:0/679888974 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f97c4158df0 0x7f97c4157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.124+0000 7f97cc000640 1 --2- 172.21.15.2:0/679888974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f97c4158a20 0x7f97c413d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.124+0000 7f97cc000640 1 --2- 172.21.15.2:0/679888974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97c40ae860 0x7f97c41693c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.124+0000 7f97cc000640 1 -- 172.21.15.2:0/679888974 >> 172.21.15.2:0/679888974 conn(0x7f97c4066e60 msgr2=0x7f97c406d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:24.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.124+0000 7f97cc000640 1 -- 172.21.15.2:0/679888974 shutdown_connections 2024-08-17T02:24:24.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.124+0000 7f97cc000640 1 -- 172.21.15.2:0/679888974 wait complete. 2024-08-17T02:24:24.139 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:24.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.290+0000 7fd157c00640 1 Processor -- start 2024-08-17T02:24:24.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.290+0000 7fd157c00640 1 -- start start 2024-08-17T02:24:24.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.291+0000 7fd157c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd15006e060 0x7fd15006e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:24.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.291+0000 7fd157c00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd1500af340 0x7fd1500af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:24.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.291+0000 7fd157c00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1500aeeb0 con 0x7fd150155040 2024-08-17T02:24:24.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.291+0000 7fd157c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd15006e9f0 con 0x7fd15006e060 2024-08-17T02:24:24.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.291+0000 7fd157c00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1500aadd0 con 0x7fd1500af340 2024-08-17T02:24:24.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.292+0000 7fd14fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd15006e060 0x7fd15006e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:24.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.292+0000 7fd14fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd15006e060 0x7fd15006e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46364/0 (socket says 172.21.15.2:46364) 2024-08-17T02:24:24.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.292+0000 7fd14fe00640 1 -- 172.21.15.2:0/2465649148 learned_addr learned my addr 172.21.15.2:0/2465649148 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:24.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.292+0000 7fd155c00640 1 --2- 172.21.15.2:0/2465649148 >> v2:172.21.15.145:3300/0 conn(0x7fd1500af340 0x7fd1500af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:24.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.292+0000 7fd14fe00640 1 -- 172.21.15.2:0/2465649148 >> v2:172.21.15.145:3300/0 conn(0x7fd1500af340 msgr2=0x7fd1500af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:24.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.292+0000 7fd14fe00640 1 --2- 172.21.15.2:0/2465649148 >> v2:172.21.15.145:3300/0 conn(0x7fd1500af340 0x7fd1500af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.292+0000 7fd14fe00640 1 -- 172.21.15.2:0/2465649148 >> v1:172.21.15.145:6789/0 conn(0x7fd150155040 legacy=0x7fd150158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:24.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.292+0000 7fd14fe00640 1 -- 172.21.15.2:0/2465649148 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1501597f0 con 0x7fd15006e060 2024-08-17T02:24:24.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.293+0000 7fd14fe00640 1 --2- 172.21.15.2:0/2465649148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd15006e060 0x7fd15006e4b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd1500ad790 tx=0x7fd13c00b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ca8b389fcaccc4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:24.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.293+0000 7fd14f400640 1 -- 172.21.15.2:0/2465649148 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c032550 con 0x7fd15006e060 2024-08-17T02:24:24.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.293+0000 7fd14f400640 1 -- 172.21.15.2:0/2465649148 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13c0326b0 con 0x7fd15006e060 2024-08-17T02:24:24.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.293+0000 7fd14f400640 1 -- 172.21.15.2:0/2465649148 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c032a50 con 0x7fd15006e060 2024-08-17T02:24:24.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.294+0000 7fd157c00640 1 -- 172.21.15.2:0/2465649148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd15006e060 msgr2=0x7fd15006e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:24.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.294+0000 7fd157c00640 1 --2- 172.21.15.2:0/2465649148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd15006e060 0x7fd15006e4b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd1500ad790 tx=0x7fd13c00b460 comp rx=0 tx=0).stop 2024-08-17T02:24:24.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.294+0000 7fd157c00640 1 -- 172.21.15.2:0/2465649148 shutdown_connections 2024-08-17T02:24:24.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.294+0000 7fd157c00640 1 --2- 172.21.15.2:0/2465649148 >> v2:172.21.15.145:3300/0 conn(0x7fd1500af340 0x7fd1500af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.294+0000 7fd157c00640 1 --2- 172.21.15.2:0/2465649148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd15006e060 0x7fd15006e4b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.294+0000 7fd157c00640 1 -- 172.21.15.2:0/2465649148 >> 172.21.15.2:0/2465649148 conn(0x7fd150066e60 msgr2=0x7fd150067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:24.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.294+0000 7fd157c00640 1 -- 172.21.15.2:0/2465649148 shutdown_connections 2024-08-17T02:24:24.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.294+0000 7fd157c00640 1 -- 172.21.15.2:0/2465649148 wait complete. 2024-08-17T02:24:24.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.295+0000 7fd157c00640 1 Processor -- start 2024-08-17T02:24:24.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.296+0000 7fd157c00640 1 -- start start 2024-08-17T02:24:24.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.296+0000 7fd157c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd15006e060 0x7fd150156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:24.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.296+0000 7fd157c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd1500af340 0x7fd1501567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:24.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.296+0000 7fd157c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd150155040 0x7fd150158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:24.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.296+0000 7fd157c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd150156d20 con 0x7fd15006e060 2024-08-17T02:24:24.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.296+0000 7fd157c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd150157b60 con 0x7fd150155040 2024-08-17T02:24:24.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.296+0000 7fd157c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd150156f50 con 0x7fd1500af340 2024-08-17T02:24:24.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.297+0000 7fd155200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd15006e060 0x7fd150156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:24.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.297+0000 7fd155200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd15006e060 0x7fd150156080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46366/0 (socket says 172.21.15.2:46366) 2024-08-17T02:24:24.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.297+0000 7fd155200640 1 -- 172.21.15.2:0/3607678885 learned_addr learned my addr 172.21.15.2:0/3607678885 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:24.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.297+0000 7fd155c00640 1 --2- 172.21.15.2:0/3607678885 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd150155040 0x7fd150158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:24.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.297+0000 7fd14fe00640 1 --2- 172.21.15.2:0/3607678885 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd1500af340 0x7fd1501567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:24.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.297+0000 7fd155200640 1 -- 172.21.15.2:0/3607678885 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd1500af340 msgr2=0x7fd1501567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:24.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.297+0000 7fd155200640 1 --2- 172.21.15.2:0/3607678885 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd1500af340 0x7fd1501567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.297+0000 7fd155200640 1 -- 172.21.15.2:0/3607678885 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd150155040 msgr2=0x7fd150158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:24.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.297+0000 7fd155200640 1 --2- 172.21.15.2:0/3607678885 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd150155040 0x7fd150158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.297+0000 7fd155200640 1 -- 172.21.15.2:0/3607678885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13c00b700 con 0x7fd15006e060 2024-08-17T02:24:24.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.297+0000 7fd155200640 1 --2- 172.21.15.2:0/3607678885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd15006e060 0x7fd150156080 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd14400b4f0 tx=0x7fd1440090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:24.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.298+0000 7fd143e00640 1 -- 172.21.15.2:0/3607678885 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14400f510 con 0x7fd15006e060 2024-08-17T02:24:24.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.298+0000 7fd143e00640 1 -- 172.21.15.2:0/3607678885 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14400f670 con 0x7fd15006e060 2024-08-17T02:24:24.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.298+0000 7fd143e00640 1 -- 172.21.15.2:0/3607678885 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14400fa70 con 0x7fd15006e060 2024-08-17T02:24:24.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.298+0000 7fd157c00640 1 -- 172.21.15.2:0/3607678885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd150157230 con 0x7fd15006e060 2024-08-17T02:24:24.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.298+0000 7fd157c00640 1 -- 172.21.15.2:0/3607678885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1501577f0 con 0x7fd15006e060 2024-08-17T02:24:24.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.299+0000 7fd157c00640 1 -- 172.21.15.2:0/3607678885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd150063fb0 con 0x7fd15006e060 2024-08-17T02:24:24.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.299+0000 7fd143e00640 1 -- 172.21.15.2:0/3607678885 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd14401a400 con 0x7fd15006e060 2024-08-17T02:24:24.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.300+0000 7fd143e00640 1 --2- 172.21.15.2:0/3607678885 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd130065150 0x7fd130067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:24.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.300+0000 7fd143e00640 1 -- 172.21.15.2:0/3607678885 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd144081fd0 con 0x7fd15006e060 2024-08-17T02:24:24.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.301+0000 7fd14fe00640 1 --2- 172.21.15.2:0/3607678885 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd130065150 0x7fd130067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:24.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.301+0000 7fd14fe00640 1 --2- 172.21.15.2:0/3607678885 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd130065150 0x7fd130067600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd13c037000 tx=0x7fd13c03a000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:24.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.304+0000 7fd143e00640 1 -- 172.21.15.2:0/3607678885 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd144050070 con 0x7fd15006e060 2024-08-17T02:24:24.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.487+0000 7fd157c00640 1 -- 172.21.15.2:0/3607678885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd150159310 con 0x7fd15006e060 2024-08-17T02:24:24.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.488+0000 7fd143e00640 1 -- 172.21.15.2:0/3607678885 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15315 (secure 0 0 0) 0x7fd144053690 con 0x7fd15006e060 2024-08-17T02:24:24.488 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:24:24.488 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":31,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:24:23.150873+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:21.215146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:22.134466+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:24.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.490+0000 7fd157c00640 1 -- 172.21.15.2:0/3607678885 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd130065150 msgr2=0x7fd130067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:24.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.490+0000 7fd157c00640 1 --2- 172.21.15.2:0/3607678885 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd130065150 0x7fd130067600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd13c037000 tx=0x7fd13c03a000 comp rx=0 tx=0).stop 2024-08-17T02:24:24.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.490+0000 7fd157c00640 1 -- 172.21.15.2:0/3607678885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd15006e060 msgr2=0x7fd150156080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:24.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.490+0000 7fd157c00640 1 --2- 172.21.15.2:0/3607678885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd15006e060 0x7fd150156080 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd14400b4f0 tx=0x7fd1440090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.490+0000 7fd157c00640 1 -- 172.21.15.2:0/3607678885 shutdown_connections 2024-08-17T02:24:24.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.490+0000 7fd157c00640 1 --2- 172.21.15.2:0/3607678885 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd150155040 0x7fd150158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.490+0000 7fd157c00640 1 --2- 172.21.15.2:0/3607678885 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd130065150 0x7fd130067600 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.490+0000 7fd157c00640 1 --2- 172.21.15.2:0/3607678885 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd1500af340 0x7fd1501567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.490+0000 7fd157c00640 1 --2- 172.21.15.2:0/3607678885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd15006e060 0x7fd150156080 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.490+0000 7fd157c00640 1 -- 172.21.15.2:0/3607678885 >> 172.21.15.2:0/3607678885 conn(0x7fd150066e60 msgr2=0x7fd1501521a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:24.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.490+0000 7fd157c00640 1 -- 172.21.15.2:0/3607678885 shutdown_connections 2024-08-17T02:24:24.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.490+0000 7fd157c00640 1 -- 172.21.15.2:0/3607678885 wait complete. 2024-08-17T02:24:24.506 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:24:24.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.660+0000 7f5104c00640 1 Processor -- start 2024-08-17T02:24:24.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.660+0000 7f5104c00640 1 -- start start 2024-08-17T02:24:24.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.662+0000 7f5104c00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f51000ad960 0x7f510015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:24.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.662+0000 7f5104c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51000add30 0x7f5100156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:24.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.662+0000 7f5104c00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f510015b5e0 con 0x7f51000ca050 2024-08-17T02:24:24.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.662+0000 7f5104c00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51000cb160 con 0x7f51000ad960 2024-08-17T02:24:24.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.662+0000 7f5104c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51000b0d10 con 0x7f51000add30 2024-08-17T02:24:24.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.662+0000 7f50fe800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51000add30 0x7f5100156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:24.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.662+0000 7f50fde00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f51000ad960 0x7f510015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:24.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.662+0000 7f50fde00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f51000ad960 0x7f510015b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:49038/0 (socket says 172.21.15.2:49038) 2024-08-17T02:24:24.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.662+0000 7f50fde00640 1 -- 172.21.15.2:0/2807549438 learned_addr learned my addr 172.21.15.2:0/2807549438 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:24.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.663+0000 7f50fe800640 1 -- 172.21.15.2:0/2807549438 >> v2:172.21.15.145:3300/0 conn(0x7f51000ad960 msgr2=0x7f510015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:24.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.663+0000 7f50fe800640 1 --2- 172.21.15.2:0/2807549438 >> v2:172.21.15.145:3300/0 conn(0x7f51000ad960 0x7f510015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.663+0000 7f50fe800640 1 -- 172.21.15.2:0/2807549438 >> v1:172.21.15.145:6789/0 conn(0x7f51000ca050 legacy=0x7f5100156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:24.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.663+0000 7f50fe800640 1 -- 172.21.15.2:0/2807549438 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51000ca550 con 0x7f51000add30 2024-08-17T02:24:24.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.663+0000 7f50fde00640 1 --2- 172.21.15.2:0/2807549438 >> v2:172.21.15.145:3300/0 conn(0x7f51000ad960 0x7f510015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:24.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.664+0000 7f50fe800640 1 --2- 172.21.15.2:0/2807549438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51000add30 0x7f5100156b30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009e60 tx=0x7f50f8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=455eeae09fa21426 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:24.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.664+0000 7f50fca00640 1 -- 172.21.15.2:0/2807549438 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f8007550 con 0x7f51000add30 2024-08-17T02:24:24.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.664+0000 7f50fca00640 1 -- 172.21.15.2:0/2807549438 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f802d050 con 0x7f51000add30 2024-08-17T02:24:24.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.664+0000 7f50fca00640 1 -- 172.21.15.2:0/2807549438 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f8007900 con 0x7f51000add30 2024-08-17T02:24:24.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.665+0000 7f5104c00640 1 -- 172.21.15.2:0/2807549438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51000add30 msgr2=0x7f5100156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:24.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.665+0000 7f5104c00640 1 --2- 172.21.15.2:0/2807549438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51000add30 0x7f5100156b30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009e60 tx=0x7f50f8009780 comp rx=0 tx=0).stop 2024-08-17T02:24:24.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.665+0000 7f5104c00640 1 -- 172.21.15.2:0/2807549438 shutdown_connections 2024-08-17T02:24:24.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.665+0000 7f5104c00640 1 --2- 172.21.15.2:0/2807549438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51000add30 0x7f5100156b30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.665+0000 7f5104c00640 1 --2- 172.21.15.2:0/2807549438 >> v2:172.21.15.145:3300/0 conn(0x7f51000ad960 0x7f510015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.665+0000 7f5104c00640 1 -- 172.21.15.2:0/2807549438 >> 172.21.15.2:0/2807549438 conn(0x7f5100066e60 msgr2=0x7f5100067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:24.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.665+0000 7f5104c00640 1 -- 172.21.15.2:0/2807549438 shutdown_connections 2024-08-17T02:24:24.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.665+0000 7f5104c00640 1 -- 172.21.15.2:0/2807549438 wait complete. 2024-08-17T02:24:24.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.666+0000 7f5104c00640 1 Processor -- start 2024-08-17T02:24:24.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.666+0000 7f5104c00640 1 -- start start 2024-08-17T02:24:24.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.667+0000 7f5104c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51000ad960 0x7f51000a9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:24.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.667+0000 7f5104c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51000add30 0x7f51001588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:24.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.667+0000 7f5104c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51000ca050 0x7f5100168b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:24.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.667+0000 7f5104c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5100158450 con 0x7f51000ca050 2024-08-17T02:24:24.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.667+0000 7f5104c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5100157840 con 0x7f51000add30 2024-08-17T02:24:24.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.667+0000 7f5104c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5100157b20 con 0x7f51000ad960 2024-08-17T02:24:24.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.667+0000 7f50fe800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51000ca050 0x7f5100168b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:24.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.668+0000 7f50fe800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51000ca050 0x7f5100168b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46380/0 (socket says 172.21.15.2:46380) 2024-08-17T02:24:24.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.668+0000 7f50fe800640 1 -- 172.21.15.2:0/311046974 learned_addr learned my addr 172.21.15.2:0/311046974 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:24.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.668+0000 7f50fde00640 1 --2- 172.21.15.2:0/311046974 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51000ad960 0x7f51000a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:24.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.668+0000 7f50fd400640 1 --2- 172.21.15.2:0/311046974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51000add30 0x7f51001588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:24.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.668+0000 7f50fe800640 1 -- 172.21.15.2:0/311046974 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51000ad960 msgr2=0x7f51000a9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:24.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.668+0000 7f50fe800640 1 --2- 172.21.15.2:0/311046974 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51000ad960 0x7f51000a9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.668+0000 7f50fe800640 1 -- 172.21.15.2:0/311046974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51000add30 msgr2=0x7f51001588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:24.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.668+0000 7f50fe800640 1 --2- 172.21.15.2:0/311046974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51000add30 0x7f51001588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.668+0000 7f50fe800640 1 -- 172.21.15.2:0/311046974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f0009450 con 0x7f51000ca050 2024-08-17T02:24:24.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.668+0000 7f50fe800640 1 --2- 172.21.15.2:0/311046974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51000ca050 0x7f5100168b60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f50f80097c0 tx=0x7f50f8037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:24.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.669+0000 7f50f5600640 1 -- 172.21.15.2:0/311046974 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f8042070 con 0x7f51000ca050 2024-08-17T02:24:24.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.669+0000 7f50f5600640 1 -- 172.21.15.2:0/311046974 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f8031b90 con 0x7f51000ca050 2024-08-17T02:24:24.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.669+0000 7f50f5600640 1 -- 172.21.15.2:0/311046974 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f803d430 con 0x7f51000ca050 2024-08-17T02:24:24.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.669+0000 7f5104c00640 1 -- 172.21.15.2:0/311046974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f8009a20 con 0x7f51000ca050 2024-08-17T02:24:24.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.669+0000 7f5104c00640 1 -- 172.21.15.2:0/311046974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51001580e0 con 0x7f51000ca050 2024-08-17T02:24:24.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.670+0000 7f5104c00640 1 -- 172.21.15.2:0/311046974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5100158600 con 0x7f51000ca050 2024-08-17T02:24:24.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.670+0000 7f50f5600640 1 -- 172.21.15.2:0/311046974 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f50f8003040 con 0x7f51000ca050 2024-08-17T02:24:24.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.671+0000 7f50f5600640 1 --2- 172.21.15.2:0/311046974 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f50e0065150 0x7f50e0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:24.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.671+0000 7f50f5600640 1 -- 172.21.15.2:0/311046974 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f50f80a3710 con 0x7f51000ca050 2024-08-17T02:24:24.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.672+0000 7f50fde00640 1 --2- 172.21.15.2:0/311046974 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f50e0065150 0x7f50e0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:24.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.672+0000 7f50fde00640 1 --2- 172.21.15.2:0/311046974 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f50e0065150 0x7f50e0067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f50f0006c90 tx=0x7f50f00091d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:24.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.675+0000 7f50f5600640 1 -- 172.21.15.2:0/311046974 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5100158600 con 0x7f51000ca050 2024-08-17T02:24:24.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:24.897+0000 7f5104c00640 1 -- 172.21.15.2:0/311046974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5100063fb0 con 0x7f51000ca050 2024-08-17T02:24:25.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.741+0000 7f50f5600640 1 -- 172.21.15.2:0/311046974 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f50f80717e0 con 0x7f51000ca050 2024-08-17T02:24:25.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.744+0000 7f5104c00640 1 -- 172.21.15.2:0/311046974 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f50e0065150 msgr2=0x7f50e0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.744+0000 7f5104c00640 1 --2- 172.21.15.2:0/311046974 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f50e0065150 0x7f50e0067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f50f0006c90 tx=0x7f50f00091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.744+0000 7f5104c00640 1 -- 172.21.15.2:0/311046974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51000ca050 msgr2=0x7f5100168b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.744+0000 7f5104c00640 1 --2- 172.21.15.2:0/311046974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51000ca050 0x7f5100168b60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f50f80097c0 tx=0x7f50f8037000 comp rx=0 tx=0).stop 2024-08-17T02:24:25.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.745+0000 7f5104c00640 1 -- 172.21.15.2:0/311046974 shutdown_connections 2024-08-17T02:24:25.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.745+0000 7f5104c00640 1 --2- 172.21.15.2:0/311046974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51000ca050 0x7f5100168b60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.745+0000 7f5104c00640 1 --2- 172.21.15.2:0/311046974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51000add30 0x7f51001588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.745+0000 7f5104c00640 1 --2- 172.21.15.2:0/311046974 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f50e0065150 0x7f50e0067600 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.745+0000 7f5104c00640 1 --2- 172.21.15.2:0/311046974 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51000ad960 0x7f51000a9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.745+0000 7f5104c00640 1 -- 172.21.15.2:0/311046974 >> 172.21.15.2:0/311046974 conn(0x7f5100066e60 msgr2=0x7f5100154850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:25.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.745+0000 7f5104c00640 1 -- 172.21.15.2:0/311046974 shutdown_connections 2024-08-17T02:24:25.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.745+0000 7f5104c00640 1 -- 172.21.15.2:0/311046974 wait complete. 2024-08-17T02:24:25.763 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:24:25.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.924+0000 7f18b0600640 1 Processor -- start 2024-08-17T02:24:25.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.924+0000 7f18b0600640 1 -- start start 2024-08-17T02:24:25.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.925+0000 7f18b0600640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f18a80aee60 0x7f18a80caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.925+0000 7f18b0600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a80afd20 con 0x7f18a8158b90 2024-08-17T02:24:25.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.925+0000 7f18b0600640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a80affe0 con 0x7f18a80aea20 2024-08-17T02:24:25.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.925+0000 7f18b0600640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a80b02c0 con 0x7f18a80aee60 2024-08-17T02:24:25.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.925+0000 7f18adc00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f18a8158b90 0x7f18a80b1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54372/0 (socket says 172.21.15.2:54372) 2024-08-17T02:24:25.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.925+0000 7f18adc00640 1 -- 172.21.15.2:0/3006095642 learned_addr learned my addr 172.21.15.2:0/3006095642 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:25.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.926+0000 7f18ae600640 1 --2- 172.21.15.2:0/3006095642 >> v2:172.21.15.145:3300/0 conn(0x7f18a80aee60 0x7f18a80caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.926+0000 7f18a7e00640 1 -- 172.21.15.2:0/3006095642 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062144862 0 0) 0x7f18a80afd20 con 0x7f18a8158b90 2024-08-17T02:24:25.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.926+0000 7f18a7e00640 1 -- 172.21.15.2:0/3006095642 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18900034e0 con 0x7f18a8158b90 2024-08-17T02:24:25.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.926+0000 7f18a7e00640 1 -- 172.21.15.2:0/3006095642 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3114630846 0 0) 0x7f18900034e0 con 0x7f18a8158b90 2024-08-17T02:24:25.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.926+0000 7f18a7e00640 1 -- 172.21.15.2:0/3006095642 >> v2:172.21.15.145:3300/0 conn(0x7f18a80aee60 msgr2=0x7f18a80caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:25.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.926+0000 7f18a7e00640 1 --2- 172.21.15.2:0/3006095642 >> v2:172.21.15.145:3300/0 conn(0x7f18a80aee60 0x7f18a80caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.926+0000 7f18a7e00640 1 -- 172.21.15.2:0/3006095642 >> v1:172.21.15.145:6789/0 conn(0x7f18a80aea20 legacy=0x7f18a80ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.926+0000 7f18a7e00640 1 -- 172.21.15.2:0/3006095642 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a80ca3c0 con 0x7f18a8158b90 2024-08-17T02:24:25.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.926+0000 7f18a7e00640 1 -- 172.21.15.2:0/3006095642 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7f189c001490 con 0x7f18a8158b90 2024-08-17T02:24:25.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.926+0000 7f18a7e00640 1 -- 172.21.15.2:0/3006095642 >> v1:172.21.15.2:6789/0 conn(0x7f18a8158b90 legacy=0x7f18a80b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.926+0000 7f18a7e00640 1 --2- 172.21.15.2:0/3006095642 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1890003a20 0x7f1890003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.926+0000 7f18a7e00640 1 --2- 172.21.15.2:0/3006095642 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1890004780 0x7f1890004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.926+0000 7f18a7e00640 1 --2- 172.21.15.2:0/3006095642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1890005180 0x7f189000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.926+0000 7f18a7e00640 1 -- 172.21.15.2:0/3006095642 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a80b02c0 con 0x7f1890005180 2024-08-17T02:24:25.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.926+0000 7f18a7e00640 1 -- 172.21.15.2:0/3006095642 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189000c0a0 con 0x7f1890003a20 2024-08-17T02:24:25.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.926+0000 7f18a7e00640 1 -- 172.21.15.2:0/3006095642 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189000c260 con 0x7f1890004780 2024-08-17T02:24:25.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.926+0000 7f18ae600640 1 --2- 172.21.15.2:0/3006095642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1890005180 0x7f189000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.927+0000 7f18adc00640 1 --2- 172.21.15.2:0/3006095642 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1890003a20 0x7f1890003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.927+0000 7f18ad200640 1 --2- 172.21.15.2:0/3006095642 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1890004780 0x7f1890004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.927+0000 7f18ae600640 1 -- 172.21.15.2:0/3006095642 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1890004780 msgr2=0x7f1890004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:25.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.927+0000 7f18ae600640 1 --2- 172.21.15.2:0/3006095642 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1890004780 0x7f1890004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.927+0000 7f18ae600640 1 -- 172.21.15.2:0/3006095642 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1890003a20 msgr2=0x7f1890003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:25.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.927+0000 7f18ae600640 1 --2- 172.21.15.2:0/3006095642 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1890003a20 0x7f1890003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.927+0000 7f18ae600640 1 -- 172.21.15.2:0/3006095642 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18900034e0 con 0x7f1890005180 2024-08-17T02:24:25.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.927+0000 7f18ad200640 1 --2- 172.21.15.2:0/3006095642 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1890004780 0x7f1890004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:25.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.928+0000 7f18ae600640 1 -- 172.21.15.2:0/3006095642 reap_dead start 2024-08-17T02:24:25.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.928+0000 7f18ae600640 1 --2- 172.21.15.2:0/3006095642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1890005180 0x7f189000b9d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f18a000e210 tx=0x7f18a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db266a3401a360 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:25.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.928+0000 7f18a7e00640 1 -- 172.21.15.2:0/3006095642 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a002c040 con 0x7f1890005180 2024-08-17T02:24:25.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.928+0000 7f18a7e00640 1 -- 172.21.15.2:0/3006095642 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a000f040 con 0x7f1890005180 2024-08-17T02:24:25.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.928+0000 7f18a7e00640 1 -- 172.21.15.2:0/3006095642 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a0030650 con 0x7f1890005180 2024-08-17T02:24:25.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.929+0000 7f18b0600640 1 -- 172.21.15.2:0/3006095642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1890005180 msgr2=0x7f189000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.929+0000 7f18b0600640 1 --2- 172.21.15.2:0/3006095642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1890005180 0x7f189000b9d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f18a000e210 tx=0x7f18a000b040 comp rx=0 tx=0).stop 2024-08-17T02:24:25.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.929+0000 7f18b0600640 1 -- 172.21.15.2:0/3006095642 shutdown_connections 2024-08-17T02:24:25.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.929+0000 7f18b0600640 1 --2- 172.21.15.2:0/3006095642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1890005180 0x7f189000b9d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.929+0000 7f18b0600640 1 -- 172.21.15.2:0/3006095642 >> 172.21.15.2:0/3006095642 conn(0x7f18a806e590 msgr2=0x7f18a806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:25.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.929+0000 7f18b0600640 1 -- 172.21.15.2:0/3006095642 shutdown_connections 2024-08-17T02:24:25.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.929+0000 7f18b0600640 1 -- 172.21.15.2:0/3006095642 wait complete. 2024-08-17T02:24:25.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.930+0000 7f18b0600640 1 Processor -- start 2024-08-17T02:24:25.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.930+0000 7f18b0600640 1 -- start start 2024-08-17T02:24:25.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.931+0000 7f18b0600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1890005180 0x7f18a81515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.931+0000 7f18b0600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18a8154550 0x7f18a80b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.931+0000 7f18b0600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18a80b4390 0x7f18a8152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.931+0000 7f18b0600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a80b47f0 con 0x7f18a8154550 2024-08-17T02:24:25.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.931+0000 7f18b0600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a81540c0 con 0x7f18a80b4390 2024-08-17T02:24:25.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.931+0000 7f18b0600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a81534b0 con 0x7f1890005180 2024-08-17T02:24:25.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.931+0000 7f18ad200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18a8154550 0x7f18a80b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.931+0000 7f18ad200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18a8154550 0x7f18a80b3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36184/0 (socket says 172.21.15.2:36184) 2024-08-17T02:24:25.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.931+0000 7f18ad200640 1 -- 172.21.15.2:0/3315759321 learned_addr learned my addr 172.21.15.2:0/3315759321 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:25.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.932+0000 7f18adc00640 1 --2- 172.21.15.2:0/3315759321 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1890005180 0x7f18a81515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.932+0000 7f18ae600640 1 --2- 172.21.15.2:0/3315759321 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18a80b4390 0x7f18a8152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.932+0000 7f18ad200640 1 -- 172.21.15.2:0/3315759321 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1890005180 msgr2=0x7f18a81515d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.932+0000 7f18ad200640 1 --2- 172.21.15.2:0/3315759321 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1890005180 0x7f18a81515d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.932+0000 7f18ad200640 1 -- 172.21.15.2:0/3315759321 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18a80b4390 msgr2=0x7f18a8152780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.932+0000 7f18ad200640 1 --2- 172.21.15.2:0/3315759321 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18a80b4390 0x7f18a8152780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.932+0000 7f18ad200640 1 -- 172.21.15.2:0/3315759321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a8153790 con 0x7f18a8154550 2024-08-17T02:24:25.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.932+0000 7f18ad200640 1 --2- 172.21.15.2:0/3315759321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18a8154550 0x7f18a80b3e50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1894000c00 tx=0x7f1894009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:25.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.932+0000 7f18a4c00640 1 -- 172.21.15.2:0/3315759321 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1894017070 con 0x7f18a8154550 2024-08-17T02:24:25.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.932+0000 7f18a4c00640 1 -- 172.21.15.2:0/3315759321 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1894007020 con 0x7f18a8154550 2024-08-17T02:24:25.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.932+0000 7f18a4c00640 1 -- 172.21.15.2:0/3315759321 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18940073a0 con 0x7f18a8154550 2024-08-17T02:24:25.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.932+0000 7f18b0600640 1 -- 172.21.15.2:0/3315759321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a8153a70 con 0x7f18a8154550 2024-08-17T02:24:25.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.933+0000 7f18b0600640 1 -- 172.21.15.2:0/3315759321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a8152cc0 con 0x7f18a8154550 2024-08-17T02:24:25.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.933+0000 7f18b0600640 1 -- 172.21.15.2:0/3315759321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a8154250 con 0x7f18a8154550 2024-08-17T02:24:25.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.934+0000 7f18a4c00640 1 -- 172.21.15.2:0/3315759321 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1894006790 con 0x7f18a8154550 2024-08-17T02:24:25.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.935+0000 7f18a4c00640 1 --2- 172.21.15.2:0/3315759321 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1888065180 0x7f1888067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.935+0000 7f18a4c00640 1 -- 172.21.15.2:0/3315759321 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1894081e90 con 0x7f18a8154550 2024-08-17T02:24:25.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.936+0000 7f18adc00640 1 --2- 172.21.15.2:0/3315759321 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1888065180 0x7f1888067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.936+0000 7f18adc00640 1 --2- 172.21.15.2:0/3315759321 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1888065180 0x7f1888067630 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f189c000e50 tx=0x7f18a80ca2b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:25.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:25.939+0000 7f18a4c00640 1 -- 172.21.15.2:0/3315759321 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f189404ff60 con 0x7f18a8154550 2024-08-17T02:24:26.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.160+0000 7f18b0600640 1 -- 172.21.15.2:0/3315759321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f18a8063fb0 con 0x7f18a8154550 2024-08-17T02:24:26.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.748+0000 7f18a4c00640 1 -- 172.21.15.2:0/3315759321 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1894053580 con 0x7f18a8154550 2024-08-17T02:24:26.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.750+0000 7f18b0600640 1 -- 172.21.15.2:0/3315759321 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1888065180 msgr2=0x7f1888067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.750+0000 7f18b0600640 1 --2- 172.21.15.2:0/3315759321 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1888065180 0x7f1888067630 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f189c000e50 tx=0x7f18a80ca2b0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.750+0000 7f18b0600640 1 -- 172.21.15.2:0/3315759321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18a8154550 msgr2=0x7f18a80b3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.750+0000 7f18b0600640 1 --2- 172.21.15.2:0/3315759321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18a8154550 0x7f18a80b3e50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1894000c00 tx=0x7f1894009040 comp rx=0 tx=0).stop 2024-08-17T02:24:26.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.750+0000 7f18b0600640 1 -- 172.21.15.2:0/3315759321 shutdown_connections 2024-08-17T02:24:26.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.750+0000 7f18b0600640 1 --2- 172.21.15.2:0/3315759321 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18a80b4390 0x7f18a8152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.750+0000 7f18b0600640 1 --2- 172.21.15.2:0/3315759321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18a8154550 0x7f18a80b3e50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.750+0000 7f18b0600640 1 --2- 172.21.15.2:0/3315759321 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1888065180 0x7f1888067630 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.750+0000 7f18b0600640 1 --2- 172.21.15.2:0/3315759321 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1890005180 0x7f18a81515d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.750+0000 7f18b0600640 1 -- 172.21.15.2:0/3315759321 >> 172.21.15.2:0/3315759321 conn(0x7f18a806e590 msgr2=0x7f18a80b4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:26.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.750+0000 7f18b0600640 1 -- 172.21.15.2:0/3315759321 shutdown_connections 2024-08-17T02:24:26.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.750+0000 7f18b0600640 1 -- 172.21.15.2:0/3315759321 wait complete. 2024-08-17T02:24:26.768 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:24:26.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.922+0000 7f0364400640 1 Processor -- start 2024-08-17T02:24:26.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.922+0000 7f0364400640 1 -- start start 2024-08-17T02:24:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.923+0000 7f0364400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f035c06dee0 0x7f035c163c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.923+0000 7f0364400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f035c0aed90 con 0x7f035c158a20 2024-08-17T02:24:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.923+0000 7f0364400640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f035c0af070 con 0x7f035c0ae860 2024-08-17T02:24:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.923+0000 7f0364400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035c0af350 con 0x7f035c06dee0 2024-08-17T02:24:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.923+0000 7f0361a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f035c158a20 0x7f035c0a89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54388/0 (socket says 172.21.15.2:54388) 2024-08-17T02:24:26.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.923+0000 7f0361a00640 1 -- 172.21.15.2:0/3385362037 learned_addr learned my addr 172.21.15.2:0/3385362037 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:26.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.924+0000 7f0362400640 1 --2- 172.21.15.2:0/3385362037 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f035c06dee0 0x7f035c163c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.924+0000 7f035be00640 1 -- 172.21.15.2:0/3385362037 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942777577 0 0) 0x7f035c0aed90 con 0x7f035c158a20 2024-08-17T02:24:26.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.924+0000 7f035be00640 1 -- 172.21.15.2:0/3385362037 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03440034e0 con 0x7f035c158a20 2024-08-17T02:24:26.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.924+0000 7f035be00640 1 -- 172.21.15.2:0/3385362037 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 49009225 0 0) 0x7f035c0af070 con 0x7f035c0ae860 2024-08-17T02:24:26.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.924+0000 7f035be00640 1 -- 172.21.15.2:0/3385362037 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f035c0aed90 con 0x7f035c0ae860 2024-08-17T02:24:26.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.924+0000 7f035be00640 1 -- 172.21.15.2:0/3385362037 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 406703397 0 0) 0x7f03440034e0 con 0x7f035c158a20 2024-08-17T02:24:26.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.924+0000 7f035be00640 1 -- 172.21.15.2:0/3385362037 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f035c06dee0 msgr2=0x7f035c163c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.924+0000 7f035be00640 1 --2- 172.21.15.2:0/3385362037 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f035c06dee0 0x7f035c163c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.924+0000 7f035be00640 1 -- 172.21.15.2:0/3385362037 >> v1:172.21.15.145:6789/0 conn(0x7f035c0ae860 legacy=0x7f035c06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.924+0000 7f035be00640 1 -- 172.21.15.2:0/3385362037 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c0af630 con 0x7f035c158a20 2024-08-17T02:24:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.924+0000 7f035be00640 1 -- 172.21.15.2:0/3385362037 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7f0350001470 con 0x7f035c158a20 2024-08-17T02:24:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.924+0000 7f035be00640 1 -- 172.21.15.2:0/3385362037 >> v1:172.21.15.2:6789/0 conn(0x7f035c158a20 legacy=0x7f035c0a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.924+0000 7f035be00640 1 --2- 172.21.15.2:0/3385362037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0344003b90 0x7f0344003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.924+0000 7f035be00640 1 --2- 172.21.15.2:0/3385362037 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0344004780 0x7f0344004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.924+0000 7f035be00640 1 --2- 172.21.15.2:0/3385362037 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f035c06dee0 0x7f0344005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.924+0000 7f035be00640 1 -- 172.21.15.2:0/3385362037 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035c0af350 con 0x7f0344003b90 2024-08-17T02:24:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.924+0000 7f035be00640 1 -- 172.21.15.2:0/3385362037 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034400bb60 con 0x7f0344004780 2024-08-17T02:24:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.924+0000 7f035be00640 1 -- 172.21.15.2:0/3385362037 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034400bd20 con 0x7f035c06dee0 2024-08-17T02:24:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.925+0000 7f0361a00640 1 --2- 172.21.15.2:0/3385362037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0344003b90 0x7f0344003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.925+0000 7f0361000640 1 --2- 172.21.15.2:0/3385362037 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0344004780 0x7f0344004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.925+0000 7f0362400640 1 --2- 172.21.15.2:0/3385362037 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f035c06dee0 0x7f0344005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.925+0000 7f0361a00640 1 -- 172.21.15.2:0/3385362037 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f035c06dee0 msgr2=0x7f0344005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.925+0000 7f0361a00640 1 --2- 172.21.15.2:0/3385362037 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f035c06dee0 0x7f0344005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.925+0000 7f0361a00640 1 -- 172.21.15.2:0/3385362037 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0344004780 msgr2=0x7f0344004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.925+0000 7f0361a00640 1 --2- 172.21.15.2:0/3385362037 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0344004780 0x7f0344004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.925+0000 7f0361a00640 1 -- 172.21.15.2:0/3385362037 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03440034e0 con 0x7f0344003b90 2024-08-17T02:24:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.925+0000 7f0361000640 1 --2- 172.21.15.2:0/3385362037 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0344004780 0x7f0344004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.926+0000 7f0361a00640 1 --2- 172.21.15.2:0/3385362037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0344003b90 0x7f0344003f80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f035000c190 tx=0x7f0350001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e05d4200951cd7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:26.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.926+0000 7f035be00640 1 -- 172.21.15.2:0/3385362037 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0350005960 con 0x7f0344003b90 2024-08-17T02:24:26.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.926+0000 7f035be00640 1 -- 172.21.15.2:0/3385362037 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035002d070 con 0x7f0344003b90 2024-08-17T02:24:26.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.926+0000 7f035be00640 1 -- 172.21.15.2:0/3385362037 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0350005b20 con 0x7f0344003b90 2024-08-17T02:24:26.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.927+0000 7f0364400640 1 -- 172.21.15.2:0/3385362037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0344003b90 msgr2=0x7f0344003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.927+0000 7f0364400640 1 --2- 172.21.15.2:0/3385362037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0344003b90 0x7f0344003f80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f035000c190 tx=0x7f0350001d40 comp rx=0 tx=0).stop 2024-08-17T02:24:26.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.927+0000 7f0362400640 1 -- 172.21.15.2:0/3385362037 reap_dead start 2024-08-17T02:24:26.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.927+0000 7f0364400640 1 -- 172.21.15.2:0/3385362037 shutdown_connections 2024-08-17T02:24:26.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.927+0000 7f0364400640 1 -- 172.21.15.2:0/3385362037 >> 172.21.15.2:0/3385362037 conn(0x7f035c066e60 msgr2=0x7f035c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:26.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.927+0000 7f0364400640 1 -- 172.21.15.2:0/3385362037 shutdown_connections 2024-08-17T02:24:26.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.927+0000 7f0364400640 1 -- 172.21.15.2:0/3385362037 wait complete. 2024-08-17T02:24:26.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.928+0000 7f0364400640 1 Processor -- start 2024-08-17T02:24:26.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.928+0000 7f0364400640 1 -- start start 2024-08-17T02:24:26.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.929+0000 7f0364400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0344003b90 0x7f035c151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.929+0000 7f0364400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f035c13d1f0 0x7f035c168fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.929+0000 7f0364400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f035c13d660 0x7f035c153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.929+0000 7f0364400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035c151550 con 0x7f035c13d1f0 2024-08-17T02:24:26.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.929+0000 7f0364400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035c154ac0 con 0x7f035c13d660 2024-08-17T02:24:26.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.929+0000 7f0364400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035c14c0d0 con 0x7f0344003b90 2024-08-17T02:24:26.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.929+0000 7f0361000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f035c13d1f0 0x7f035c168fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.929+0000 7f0361000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f035c13d1f0 0x7f035c168fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36214/0 (socket says 172.21.15.2:36214) 2024-08-17T02:24:26.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.929+0000 7f0361000640 1 -- 172.21.15.2:0/3488659863 learned_addr learned my addr 172.21.15.2:0/3488659863 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:26.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.930+0000 7f0361a00640 1 --2- 172.21.15.2:0/3488659863 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0344003b90 0x7f035c151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.930+0000 7f0362400640 1 --2- 172.21.15.2:0/3488659863 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f035c13d660 0x7f035c153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.930+0000 7f0361000640 1 -- 172.21.15.2:0/3488659863 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0344003b90 msgr2=0x7f035c151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.930+0000 7f0361000640 1 --2- 172.21.15.2:0/3488659863 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0344003b90 0x7f035c151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.930+0000 7f0361000640 1 -- 172.21.15.2:0/3488659863 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f035c13d660 msgr2=0x7f035c153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.930+0000 7f0361000640 1 --2- 172.21.15.2:0/3488659863 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f035c13d660 0x7f035c153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.930+0000 7f0361000640 1 -- 172.21.15.2:0/3488659863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c150c20 con 0x7f035c13d1f0 2024-08-17T02:24:26.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.930+0000 7f0361000640 1 --2- 172.21.15.2:0/3488659863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f035c13d1f0 0x7f035c168fd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f03480079f0 tx=0x7f0348009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:26.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.930+0000 7f0358c00640 1 -- 172.21.15.2:0/3488659863 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348007020 con 0x7f035c13d1f0 2024-08-17T02:24:26.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.930+0000 7f0358c00640 1 -- 172.21.15.2:0/3488659863 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0348007180 con 0x7f035c13d1f0 2024-08-17T02:24:26.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.930+0000 7f0358c00640 1 -- 172.21.15.2:0/3488659863 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348007520 con 0x7f035c13d1f0 2024-08-17T02:24:26.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.930+0000 7f0364400640 1 -- 172.21.15.2:0/3488659863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f035c152000 con 0x7f035c13d1f0 2024-08-17T02:24:26.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.931+0000 7f0364400640 1 -- 172.21.15.2:0/3488659863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f035c1525c0 con 0x7f035c13d1f0 2024-08-17T02:24:26.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.932+0000 7f0364400640 1 -- 172.21.15.2:0/3488659863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f035c063fb0 con 0x7f035c13d1f0 2024-08-17T02:24:26.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.932+0000 7f0358c00640 1 -- 172.21.15.2:0/3488659863 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f03480069a0 con 0x7f035c13d1f0 2024-08-17T02:24:26.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.933+0000 7f0358c00640 1 --2- 172.21.15.2:0/3488659863 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f033c065150 0x7f033c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.933+0000 7f0358c00640 1 -- 172.21.15.2:0/3488659863 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f03480826c0 con 0x7f035c13d1f0 2024-08-17T02:24:26.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.934+0000 7f0361a00640 1 --2- 172.21.15.2:0/3488659863 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f033c065150 0x7f033c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.934+0000 7f0361a00640 1 --2- 172.21.15.2:0/3488659863 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f033c065150 0x7f033c067600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0350032000 tx=0x7f0350033000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:26.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:26.937+0000 7f0358c00640 1 -- 172.21.15.2:0/3488659863 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f03480506e0 con 0x7f035c13d1f0 2024-08-17T02:24:27.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.160+0000 7f0364400640 1 -- 172.21.15.2:0/3488659863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f035c06e4c0 con 0x7f035c13d1f0 2024-08-17T02:24:27.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.161+0000 7f0358c00640 1 -- 172.21.15.2:0/3488659863 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f0348053d00 con 0x7f035c13d1f0 2024-08-17T02:24:27.161 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:24:27.161 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1347318932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1347318932},{"type":"v1","addr":"172.21.15.2:6834","nonce":1347318932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6836/4156967978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":4156967978},{"type":"v1","addr":"172.21.15.145:6836","nonce":4156967978}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4903,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/1729489536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":1729489536},{"type":"v1","addr":"172.21.15.145:6837","nonce":1729489536}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:23.151218+0000","modified":"2024-08-17T02:24:26.741121+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4950},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4950":{"gid":4950,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/3013258535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3013258535},{"type":"v1","addr":"172.21.15.2:6835","nonce":3013258535}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:24:27.162 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2024-08-17T02:24:27.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.163+0000 7f0364400640 1 -- 172.21.15.2:0/3488659863 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f033c065150 msgr2=0x7f033c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.163+0000 7f0364400640 1 --2- 172.21.15.2:0/3488659863 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f033c065150 0x7f033c067600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0350032000 tx=0x7f0350033000 comp rx=0 tx=0).stop 2024-08-17T02:24:27.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.163+0000 7f0364400640 1 -- 172.21.15.2:0/3488659863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f035c13d1f0 msgr2=0x7f035c168fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.163+0000 7f0364400640 1 --2- 172.21.15.2:0/3488659863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f035c13d1f0 0x7f035c168fd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f03480079f0 tx=0x7f0348009040 comp rx=0 tx=0).stop 2024-08-17T02:24:27.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.164+0000 7f0364400640 1 -- 172.21.15.2:0/3488659863 shutdown_connections 2024-08-17T02:24:27.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.164+0000 7f0364400640 1 --2- 172.21.15.2:0/3488659863 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f035c13d660 0x7f035c153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.164+0000 7f0364400640 1 --2- 172.21.15.2:0/3488659863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f035c13d1f0 0x7f035c168fd0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.164+0000 7f0364400640 1 --2- 172.21.15.2:0/3488659863 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f033c065150 0x7f033c067600 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.164+0000 7f0364400640 1 --2- 172.21.15.2:0/3488659863 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0344003b90 0x7f035c151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.164+0000 7f0364400640 1 -- 172.21.15.2:0/3488659863 >> 172.21.15.2:0/3488659863 conn(0x7f035c066e60 msgr2=0x7f035c0acc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:27.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.164+0000 7f0364400640 1 -- 172.21.15.2:0/3488659863 shutdown_connections 2024-08-17T02:24:27.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.164+0000 7f0364400640 1 -- 172.21.15.2:0/3488659863 wait complete. 2024-08-17T02:24:27.179 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:27.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.329+0000 7f9e5c800640 1 Processor -- start 2024-08-17T02:24:27.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.329+0000 7f9e5c800640 1 -- start start 2024-08-17T02:24:27.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.330+0000 7f9e5c800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e540afca0 0x7f9e540b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.330+0000 7f9e5c800640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9e540acf10 0x7f9e54159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.330+0000 7f9e5c800640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e5415a4e0 con 0x7f9e541589a0 2024-08-17T02:24:27.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.331+0000 7f9e5c800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e540b0980 con 0x7f9e540afca0 2024-08-17T02:24:27.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.331+0000 7f9e5c800640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e540c92b0 con 0x7f9e540acf10 2024-08-17T02:24:27.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.331+0000 7f9e59e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e540afca0 0x7f9e540b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.331+0000 7f9e59e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e540afca0 0x7f9e540b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36218/0 (socket says 172.21.15.2:36218) 2024-08-17T02:24:27.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.331+0000 7f9e59e00640 1 -- 172.21.15.2:0/519364117 learned_addr learned my addr 172.21.15.2:0/519364117 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:27.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.331+0000 7f9e59400640 1 --2- 172.21.15.2:0/519364117 >> v2:172.21.15.145:3300/0 conn(0x7f9e540acf10 0x7f9e54159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.331+0000 7f9e59e00640 1 -- 172.21.15.2:0/519364117 >> v2:172.21.15.145:3300/0 conn(0x7f9e540acf10 msgr2=0x7f9e54159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:27.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.331+0000 7f9e59e00640 1 --2- 172.21.15.2:0/519364117 >> v2:172.21.15.145:3300/0 conn(0x7f9e540acf10 0x7f9e54159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.331+0000 7f9e59e00640 1 -- 172.21.15.2:0/519364117 >> v1:172.21.15.145:6789/0 conn(0x7f9e541589a0 legacy=0x7f9e54158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:27.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.331+0000 7f9e59e00640 1 -- 172.21.15.2:0/519364117 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e540ad480 con 0x7f9e540afca0 2024-08-17T02:24:27.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.332+0000 7f9e59e00640 1 --2- 172.21.15.2:0/519364117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e540afca0 0x7f9e540b0070 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9e540c83b0 tx=0x7f9e480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a9c76f92240440 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:27.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.333+0000 7f9e58a00640 1 -- 172.21.15.2:0/519364117 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4802ade0 con 0x7f9e540afca0 2024-08-17T02:24:27.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.333+0000 7f9e58a00640 1 -- 172.21.15.2:0/519364117 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e48032440 con 0x7f9e540afca0 2024-08-17T02:24:27.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.333+0000 7f9e58a00640 1 -- 172.21.15.2:0/519364117 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e48032820 con 0x7f9e540afca0 2024-08-17T02:24:27.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.333+0000 7f9e5c800640 1 -- 172.21.15.2:0/519364117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e540afca0 msgr2=0x7f9e540b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.333+0000 7f9e5c800640 1 --2- 172.21.15.2:0/519364117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e540afca0 0x7f9e540b0070 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9e540c83b0 tx=0x7f9e480091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.334+0000 7f9e5c800640 1 -- 172.21.15.2:0/519364117 shutdown_connections 2024-08-17T02:24:27.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.334+0000 7f9e5c800640 1 --2- 172.21.15.2:0/519364117 >> v2:172.21.15.145:3300/0 conn(0x7f9e540acf10 0x7f9e54159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.334+0000 7f9e5c800640 1 --2- 172.21.15.2:0/519364117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e540afca0 0x7f9e540b0070 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.334+0000 7f9e5c800640 1 -- 172.21.15.2:0/519364117 >> 172.21.15.2:0/519364117 conn(0x7f9e54066e60 msgr2=0x7f9e54067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:27.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.334+0000 7f9e5c800640 1 -- 172.21.15.2:0/519364117 shutdown_connections 2024-08-17T02:24:27.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.334+0000 7f9e5c800640 1 -- 172.21.15.2:0/519364117 wait complete. 2024-08-17T02:24:27.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.335+0000 7f9e5c800640 1 Processor -- start 2024-08-17T02:24:27.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.335+0000 7f9e5c800640 1 -- start start 2024-08-17T02:24:27.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.336+0000 7f9e5c800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9e540acf10 0x7f9e54156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.336+0000 7f9e5c800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e540afca0 0x7f9e54157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.336+0000 7f9e5c800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9e541589a0 0x7f9e54153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.336+0000 7f9e5c800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e54157410 con 0x7f9e540afca0 2024-08-17T02:24:27.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.336+0000 7f9e5c800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e54158430 con 0x7f9e541589a0 2024-08-17T02:24:27.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.336+0000 7f9e5c800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e54156800 con 0x7f9e540acf10 2024-08-17T02:24:27.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.336+0000 7f9e59400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e540afca0 0x7f9e54157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.336+0000 7f9e59400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e540afca0 0x7f9e54157ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36220/0 (socket says 172.21.15.2:36220) 2024-08-17T02:24:27.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.336+0000 7f9e59400640 1 -- 172.21.15.2:0/3068092714 learned_addr learned my addr 172.21.15.2:0/3068092714 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:27.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.336+0000 7f9e5a800640 1 --2- 172.21.15.2:0/3068092714 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9e541589a0 0x7f9e54153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.336+0000 7f9e59e00640 1 --2- 172.21.15.2:0/3068092714 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9e540acf10 0x7f9e54156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.337+0000 7f9e59400640 1 -- 172.21.15.2:0/3068092714 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9e540acf10 msgr2=0x7f9e54156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.337+0000 7f9e59400640 1 --2- 172.21.15.2:0/3068092714 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9e540acf10 0x7f9e54156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.337+0000 7f9e59400640 1 -- 172.21.15.2:0/3068092714 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9e541589a0 msgr2=0x7f9e54153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.337+0000 7f9e59400640 1 --2- 172.21.15.2:0/3068092714 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9e541589a0 0x7f9e54153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.337+0000 7f9e59400640 1 -- 172.21.15.2:0/3068092714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e48009450 con 0x7f9e540afca0 2024-08-17T02:24:27.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.337+0000 7f9e5a800640 1 --2- 172.21.15.2:0/3068092714 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9e541589a0 0x7f9e54153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:27.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.337+0000 7f9e59400640 1 --2- 172.21.15.2:0/3068092714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e540afca0 0x7f9e54157ef0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400d890 tx=0x7f9e44008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:27.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.337+0000 7f9e4d600640 1 -- 172.21.15.2:0/3068092714 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4400de20 con 0x7f9e540afca0 2024-08-17T02:24:27.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.337+0000 7f9e4d600640 1 -- 172.21.15.2:0/3068092714 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e440098b0 con 0x7f9e540afca0 2024-08-17T02:24:27.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.337+0000 7f9e4d600640 1 -- 172.21.15.2:0/3068092714 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e44009c50 con 0x7f9e540afca0 2024-08-17T02:24:27.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.337+0000 7f9e5c800640 1 -- 172.21.15.2:0/3068092714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e54156ae0 con 0x7f9e540afca0 2024-08-17T02:24:27.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.337+0000 7f9e5c800640 1 -- 172.21.15.2:0/3068092714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e541570a0 con 0x7f9e540afca0 2024-08-17T02:24:27.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.339+0000 7f9e5c800640 1 -- 172.21.15.2:0/3068092714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e54063fb0 con 0x7f9e540afca0 2024-08-17T02:24:27.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.339+0000 7f9e4d600640 1 -- 172.21.15.2:0/3068092714 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9e44014620 con 0x7f9e540afca0 2024-08-17T02:24:27.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.340+0000 7f9e4d600640 1 --2- 172.21.15.2:0/3068092714 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9e38065150 0x7f9e38067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.340+0000 7f9e4d600640 1 -- 172.21.15.2:0/3068092714 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9e44082cf0 con 0x7f9e540afca0 2024-08-17T02:24:27.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.341+0000 7f9e59e00640 1 --2- 172.21.15.2:0/3068092714 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9e38065150 0x7f9e38067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.341+0000 7f9e59e00640 1 --2- 172.21.15.2:0/3068092714 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9e38065150 0x7f9e38067600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9e48034000 tx=0x7f9e48032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:27.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.344+0000 7f9e4d600640 1 -- 172.21.15.2:0/3068092714 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9e44050dc0 con 0x7f9e540afca0 2024-08-17T02:24:27.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.528+0000 7f9e5c800640 1 -- 172.21.15.2:0/3068092714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e54157550 con 0x7f9e540afca0 2024-08-17T02:24:27.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.529+0000 7f9e4d600640 1 -- 172.21.15.2:0/3068092714 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f9e54157550 con 0x7f9e540afca0 2024-08-17T02:24:27.529 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:24:27.529 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":32,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:24:24.724055+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:21.215146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:22.134466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:27.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.531+0000 7f9e5c800640 1 -- 172.21.15.2:0/3068092714 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9e38065150 msgr2=0x7f9e38067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.531+0000 7f9e5c800640 1 --2- 172.21.15.2:0/3068092714 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9e38065150 0x7f9e38067600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9e48034000 tx=0x7f9e48032000 comp rx=0 tx=0).stop 2024-08-17T02:24:27.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.531+0000 7f9e5c800640 1 -- 172.21.15.2:0/3068092714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e540afca0 msgr2=0x7f9e54157ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.531+0000 7f9e5c800640 1 --2- 172.21.15.2:0/3068092714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e540afca0 0x7f9e54157ef0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400d890 tx=0x7f9e44008040 comp rx=0 tx=0).stop 2024-08-17T02:24:27.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.531+0000 7f9e5c800640 1 -- 172.21.15.2:0/3068092714 shutdown_connections 2024-08-17T02:24:27.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.531+0000 7f9e5c800640 1 --2- 172.21.15.2:0/3068092714 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9e541589a0 0x7f9e54153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.531+0000 7f9e5c800640 1 --2- 172.21.15.2:0/3068092714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e540afca0 0x7f9e54157ef0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.531+0000 7f9e5c800640 1 --2- 172.21.15.2:0/3068092714 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9e38065150 0x7f9e38067600 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.531+0000 7f9e5c800640 1 --2- 172.21.15.2:0/3068092714 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9e540acf10 0x7f9e54156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.531+0000 7f9e5c800640 1 -- 172.21.15.2:0/3068092714 >> 172.21.15.2:0/3068092714 conn(0x7f9e54066e60 msgr2=0x7f9e540cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:27.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.531+0000 7f9e5c800640 1 -- 172.21.15.2:0/3068092714 shutdown_connections 2024-08-17T02:24:27.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.531+0000 7f9e5c800640 1 -- 172.21.15.2:0/3068092714 wait complete. 2024-08-17T02:24:27.546 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:24:27.546 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:24:27.619 INFO:tasks.ceph.mds.a.smithi002.stderr:2024-08-17T02:24:27.619+0000 7fdea5a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:24:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.698+0000 7f5165c00640 1 Processor -- start 2024-08-17T02:24:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.698+0000 7f5165c00640 1 -- start start 2024-08-17T02:24:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.699+0000 7f5165c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f51600ca430 0x7f51600adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.699+0000 7f5165c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51600cb180 con 0x7f51600ad790 2024-08-17T02:24:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.699+0000 7f5165c00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51600af530 con 0x7f51601552d0 2024-08-17T02:24:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.699+0000 7f5165c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51600ca8e0 con 0x7f51600ca430 2024-08-17T02:24:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.700+0000 7f515fe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f51600ad790 0x7f51600c9d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54396/0 (socket says 172.21.15.2:54396) 2024-08-17T02:24:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.700+0000 7f515fe00640 1 -- 172.21.15.2:0/4099647668 learned_addr learned my addr 172.21.15.2:0/4099647668 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.700+0000 7f515f400640 1 --2- 172.21.15.2:0/4099647668 >> v2:172.21.15.2:3300/0 conn(0x7f51600ca430 0x7f51600adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.700+0000 7f515ea00640 1 -- 172.21.15.2:0/4099647668 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 832520002 0 0) 0x7f51600cb180 con 0x7f51600ad790 2024-08-17T02:24:27.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.700+0000 7f515f400640 1 -- 172.21.15.2:0/4099647668 >> v1:172.21.15.145:6789/0 conn(0x7f51601552d0 legacy=0x7f5160155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:27.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.700+0000 7f515f400640 1 -- 172.21.15.2:0/4099647668 >> v1:172.21.15.2:6789/0 conn(0x7f51600ad790 legacy=0x7f51600c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.700+0000 7f515f400640 1 -- 172.21.15.2:0/4099647668 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51600cabc0 con 0x7f51600ca430 2024-08-17T02:24:27.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.701+0000 7f515f400640 1 --2- 172.21.15.2:0/4099647668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51600ca430 0x7f51600adb60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f514c009850 tx=0x7f514c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc8314e611a30ea server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:27.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.701+0000 7f515ea00640 1 -- 172.21.15.2:0/4099647668 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c02ad00 con 0x7f51600ca430 2024-08-17T02:24:27.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.701+0000 7f515ea00640 1 -- 172.21.15.2:0/4099647668 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514c02ae60 con 0x7f51600ca430 2024-08-17T02:24:27.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.701+0000 7f515ea00640 1 -- 172.21.15.2:0/4099647668 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c032670 con 0x7f51600ca430 2024-08-17T02:24:27.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.702+0000 7f5165c00640 1 -- 172.21.15.2:0/4099647668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51600ca430 msgr2=0x7f51600adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.702+0000 7f5165c00640 1 --2- 172.21.15.2:0/4099647668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51600ca430 0x7f51600adb60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f514c009850 tx=0x7f514c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.702+0000 7f5165c00640 1 -- 172.21.15.2:0/4099647668 shutdown_connections 2024-08-17T02:24:27.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.702+0000 7f5165c00640 1 --2- 172.21.15.2:0/4099647668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51600ca430 0x7f51600adb60 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.702+0000 7f5165c00640 1 -- 172.21.15.2:0/4099647668 >> 172.21.15.2:0/4099647668 conn(0x7f5160062af0 msgr2=0x7f5160062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:27.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.702+0000 7f5165c00640 1 -- 172.21.15.2:0/4099647668 shutdown_connections 2024-08-17T02:24:27.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.702+0000 7f5165c00640 1 -- 172.21.15.2:0/4099647668 wait complete. 2024-08-17T02:24:27.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.703+0000 7f5165c00640 1 Processor -- start 2024-08-17T02:24:27.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.704+0000 7f5165c00640 1 -- start start 2024-08-17T02:24:27.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.704+0000 7f5165c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51600ad790 0x7f5160168d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.704+0000 7f5165c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51600ca430 0x7f516013c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.704+0000 7f5165c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51601552d0 0x7f51600aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.704+0000 7f5165c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51601560f0 con 0x7f51600ad790 2024-08-17T02:24:27.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.704+0000 7f5165c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51600abf90 con 0x7f51600ca430 2024-08-17T02:24:27.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.704+0000 7f5165c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51600ab6f0 con 0x7f51601552d0 2024-08-17T02:24:27.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.705+0000 7f515fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51600ad790 0x7f5160168d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.705+0000 7f515fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51600ad790 0x7f5160168d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36228/0 (socket says 172.21.15.2:36228) 2024-08-17T02:24:27.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.705+0000 7f515fe00640 1 -- 172.21.15.2:0/3717673837 learned_addr learned my addr 172.21.15.2:0/3717673837 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:27.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.705+0000 7f515f400640 1 --2- 172.21.15.2:0/3717673837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51600ca430 0x7f516013c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.705+0000 7f5165200640 1 --2- 172.21.15.2:0/3717673837 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51601552d0 0x7f51600aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.705+0000 7f515fe00640 1 -- 172.21.15.2:0/3717673837 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51601552d0 msgr2=0x7f51600aadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.705+0000 7f515fe00640 1 --2- 172.21.15.2:0/3717673837 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51601552d0 0x7f51600aadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.705+0000 7f515fe00640 1 -- 172.21.15.2:0/3717673837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51600ca430 msgr2=0x7f516013c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.705+0000 7f515fe00640 1 --2- 172.21.15.2:0/3717673837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51600ca430 0x7f516013c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.705+0000 7f515fe00640 1 -- 172.21.15.2:0/3717673837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c009390 con 0x7f51600ad790 2024-08-17T02:24:27.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.705+0000 7f5165200640 1 --2- 172.21.15.2:0/3717673837 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51601552d0 0x7f51600aadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:27.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.706+0000 7f515fe00640 1 --2- 172.21.15.2:0/3717673837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51600ad790 0x7f5160168d60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f515000c610 tx=0x7f5150007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:27.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.706+0000 7f5157400640 1 -- 172.21.15.2:0/3717673837 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5150005aa0 con 0x7f51600ad790 2024-08-17T02:24:27.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.706+0000 7f5157400640 1 -- 172.21.15.2:0/3717673837 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5150005c00 con 0x7f51600ad790 2024-08-17T02:24:27.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.706+0000 7f5157400640 1 -- 172.21.15.2:0/3717673837 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51500070f0 con 0x7f51600ad790 2024-08-17T02:24:27.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.706+0000 7f5165c00640 1 -- 172.21.15.2:0/3717673837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51600ab9d0 con 0x7f51600ad790 2024-08-17T02:24:27.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.706+0000 7f5165c00640 1 -- 172.21.15.2:0/3717673837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51600ab330 con 0x7f51600ad790 2024-08-17T02:24:27.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.707+0000 7f5165c00640 1 -- 172.21.15.2:0/3717673837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5160155ec0 con 0x7f51600ad790 2024-08-17T02:24:27.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.708+0000 7f5157400640 1 -- 172.21.15.2:0/3717673837 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f51500074e0 con 0x7f51600ad790 2024-08-17T02:24:27.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.709+0000 7f5157400640 1 --2- 172.21.15.2:0/3717673837 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5140065180 0x7f5140067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.709+0000 7f5157400640 1 -- 172.21.15.2:0/3717673837 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5150081ee0 con 0x7f51600ad790 2024-08-17T02:24:27.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.709+0000 7f515f400640 1 --2- 172.21.15.2:0/3717673837 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5140065180 0x7f5140067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.710+0000 7f515f400640 1 --2- 172.21.15.2:0/3717673837 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5140065180 0x7f5140067630 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f514c034000 tx=0x7f514c032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.713+0000 7f5157400640 1 -- 172.21.15.2:0/3717673837 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f515004ff80 con 0x7f51600ad790 2024-08-17T02:24:27.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.891+0000 7f5165c00640 1 -- 172.21.15.2:0/3717673837 --> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5160070720 con 0x7f5140065180 2024-08-17T02:24:27.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.900+0000 7f5157400640 1 -- 172.21.15.2:0/3717673837 <== mgr.4108 v2:172.21.15.145:6832/36841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264615 (secure 0 0 0) 0x7f5160070720 con 0x7f5140065180 2024-08-17T02:24:27.903 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:24:27.904 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-17T02:24:27.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.903+0000 7f5165c00640 1 -- 172.21.15.2:0/3717673837 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5140065180 msgr2=0x7f5140067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.903+0000 7f5165c00640 1 --2- 172.21.15.2:0/3717673837 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5140065180 0x7f5140067630 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f514c034000 tx=0x7f514c032000 comp rx=0 tx=0).stop 2024-08-17T02:24:27.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.903+0000 7f5165c00640 1 -- 172.21.15.2:0/3717673837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51600ad790 msgr2=0x7f5160168d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.903+0000 7f5165c00640 1 --2- 172.21.15.2:0/3717673837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51600ad790 0x7f5160168d60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f515000c610 tx=0x7f5150007d60 comp rx=0 tx=0).stop 2024-08-17T02:24:27.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.903+0000 7f5165c00640 1 -- 172.21.15.2:0/3717673837 shutdown_connections 2024-08-17T02:24:27.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.903+0000 7f5165c00640 1 --2- 172.21.15.2:0/3717673837 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5140065180 0x7f5140067630 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.903+0000 7f5165c00640 1 --2- 172.21.15.2:0/3717673837 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51601552d0 0x7f51600aadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.903+0000 7f5165c00640 1 --2- 172.21.15.2:0/3717673837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51600ca430 0x7f516013c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.903+0000 7f5165c00640 1 --2- 172.21.15.2:0/3717673837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51600ad790 0x7f5160168d60 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.903+0000 7f5165c00640 1 -- 172.21.15.2:0/3717673837 >> 172.21.15.2:0/3717673837 conn(0x7f5160062af0 msgr2=0x7f5160069780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:27.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.903+0000 7f5165c00640 1 -- 172.21.15.2:0/3717673837 shutdown_connections 2024-08-17T02:24:27.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:27.903+0000 7f5165c00640 1 -- 172.21.15.2:0/3717673837 wait complete. 2024-08-17T02:24:27.918 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-08-17T02:24:26.063582+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399476,"kb_used_data":3968,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575244,"statfs":{"total":773094113280,"available":770637049856,"internally_reserved":0,"allocated":4063232,"data_stored":2254668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.353817"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.739706+0000","last_change":"2024-08-17T02:24:23.739706+0000","last_active":"2024-08-17T02:24:23.739706+0000","last_peered":"2024-08-17T02:24:23.739706+0000","last_clean":"2024-08-17T02:24:23.739706+0000","last_became_active":"2024-08-17T02:24:23.737938+0000","last_became_peered":"2024-08-17T02:24:23.737938+0000","last_unstale":"2024-08-17T02:24:23.739706+0000","last_undegraded":"2024-08-17T02:24:23.739706+0000","last_fullsized":"2024-08-17T02:24:23.739706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:27.260103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.763163+0000","last_change":"2024-08-17T02:24:23.754746+0000","last_active":"2024-08-17T02:24:23.763163+0000","last_peered":"2024-08-17T02:24:23.763163+0000","last_clean":"2024-08-17T02:24:23.763163+0000","last_became_active":"2024-08-17T02:24:23.754088+0000","last_became_peered":"2024-08-17T02:24:23.754088+0000","last_unstale":"2024-08-17T02:24:23.763163+0000","last_undegraded":"2024-08-17T02:24:23.763163+0000","last_fullsized":"2024-08-17T02:24:23.763163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:14:53.912320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.753806+0000","last_change":"2024-08-17T02:24:23.748418+0000","last_active":"2024-08-17T02:24:23.753806+0000","last_peered":"2024-08-17T02:24:23.753806+0000","last_clean":"2024-08-17T02:24:23.753806+0000","last_became_active":"2024-08-17T02:24:23.748154+0000","last_became_peered":"2024-08-17T02:24:23.748154+0000","last_unstale":"2024-08-17T02:24:23.753806+0000","last_undegraded":"2024-08-17T02:24:23.753806+0000","last_fullsized":"2024-08-17T02:24:23.753806+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:34:34.721761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.742187+0000","last_change":"2024-08-17T02:24:23.742187+0000","last_active":"2024-08-17T02:24:23.742187+0000","last_peered":"2024-08-17T02:24:23.742187+0000","last_clean":"2024-08-17T02:24:23.742187+0000","last_became_active":"2024-08-17T02:24:23.741951+0000","last_became_peered":"2024-08-17T02:24:23.741951+0000","last_unstale":"2024-08-17T02:24:23.742187+0000","last_undegraded":"2024-08-17T02:24:23.742187+0000","last_fullsized":"2024-08-17T02:24:23.742187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:42.224525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.748311+0000","last_change":"2024-08-17T02:24:23.748311+0000","last_active":"2024-08-17T02:24:23.748311+0000","last_peered":"2024-08-17T02:24:23.748311+0000","last_clean":"2024-08-17T02:24:23.748311+0000","last_became_active":"2024-08-17T02:24:23.747380+0000","last_became_peered":"2024-08-17T02:24:23.747380+0000","last_unstale":"2024-08-17T02:24:23.748311+0000","last_undegraded":"2024-08-17T02:24:23.748311+0000","last_fullsized":"2024-08-17T02:24:23.748311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:02:16.400838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.759152+0000","last_change":"2024-08-17T02:24:23.748803+0000","last_active":"2024-08-17T02:24:23.759152+0000","last_peered":"2024-08-17T02:24:23.759152+0000","last_clean":"2024-08-17T02:24:23.759152+0000","last_became_active":"2024-08-17T02:24:23.748523+0000","last_became_peered":"2024-08-17T02:24:23.748523+0000","last_unstale":"2024-08-17T02:24:23.759152+0000","last_undegraded":"2024-08-17T02:24:23.759152+0000","last_fullsized":"2024-08-17T02:24:23.759152+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:43.227359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.747381+0000","last_change":"2024-08-17T02:24:23.742018+0000","last_active":"2024-08-17T02:24:23.747381+0000","last_peered":"2024-08-17T02:24:23.747381+0000","last_clean":"2024-08-17T02:24:23.747381+0000","last_became_active":"2024-08-17T02:24:23.741565+0000","last_became_peered":"2024-08-17T02:24:23.741565+0000","last_unstale":"2024-08-17T02:24:23.747381+0000","last_undegraded":"2024-08-17T02:24:23.747381+0000","last_fullsized":"2024-08-17T02:24:23.747381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:28:51.875416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.745061+0000","last_change":"2024-08-17T02:24:23.735817+0000","last_active":"2024-08-17T02:24:23.745061+0000","last_peered":"2024-08-17T02:24:23.745061+0000","last_clean":"2024-08-17T02:24:23.745061+0000","last_became_active":"2024-08-17T02:24:23.735541+0000","last_became_peered":"2024-08-17T02:24:23.735541+0000","last_unstale":"2024-08-17T02:24:23.745061+0000","last_undegraded":"2024-08-17T02:24:23.745061+0000","last_fullsized":"2024-08-17T02:24:23.745061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:43.227359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.749059+0000","last_change":"2024-08-17T02:24:23.749059+0000","last_active":"2024-08-17T02:24:23.749059+0000","last_peered":"2024-08-17T02:24:23.749059+0000","last_clean":"2024-08-17T02:24:23.749059+0000","last_became_active":"2024-08-17T02:24:23.748759+0000","last_became_peered":"2024-08-17T02:24:23.748759+0000","last_unstale":"2024-08-17T02:24:23.749059+0000","last_undegraded":"2024-08-17T02:24:23.749059+0000","last_fullsized":"2024-08-17T02:24:23.749059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:26.380538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.756686+0000","last_change":"2024-08-17T02:24:23.756686+0000","last_active":"2024-08-17T02:24:23.756686+0000","last_peered":"2024-08-17T02:24:23.756686+0000","last_clean":"2024-08-17T02:24:23.756686+0000","last_became_active":"2024-08-17T02:24:23.756392+0000","last_became_peered":"2024-08-17T02:24:23.756392+0000","last_unstale":"2024-08-17T02:24:23.756686+0000","last_undegraded":"2024-08-17T02:24:23.756686+0000","last_fullsized":"2024-08-17T02:24:23.756686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:10.116414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.753488+0000","last_change":"2024-08-17T02:24:23.750055+0000","last_active":"2024-08-17T02:24:23.753488+0000","last_peered":"2024-08-17T02:24:23.753488+0000","last_clean":"2024-08-17T02:24:23.753488+0000","last_became_active":"2024-08-17T02:24:23.749762+0000","last_became_peered":"2024-08-17T02:24:23.749762+0000","last_unstale":"2024-08-17T02:24:23.753488+0000","last_undegraded":"2024-08-17T02:24:23.753488+0000","last_fullsized":"2024-08-17T02:24:23.753488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:25:00.964150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.753660+0000","last_change":"2024-08-17T02:24:23.748834+0000","last_active":"2024-08-17T02:24:23.753660+0000","last_peered":"2024-08-17T02:24:23.753660+0000","last_clean":"2024-08-17T02:24:23.753660+0000","last_became_active":"2024-08-17T02:24:23.748545+0000","last_became_peered":"2024-08-17T02:24:23.748545+0000","last_unstale":"2024-08-17T02:24:23.753660+0000","last_undegraded":"2024-08-17T02:24:23.753660+0000","last_fullsized":"2024-08-17T02:24:23.753660+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:47:32.978182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.737361+0000","last_change":"2024-08-17T02:24:23.737361+0000","last_active":"2024-08-17T02:24:23.737361+0000","last_peered":"2024-08-17T02:24:23.737361+0000","last_clean":"2024-08-17T02:24:23.737361+0000","last_became_active":"2024-08-17T02:24:23.737083+0000","last_became_peered":"2024-08-17T02:24:23.737083+0000","last_unstale":"2024-08-17T02:24:23.737361+0000","last_undegraded":"2024-08-17T02:24:23.737361+0000","last_fullsized":"2024-08-17T02:24:23.737361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:59.763928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.761474+0000","last_change":"2024-08-17T02:24:23.754894+0000","last_active":"2024-08-17T02:24:23.761474+0000","last_peered":"2024-08-17T02:24:23.761474+0000","last_clean":"2024-08-17T02:24:23.761474+0000","last_became_active":"2024-08-17T02:24:23.749193+0000","last_became_peered":"2024-08-17T02:24:23.749193+0000","last_unstale":"2024-08-17T02:24:23.761474+0000","last_undegraded":"2024-08-17T02:24:23.761474+0000","last_fullsized":"2024-08-17T02:24:23.761474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:28:51.875416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.749680+0000","last_change":"2024-08-17T02:24:23.743606+0000","last_active":"2024-08-17T02:24:23.749680+0000","last_peered":"2024-08-17T02:24:23.749680+0000","last_clean":"2024-08-17T02:24:23.749680+0000","last_became_active":"2024-08-17T02:24:23.743101+0000","last_became_peered":"2024-08-17T02:24:23.743101+0000","last_unstale":"2024-08-17T02:24:23.749680+0000","last_undegraded":"2024-08-17T02:24:23.749680+0000","last_fullsized":"2024-08-17T02:24:23.749680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:46:20.760004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.753468+0000","last_change":"2024-08-17T02:24:23.750577+0000","last_active":"2024-08-17T02:24:23.753468+0000","last_peered":"2024-08-17T02:24:23.753468+0000","last_clean":"2024-08-17T02:24:23.753468+0000","last_became_active":"2024-08-17T02:24:23.749499+0000","last_became_peered":"2024-08-17T02:24:23.749499+0000","last_unstale":"2024-08-17T02:24:23.753468+0000","last_undegraded":"2024-08-17T02:24:23.753468+0000","last_fullsized":"2024-08-17T02:24:23.753468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:47:32.978182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.747524+0000","last_change":"2024-08-17T02:24:23.740065+0000","last_active":"2024-08-17T02:24:23.747524+0000","last_peered":"2024-08-17T02:24:23.747524+0000","last_clean":"2024-08-17T02:24:23.747524+0000","last_became_active":"2024-08-17T02:24:23.739819+0000","last_became_peered":"2024-08-17T02:24:23.739819+0000","last_unstale":"2024-08-17T02:24:23.747524+0000","last_undegraded":"2024-08-17T02:24:23.747524+0000","last_fullsized":"2024-08-17T02:24:23.747524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:39:42.983738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.763201+0000","last_change":"2024-08-17T02:24:23.757764+0000","last_active":"2024-08-17T02:24:23.763201+0000","last_peered":"2024-08-17T02:24:23.763201+0000","last_clean":"2024-08-17T02:24:23.763201+0000","last_became_active":"2024-08-17T02:24:23.754549+0000","last_became_peered":"2024-08-17T02:24:23.754549+0000","last_unstale":"2024-08-17T02:24:23.763201+0000","last_undegraded":"2024-08-17T02:24:23.763201+0000","last_fullsized":"2024-08-17T02:24:23.763201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:06:22.129551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.761374+0000","last_change":"2024-08-17T02:24:23.754145+0000","last_active":"2024-08-17T02:24:23.761374+0000","last_peered":"2024-08-17T02:24:23.761374+0000","last_clean":"2024-08-17T02:24:23.761374+0000","last_became_active":"2024-08-17T02:24:23.753754+0000","last_became_peered":"2024-08-17T02:24:23.753754+0000","last_unstale":"2024-08-17T02:24:23.761374+0000","last_undegraded":"2024-08-17T02:24:23.761374+0000","last_fullsized":"2024-08-17T02:24:23.761374+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:47:35.260059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.737152+0000","last_change":"2024-08-17T02:24:23.737152+0000","last_active":"2024-08-17T02:24:23.737152+0000","last_peered":"2024-08-17T02:24:23.737152+0000","last_clean":"2024-08-17T02:24:23.737152+0000","last_became_active":"2024-08-17T02:24:23.736857+0000","last_became_peered":"2024-08-17T02:24:23.736857+0000","last_unstale":"2024-08-17T02:24:23.737152+0000","last_undegraded":"2024-08-17T02:24:23.737152+0000","last_fullsized":"2024-08-17T02:24:23.737152+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:25:45.136668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.733807+0000","last_change":"2024-08-17T02:24:23.733807+0000","last_active":"2024-08-17T02:24:23.733807+0000","last_peered":"2024-08-17T02:24:23.733807+0000","last_clean":"2024-08-17T02:24:23.733807+0000","last_became_active":"2024-08-17T02:24:23.733480+0000","last_became_peered":"2024-08-17T02:24:23.733480+0000","last_unstale":"2024-08-17T02:24:23.733807+0000","last_undegraded":"2024-08-17T02:24:23.733807+0000","last_fullsized":"2024-08-17T02:24:23.733807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:51:41.360019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.759325+0000","last_change":"2024-08-17T02:24:23.759325+0000","last_active":"2024-08-17T02:24:23.759325+0000","last_peered":"2024-08-17T02:24:23.759325+0000","last_clean":"2024-08-17T02:24:23.759325+0000","last_became_active":"2024-08-17T02:24:23.759023+0000","last_became_peered":"2024-08-17T02:24:23.759023+0000","last_unstale":"2024-08-17T02:24:23.759325+0000","last_undegraded":"2024-08-17T02:24:23.759325+0000","last_fullsized":"2024-08-17T02:24:23.759325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:20:03.013029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.729341+0000","last_change":"2024-08-17T02:24:23.726546+0000","last_active":"2024-08-17T02:24:23.729341+0000","last_peered":"2024-08-17T02:24:23.729341+0000","last_clean":"2024-08-17T02:24:23.729341+0000","last_became_active":"2024-08-17T02:24:23.726261+0000","last_became_peered":"2024-08-17T02:24:23.726261+0000","last_unstale":"2024-08-17T02:24:23.729341+0000","last_undegraded":"2024-08-17T02:24:23.729341+0000","last_fullsized":"2024-08-17T02:24:23.729341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:15:34.819566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.749699+0000","last_change":"2024-08-17T02:24:23.741784+0000","last_active":"2024-08-17T02:24:23.749699+0000","last_peered":"2024-08-17T02:24:23.749699+0000","last_clean":"2024-08-17T02:24:23.749699+0000","last_became_active":"2024-08-17T02:24:23.741513+0000","last_became_peered":"2024-08-17T02:24:23.741513+0000","last_unstale":"2024-08-17T02:24:23.749699+0000","last_undegraded":"2024-08-17T02:24:23.749699+0000","last_fullsized":"2024-08-17T02:24:23.749699+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:43.227359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.750262+0000","last_change":"2024-08-17T02:24:23.750262+0000","last_active":"2024-08-17T02:24:23.750262+0000","last_peered":"2024-08-17T02:24:23.750262+0000","last_clean":"2024-08-17T02:24:23.750262+0000","last_became_active":"2024-08-17T02:24:23.749971+0000","last_became_peered":"2024-08-17T02:24:23.749971+0000","last_unstale":"2024-08-17T02:24:23.750262+0000","last_undegraded":"2024-08-17T02:24:23.750262+0000","last_fullsized":"2024-08-17T02:24:23.750262+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:03:53.684995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.763183+0000","last_change":"2024-08-17T02:24:23.755452+0000","last_active":"2024-08-17T02:24:23.763183+0000","last_peered":"2024-08-17T02:24:23.763183+0000","last_clean":"2024-08-17T02:24:23.763183+0000","last_became_active":"2024-08-17T02:24:23.754319+0000","last_became_peered":"2024-08-17T02:24:23.754319+0000","last_unstale":"2024-08-17T02:24:23.763183+0000","last_undegraded":"2024-08-17T02:24:23.763183+0000","last_fullsized":"2024-08-17T02:24:23.763183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:14.615283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.741640+0000","last_change":"2024-08-17T02:24:23.741640+0000","last_active":"2024-08-17T02:24:23.741640+0000","last_peered":"2024-08-17T02:24:23.741640+0000","last_clean":"2024-08-17T02:24:23.741640+0000","last_became_active":"2024-08-17T02:24:23.741362+0000","last_became_peered":"2024-08-17T02:24:23.741362+0000","last_unstale":"2024-08-17T02:24:23.741640+0000","last_undegraded":"2024-08-17T02:24:23.741640+0000","last_fullsized":"2024-08-17T02:24:23.741640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:25:00.964150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.746369+0000","last_change":"2024-08-17T02:24:23.737686+0000","last_active":"2024-08-17T02:24:23.746369+0000","last_peered":"2024-08-17T02:24:23.746369+0000","last_clean":"2024-08-17T02:24:23.746369+0000","last_became_active":"2024-08-17T02:24:23.737433+0000","last_became_peered":"2024-08-17T02:24:23.737433+0000","last_unstale":"2024-08-17T02:24:23.746369+0000","last_undegraded":"2024-08-17T02:24:23.746369+0000","last_fullsized":"2024-08-17T02:24:23.746369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:49:55.156739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.750702+0000","last_change":"2024-08-17T02:24:23.750702+0000","last_active":"2024-08-17T02:24:23.750702+0000","last_peered":"2024-08-17T02:24:23.750702+0000","last_clean":"2024-08-17T02:24:23.750702+0000","last_became_active":"2024-08-17T02:24:23.750428+0000","last_became_peered":"2024-08-17T02:24:23.750428+0000","last_unstale":"2024-08-17T02:24:23.750702+0000","last_undegraded":"2024-08-17T02:24:23.750702+0000","last_fullsized":"2024-08-17T02:24:23.750702+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:42.224525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.745826+0000","last_change":"2024-08-17T02:24:23.737691+0000","last_active":"2024-08-17T02:24:23.745826+0000","last_peered":"2024-08-17T02:24:23.745826+0000","last_clean":"2024-08-17T02:24:23.745826+0000","last_became_active":"2024-08-17T02:24:23.737415+0000","last_became_peered":"2024-08-17T02:24:23.737415+0000","last_unstale":"2024-08-17T02:24:23.745826+0000","last_undegraded":"2024-08-17T02:24:23.745826+0000","last_fullsized":"2024-08-17T02:24:23.745826+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:46:20.760004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.736481+0000","last_change":"2024-08-17T02:24:23.736481+0000","last_active":"2024-08-17T02:24:23.736481+0000","last_peered":"2024-08-17T02:24:23.736481+0000","last_clean":"2024-08-17T02:24:23.736481+0000","last_became_active":"2024-08-17T02:24:23.736084+0000","last_became_peered":"2024-08-17T02:24:23.736084+0000","last_unstale":"2024-08-17T02:24:23.736481+0000","last_undegraded":"2024-08-17T02:24:23.736481+0000","last_fullsized":"2024-08-17T02:24:23.736481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:12:48.697155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.745044+0000","last_change":"2024-08-17T02:24:23.732520+0000","last_active":"2024-08-17T02:24:23.745044+0000","last_peered":"2024-08-17T02:24:23.745044+0000","last_clean":"2024-08-17T02:24:23.745044+0000","last_became_active":"2024-08-17T02:24:23.731995+0000","last_became_peered":"2024-08-17T02:24:23.731995+0000","last_unstale":"2024-08-17T02:24:23.745044+0000","last_undegraded":"2024-08-17T02:24:23.745044+0000","last_fullsized":"2024-08-17T02:24:23.745044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:34:34.721761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.732585+0000","last_change":"2024-08-17T02:24:23.729673+0000","last_active":"2024-08-17T02:24:23.732585+0000","last_peered":"2024-08-17T02:24:23.732585+0000","last_clean":"2024-08-17T02:24:23.732585+0000","last_became_active":"2024-08-17T02:24:23.729435+0000","last_became_peered":"2024-08-17T02:24:23.729435+0000","last_unstale":"2024-08-17T02:24:23.732585+0000","last_undegraded":"2024-08-17T02:24:23.732585+0000","last_fullsized":"2024-08-17T02:24:23.732585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:42.224525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.752074+0000","last_change":"2024-08-17T02:24:22.737156+0000","last_active":"2024-08-17T02:24:23.752074+0000","last_peered":"2024-08-17T02:24:23.752074+0000","last_clean":"2024-08-17T02:24:23.752074+0000","last_became_active":"2024-08-17T02:24:22.736766+0000","last_became_peered":"2024-08-17T02:24:22.736766+0000","last_unstale":"2024-08-17T02:24:23.752074+0000","last_undegraded":"2024-08-17T02:24:23.752074+0000","last_fullsized":"2024-08-17T02:24:23.752074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:58.753958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.741627+0000","last_change":"2024-08-17T02:24:23.741627+0000","last_active":"2024-08-17T02:24:23.741627+0000","last_peered":"2024-08-17T02:24:23.741627+0000","last_clean":"2024-08-17T02:24:23.741627+0000","last_became_active":"2024-08-17T02:24:23.741377+0000","last_became_peered":"2024-08-17T02:24:23.741377+0000","last_unstale":"2024-08-17T02:24:23.741627+0000","last_undegraded":"2024-08-17T02:24:23.741627+0000","last_fullsized":"2024-08-17T02:24:23.741627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:03:53.684995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.754163+0000","last_change":"2024-08-17T02:24:22.733826+0000","last_active":"2024-08-17T02:24:23.754163+0000","last_peered":"2024-08-17T02:24:23.754163+0000","last_clean":"2024-08-17T02:24:23.754163+0000","last_became_active":"2024-08-17T02:24:22.733611+0000","last_became_peered":"2024-08-17T02:24:22.733611+0000","last_unstale":"2024-08-17T02:24:23.754163+0000","last_undegraded":"2024-08-17T02:24:23.754163+0000","last_fullsized":"2024-08-17T02:24:23.754163+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:23:14.788483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.750120+0000","last_change":"2024-08-17T02:24:23.750120+0000","last_active":"2024-08-17T02:24:23.750120+0000","last_peered":"2024-08-17T02:24:23.750120+0000","last_clean":"2024-08-17T02:24:23.750120+0000","last_became_active":"2024-08-17T02:24:23.749839+0000","last_became_peered":"2024-08-17T02:24:23.749839+0000","last_unstale":"2024-08-17T02:24:23.750120+0000","last_undegraded":"2024-08-17T02:24:23.750120+0000","last_fullsized":"2024-08-17T02:24:23.750120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:14:36.422342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.761700+0000","last_change":"2024-08-17T02:24:22.743348+0000","last_active":"2024-08-17T02:24:23.761700+0000","last_peered":"2024-08-17T02:24:23.761700+0000","last_clean":"2024-08-17T02:24:23.761700+0000","last_became_active":"2024-08-17T02:24:22.743067+0000","last_became_peered":"2024-08-17T02:24:22.743067+0000","last_unstale":"2024-08-17T02:24:23.761700+0000","last_undegraded":"2024-08-17T02:24:23.761700+0000","last_fullsized":"2024-08-17T02:24:23.761700+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:03:52.675025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.743720+0000","last_change":"2024-08-17T02:24:23.743720+0000","last_active":"2024-08-17T02:24:23.743720+0000","last_peered":"2024-08-17T02:24:23.743720+0000","last_clean":"2024-08-17T02:24:23.743720+0000","last_became_active":"2024-08-17T02:24:23.739921+0000","last_became_peered":"2024-08-17T02:24:23.739921+0000","last_unstale":"2024-08-17T02:24:23.743720+0000","last_undegraded":"2024-08-17T02:24:23.743720+0000","last_fullsized":"2024-08-17T02:24:23.743720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:14:36.422342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.755026+0000","last_change":"2024-08-17T02:24:22.738509+0000","last_active":"2024-08-17T02:24:23.755026+0000","last_peered":"2024-08-17T02:24:23.755026+0000","last_clean":"2024-08-17T02:24:23.755026+0000","last_became_active":"2024-08-17T02:24:22.738148+0000","last_became_peered":"2024-08-17T02:24:22.738148+0000","last_unstale":"2024-08-17T02:24:23.755026+0000","last_undegraded":"2024-08-17T02:24:23.755026+0000","last_fullsized":"2024-08-17T02:24:23.755026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:34:49.589657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.747469+0000","last_change":"2024-08-17T02:24:23.742559+0000","last_active":"2024-08-17T02:24:23.747469+0000","last_peered":"2024-08-17T02:24:23.747469+0000","last_clean":"2024-08-17T02:24:23.747469+0000","last_became_active":"2024-08-17T02:24:23.742176+0000","last_became_peered":"2024-08-17T02:24:23.742176+0000","last_unstale":"2024-08-17T02:24:23.747469+0000","last_undegraded":"2024-08-17T02:24:23.747469+0000","last_fullsized":"2024-08-17T02:24:23.747469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:10.116414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.729490+0000","last_change":"2024-08-17T02:24:22.745981+0000","last_active":"2024-08-17T02:24:23.729490+0000","last_peered":"2024-08-17T02:24:23.729490+0000","last_clean":"2024-08-17T02:24:23.729490+0000","last_became_active":"2024-08-17T02:24:22.745385+0000","last_became_peered":"2024-08-17T02:24:22.745385+0000","last_unstale":"2024-08-17T02:24:23.729490+0000","last_undegraded":"2024-08-17T02:24:23.729490+0000","last_fullsized":"2024-08-17T02:24:23.729490+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:43:02.800534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.735999+0000","last_change":"2024-08-17T02:24:23.731998+0000","last_active":"2024-08-17T02:24:23.735999+0000","last_peered":"2024-08-17T02:24:23.735999+0000","last_clean":"2024-08-17T02:24:23.735999+0000","last_became_active":"2024-08-17T02:24:23.731720+0000","last_became_peered":"2024-08-17T02:24:23.731720+0000","last_unstale":"2024-08-17T02:24:23.735999+0000","last_undegraded":"2024-08-17T02:24:23.735999+0000","last_fullsized":"2024-08-17T02:24:23.735999+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:39:42.983738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.729002+0000","last_change":"2024-08-17T02:24:22.741383+0000","last_active":"2024-08-17T02:24:23.729002+0000","last_peered":"2024-08-17T02:24:23.729002+0000","last_clean":"2024-08-17T02:24:23.729002+0000","last_became_active":"2024-08-17T02:24:22.741114+0000","last_became_peered":"2024-08-17T02:24:22.741114+0000","last_unstale":"2024-08-17T02:24:23.729002+0000","last_undegraded":"2024-08-17T02:24:23.729002+0000","last_fullsized":"2024-08-17T02:24:23.729002+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:22:39.132246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.738005+0000","last_change":"2024-08-17T02:24:23.738005+0000","last_active":"2024-08-17T02:24:23.738005+0000","last_peered":"2024-08-17T02:24:23.738005+0000","last_clean":"2024-08-17T02:24:23.738005+0000","last_became_active":"2024-08-17T02:24:23.737761+0000","last_became_peered":"2024-08-17T02:24:23.737761+0000","last_unstale":"2024-08-17T02:24:23.738005+0000","last_undegraded":"2024-08-17T02:24:23.738005+0000","last_fullsized":"2024-08-17T02:24:23.738005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:12:48.697155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.734012+0000","last_change":"2024-08-17T02:24:22.737771+0000","last_active":"2024-08-17T02:24:23.734012+0000","last_peered":"2024-08-17T02:24:23.734012+0000","last_clean":"2024-08-17T02:24:23.734012+0000","last_became_active":"2024-08-17T02:24:22.736301+0000","last_became_peered":"2024-08-17T02:24:22.736301+0000","last_unstale":"2024-08-17T02:24:23.734012+0000","last_undegraded":"2024-08-17T02:24:23.734012+0000","last_fullsized":"2024-08-17T02:24:23.734012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:25.370569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.739228+0000","last_change":"2024-08-17T02:24:23.739228+0000","last_active":"2024-08-17T02:24:23.739228+0000","last_peered":"2024-08-17T02:24:23.739228+0000","last_clean":"2024-08-17T02:24:23.739228+0000","last_became_active":"2024-08-17T02:24:23.738393+0000","last_became_peered":"2024-08-17T02:24:23.738393+0000","last_unstale":"2024-08-17T02:24:23.739228+0000","last_undegraded":"2024-08-17T02:24:23.739228+0000","last_fullsized":"2024-08-17T02:24:23.739228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:26.380538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:24:22.738686+0000","last_change":"2024-08-17T02:24:22.733404+0000","last_active":"2024-08-17T02:24:22.738686+0000","last_peered":"2024-08-17T02:24:22.738686+0000","last_clean":"2024-08-17T02:24:22.738686+0000","last_became_active":"2024-08-17T02:24:22.733149+0000","last_became_peered":"2024-08-17T02:24:22.733149+0000","last_unstale":"2024-08-17T02:24:22.738686+0000","last_undegraded":"2024-08-17T02:24:22.738686+0000","last_fullsized":"2024-08-17T02:24:22.738686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:03:18.416445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.757504+0000","last_change":"2024-08-17T02:24:23.756609+0000","last_active":"2024-08-17T02:24:23.757504+0000","last_peered":"2024-08-17T02:24:23.757504+0000","last_clean":"2024-08-17T02:24:23.757504+0000","last_became_active":"2024-08-17T02:24:23.756368+0000","last_became_peered":"2024-08-17T02:24:23.756368+0000","last_unstale":"2024-08-17T02:24:23.757504+0000","last_undegraded":"2024-08-17T02:24:23.757504+0000","last_fullsized":"2024-08-17T02:24:23.757504+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:05.656289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.731821+0000","last_change":"2024-08-17T02:24:22.742118+0000","last_active":"2024-08-17T02:24:23.731821+0000","last_peered":"2024-08-17T02:24:23.731821+0000","last_clean":"2024-08-17T02:24:23.731821+0000","last_became_active":"2024-08-17T02:24:22.740691+0000","last_became_peered":"2024-08-17T02:24:22.740691+0000","last_unstale":"2024-08-17T02:24:23.731821+0000","last_undegraded":"2024-08-17T02:24:23.731821+0000","last_fullsized":"2024-08-17T02:24:23.731821+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:44.461344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.761421+0000","last_change":"2024-08-17T02:24:23.753927+0000","last_active":"2024-08-17T02:24:23.761421+0000","last_peered":"2024-08-17T02:24:23.761421+0000","last_clean":"2024-08-17T02:24:23.761421+0000","last_became_active":"2024-08-17T02:24:23.753561+0000","last_became_peered":"2024-08-17T02:24:23.753561+0000","last_unstale":"2024-08-17T02:24:23.761421+0000","last_undegraded":"2024-08-17T02:24:23.761421+0000","last_fullsized":"2024-08-17T02:24:23.761421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:56:18.273049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.719878+0000","last_change":"2024-08-17T02:24:22.744037+0000","last_active":"2024-08-17T02:24:23.719878+0000","last_peered":"2024-08-17T02:24:23.719878+0000","last_clean":"2024-08-17T02:24:23.719878+0000","last_became_active":"2024-08-17T02:24:22.743749+0000","last_became_peered":"2024-08-17T02:24:22.743749+0000","last_unstale":"2024-08-17T02:24:23.719878+0000","last_undegraded":"2024-08-17T02:24:23.719878+0000","last_fullsized":"2024-08-17T02:24:23.719878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:02:15.390868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.759274+0000","last_change":"2024-08-17T02:24:23.749232+0000","last_active":"2024-08-17T02:24:23.759274+0000","last_peered":"2024-08-17T02:24:23.759274+0000","last_clean":"2024-08-17T02:24:23.759274+0000","last_became_active":"2024-08-17T02:24:23.748981+0000","last_became_peered":"2024-08-17T02:24:23.748981+0000","last_unstale":"2024-08-17T02:24:23.759274+0000","last_undegraded":"2024-08-17T02:24:23.759274+0000","last_fullsized":"2024-08-17T02:24:23.759274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:41.566939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.750491+0000","last_change":"2024-08-17T02:24:22.735686+0000","last_active":"2024-08-17T02:24:23.750491+0000","last_peered":"2024-08-17T02:24:23.750491+0000","last_clean":"2024-08-17T02:24:23.750491+0000","last_became_active":"2024-08-17T02:24:22.735370+0000","last_became_peered":"2024-08-17T02:24:22.735370+0000","last_unstale":"2024-08-17T02:24:23.750491+0000","last_undegraded":"2024-08-17T02:24:23.750491+0000","last_fullsized":"2024-08-17T02:24:23.750491+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:44.461344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.753823+0000","last_change":"2024-08-17T02:24:23.748538+0000","last_active":"2024-08-17T02:24:23.753823+0000","last_peered":"2024-08-17T02:24:23.753823+0000","last_clean":"2024-08-17T02:24:23.753823+0000","last_became_active":"2024-08-17T02:24:23.748241+0000","last_became_peered":"2024-08-17T02:24:23.748241+0000","last_unstale":"2024-08-17T02:24:23.753823+0000","last_undegraded":"2024-08-17T02:24:23.753823+0000","last_fullsized":"2024-08-17T02:24:23.753823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:28:51.875416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.765337+0000","last_change":"2024-08-17T02:24:22.744426+0000","last_active":"2024-08-17T02:24:23.765337+0000","last_peered":"2024-08-17T02:24:23.765337+0000","last_clean":"2024-08-17T02:24:23.765337+0000","last_became_active":"2024-08-17T02:24:22.744134+0000","last_became_peered":"2024-08-17T02:24:22.744134+0000","last_unstale":"2024-08-17T02:24:23.765337+0000","last_undegraded":"2024-08-17T02:24:23.765337+0000","last_fullsized":"2024-08-17T02:24:23.765337+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:41.214555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.745343+0000","last_change":"2024-08-17T02:24:23.745343+0000","last_active":"2024-08-17T02:24:23.745343+0000","last_peered":"2024-08-17T02:24:23.745343+0000","last_clean":"2024-08-17T02:24:23.745343+0000","last_became_active":"2024-08-17T02:24:23.745161+0000","last_became_peered":"2024-08-17T02:24:23.745161+0000","last_unstale":"2024-08-17T02:24:23.745343+0000","last_undegraded":"2024-08-17T02:24:23.745343+0000","last_fullsized":"2024-08-17T02:24:23.745343+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:20:03.013029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.752003+0000","last_change":"2024-08-17T02:24:22.738453+0000","last_active":"2024-08-17T02:24:23.752003+0000","last_peered":"2024-08-17T02:24:23.752003+0000","last_clean":"2024-08-17T02:24:23.752003+0000","last_became_active":"2024-08-17T02:24:22.738196+0000","last_became_peered":"2024-08-17T02:24:22.738196+0000","last_unstale":"2024-08-17T02:24:23.752003+0000","last_undegraded":"2024-08-17T02:24:23.752003+0000","last_fullsized":"2024-08-17T02:24:23.752003+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:44.165143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.761488+0000","last_change":"2024-08-17T02:24:23.755010+0000","last_active":"2024-08-17T02:24:23.761488+0000","last_peered":"2024-08-17T02:24:23.761488+0000","last_clean":"2024-08-17T02:24:23.761488+0000","last_became_active":"2024-08-17T02:24:23.754747+0000","last_became_peered":"2024-08-17T02:24:23.754747+0000","last_unstale":"2024-08-17T02:24:23.761488+0000","last_undegraded":"2024-08-17T02:24:23.761488+0000","last_fullsized":"2024-08-17T02:24:23.761488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:39:42.983738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:24:22.740184+0000","last_change":"2024-08-17T02:24:22.731757+0000","last_active":"2024-08-17T02:24:22.740184+0000","last_peered":"2024-08-17T02:24:22.740184+0000","last_clean":"2024-08-17T02:24:22.740184+0000","last_became_active":"2024-08-17T02:24:22.731086+0000","last_became_peered":"2024-08-17T02:24:22.731086+0000","last_unstale":"2024-08-17T02:24:22.740184+0000","last_undegraded":"2024-08-17T02:24:22.740184+0000","last_fullsized":"2024-08-17T02:24:22.740184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:39:10.244175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.745026+0000","last_change":"2024-08-17T02:24:23.732314+0000","last_active":"2024-08-17T02:24:23.745026+0000","last_peered":"2024-08-17T02:24:23.745026+0000","last_clean":"2024-08-17T02:24:23.745026+0000","last_became_active":"2024-08-17T02:24:23.731598+0000","last_became_peered":"2024-08-17T02:24:23.731598+0000","last_unstale":"2024-08-17T02:24:23.745026+0000","last_undegraded":"2024-08-17T02:24:23.745026+0000","last_fullsized":"2024-08-17T02:24:23.745026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:06:58.770100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.733914+0000","last_change":"2024-08-17T02:24:22.740500+0000","last_active":"2024-08-17T02:24:23.733914+0000","last_peered":"2024-08-17T02:24:23.733914+0000","last_clean":"2024-08-17T02:24:23.733914+0000","last_became_active":"2024-08-17T02:24:22.740070+0000","last_became_peered":"2024-08-17T02:24:22.740070+0000","last_unstale":"2024-08-17T02:24:23.733914+0000","last_undegraded":"2024-08-17T02:24:23.733914+0000","last_fullsized":"2024-08-17T02:24:23.733914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:15:33.809597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.741465+0000","last_change":"2024-08-17T02:24:23.741465+0000","last_active":"2024-08-17T02:24:23.741465+0000","last_peered":"2024-08-17T02:24:23.741465+0000","last_clean":"2024-08-17T02:24:23.741465+0000","last_became_active":"2024-08-17T02:24:23.741165+0000","last_became_peered":"2024-08-17T02:24:23.741165+0000","last_unstale":"2024-08-17T02:24:23.741465+0000","last_undegraded":"2024-08-17T02:24:23.741465+0000","last_fullsized":"2024-08-17T02:24:23.741465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:30:15.345252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.766815+0000","last_change":"2024-08-17T02:24:22.743014+0000","last_active":"2024-08-17T02:24:23.766815+0000","last_peered":"2024-08-17T02:24:23.766815+0000","last_clean":"2024-08-17T02:24:23.766815+0000","last_became_active":"2024-08-17T02:24:22.742697+0000","last_became_peered":"2024-08-17T02:24:22.742697+0000","last_unstale":"2024-08-17T02:24:23.766815+0000","last_undegraded":"2024-08-17T02:24:23.766815+0000","last_fullsized":"2024-08-17T02:24:23.766815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:20:02.003059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.737363+0000","last_change":"2024-08-17T02:24:23.737363+0000","last_active":"2024-08-17T02:24:23.737363+0000","last_peered":"2024-08-17T02:24:23.737363+0000","last_clean":"2024-08-17T02:24:23.737363+0000","last_became_active":"2024-08-17T02:24:23.737066+0000","last_became_peered":"2024-08-17T02:24:23.737066+0000","last_unstale":"2024-08-17T02:24:23.737363+0000","last_undegraded":"2024-08-17T02:24:23.737363+0000","last_fullsized":"2024-08-17T02:24:23.737363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:03:53.684995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.739800+0000","last_change":"2024-08-17T02:24:22.745381+0000","last_active":"2024-08-17T02:24:23.739800+0000","last_peered":"2024-08-17T02:24:23.739800+0000","last_clean":"2024-08-17T02:24:23.739800+0000","last_became_active":"2024-08-17T02:24:22.744883+0000","last_became_peered":"2024-08-17T02:24:22.744883+0000","last_unstale":"2024-08-17T02:24:23.739800+0000","last_undegraded":"2024-08-17T02:24:23.739800+0000","last_fullsized":"2024-08-17T02:24:23.739800+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:43.224799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.749193+0000","last_change":"2024-08-17T02:24:23.740791+0000","last_active":"2024-08-17T02:24:23.749193+0000","last_peered":"2024-08-17T02:24:23.749193+0000","last_clean":"2024-08-17T02:24:23.749193+0000","last_became_active":"2024-08-17T02:24:23.740524+0000","last_became_peered":"2024-08-17T02:24:23.740524+0000","last_unstale":"2024-08-17T02:24:23.749193+0000","last_undegraded":"2024-08-17T02:24:23.749193+0000","last_fullsized":"2024-08-17T02:24:23.749193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:37:20.039928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.751972+0000","last_change":"2024-08-17T02:24:22.740849+0000","last_active":"2024-08-17T02:24:23.751972+0000","last_peered":"2024-08-17T02:24:23.751972+0000","last_clean":"2024-08-17T02:24:23.751972+0000","last_became_active":"2024-08-17T02:24:22.740546+0000","last_became_peered":"2024-08-17T02:24:22.740546+0000","last_unstale":"2024-08-17T02:24:23.751972+0000","last_undegraded":"2024-08-17T02:24:23.751972+0000","last_fullsized":"2024-08-17T02:24:23.751972+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:58.753958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.745443+0000","last_change":"2024-08-17T02:24:23.745443+0000","last_active":"2024-08-17T02:24:23.745443+0000","last_peered":"2024-08-17T02:24:23.745443+0000","last_clean":"2024-08-17T02:24:23.745443+0000","last_became_active":"2024-08-17T02:24:23.742136+0000","last_became_peered":"2024-08-17T02:24:23.742136+0000","last_unstale":"2024-08-17T02:24:23.745443+0000","last_undegraded":"2024-08-17T02:24:23.745443+0000","last_fullsized":"2024-08-17T02:24:23.745443+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:15:34.819566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.729851+0000","last_change":"2024-08-17T02:24:22.743218+0000","last_active":"2024-08-17T02:24:23.729851+0000","last_peered":"2024-08-17T02:24:23.729851+0000","last_clean":"2024-08-17T02:24:23.729851+0000","last_became_active":"2024-08-17T02:24:22.742838+0000","last_became_peered":"2024-08-17T02:24:22.742838+0000","last_unstale":"2024-08-17T02:24:23.729851+0000","last_undegraded":"2024-08-17T02:24:23.729851+0000","last_fullsized":"2024-08-17T02:24:23.729851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:34:49.589657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.742874+0000","last_change":"2024-08-17T02:24:23.742874+0000","last_active":"2024-08-17T02:24:23.742874+0000","last_peered":"2024-08-17T02:24:23.742874+0000","last_clean":"2024-08-17T02:24:23.742874+0000","last_became_active":"2024-08-17T02:24:23.742620+0000","last_became_peered":"2024-08-17T02:24:23.742620+0000","last_unstale":"2024-08-17T02:24:23.742874+0000","last_undegraded":"2024-08-17T02:24:23.742874+0000","last_fullsized":"2024-08-17T02:24:23.742874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:23:15.798453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:24:22.746761+0000","last_change":"2024-08-17T02:24:22.745640+0000","last_active":"2024-08-17T02:24:22.746761+0000","last_peered":"2024-08-17T02:24:22.746761+0000","last_clean":"2024-08-17T02:24:22.746761+0000","last_became_active":"2024-08-17T02:24:22.745365+0000","last_became_peered":"2024-08-17T02:24:22.745365+0000","last_unstale":"2024-08-17T02:24:22.746761+0000","last_undegraded":"2024-08-17T02:24:22.746761+0000","last_fullsized":"2024-08-17T02:24:22.746761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:29:29.959746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.738715+0000","last_change":"2024-08-17T02:24:23.738715+0000","last_active":"2024-08-17T02:24:23.738715+0000","last_peered":"2024-08-17T02:24:23.738715+0000","last_clean":"2024-08-17T02:24:23.738715+0000","last_became_active":"2024-08-17T02:24:23.735222+0000","last_became_peered":"2024-08-17T02:24:23.735222+0000","last_unstale":"2024-08-17T02:24:23.738715+0000","last_undegraded":"2024-08-17T02:24:23.738715+0000","last_fullsized":"2024-08-17T02:24:23.738715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:39:11.254144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.755484+0000","last_change":"2024-08-17T02:24:22.729448+0000","last_active":"2024-08-17T02:24:23.755484+0000","last_peered":"2024-08-17T02:24:23.755484+0000","last_clean":"2024-08-17T02:24:23.755484+0000","last_became_active":"2024-08-17T02:24:22.729075+0000","last_became_peered":"2024-08-17T02:24:22.729075+0000","last_unstale":"2024-08-17T02:24:23.755484+0000","last_undegraded":"2024-08-17T02:24:23.755484+0000","last_fullsized":"2024-08-17T02:24:23.755484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:25.554270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.733148+0000","last_change":"2024-08-17T02:24:23.733148+0000","last_active":"2024-08-17T02:24:23.733148+0000","last_peered":"2024-08-17T02:24:23.733148+0000","last_clean":"2024-08-17T02:24:23.733148+0000","last_became_active":"2024-08-17T02:24:23.732298+0000","last_became_peered":"2024-08-17T02:24:23.732298+0000","last_unstale":"2024-08-17T02:24:23.733148+0000","last_undegraded":"2024-08-17T02:24:23.733148+0000","last_fullsized":"2024-08-17T02:24:23.733148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:35.324498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:24:22.743035+0000","last_change":"2024-08-17T02:24:22.739580+0000","last_active":"2024-08-17T02:24:22.743035+0000","last_peered":"2024-08-17T02:24:22.743035+0000","last_clean":"2024-08-17T02:24:22.743035+0000","last_became_active":"2024-08-17T02:24:22.737821+0000","last_became_peered":"2024-08-17T02:24:22.737821+0000","last_unstale":"2024-08-17T02:24:22.743035+0000","last_undegraded":"2024-08-17T02:24:22.743035+0000","last_fullsized":"2024-08-17T02:24:22.743035+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:43:02.800534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.734427+0000","last_change":"2024-08-17T02:24:23.734427+0000","last_active":"2024-08-17T02:24:23.734427+0000","last_peered":"2024-08-17T02:24:23.734427+0000","last_clean":"2024-08-17T02:24:23.734427+0000","last_became_active":"2024-08-17T02:24:23.734092+0000","last_became_peered":"2024-08-17T02:24:23.734092+0000","last_unstale":"2024-08-17T02:24:23.734427+0000","last_undegraded":"2024-08-17T02:24:23.734427+0000","last_fullsized":"2024-08-17T02:24:23.734427+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:43:03.810504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:24:22.732788+0000","last_change":"2024-08-17T02:24:22.729596+0000","last_active":"2024-08-17T02:24:22.732788+0000","last_peered":"2024-08-17T02:24:22.732788+0000","last_clean":"2024-08-17T02:24:22.732788+0000","last_became_active":"2024-08-17T02:24:22.729228+0000","last_became_peered":"2024-08-17T02:24:22.729228+0000","last_unstale":"2024-08-17T02:24:22.732788+0000","last_undegraded":"2024-08-17T02:24:22.732788+0000","last_fullsized":"2024-08-17T02:24:22.732788+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:21.261277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.747360+0000","last_change":"2024-08-17T02:24:23.741792+0000","last_active":"2024-08-17T02:24:23.747360+0000","last_peered":"2024-08-17T02:24:23.747360+0000","last_clean":"2024-08-17T02:24:23.747360+0000","last_became_active":"2024-08-17T02:24:23.741244+0000","last_became_peered":"2024-08-17T02:24:23.741244+0000","last_unstale":"2024-08-17T02:24:23.747360+0000","last_undegraded":"2024-08-17T02:24:23.747360+0000","last_fullsized":"2024-08-17T02:24:23.747360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:49:55.156739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.722751+0000","last_change":"2024-08-17T02:24:22.737394+0000","last_active":"2024-08-17T02:24:23.722751+0000","last_peered":"2024-08-17T02:24:23.722751+0000","last_clean":"2024-08-17T02:24:23.722751+0000","last_became_active":"2024-08-17T02:24:22.737125+0000","last_became_peered":"2024-08-17T02:24:22.737125+0000","last_unstale":"2024-08-17T02:24:23.722751+0000","last_undegraded":"2024-08-17T02:24:23.722751+0000","last_fullsized":"2024-08-17T02:24:23.722751+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:12:47.687186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.739058+0000","last_change":"2024-08-17T02:24:23.739058+0000","last_active":"2024-08-17T02:24:23.739058+0000","last_peered":"2024-08-17T02:24:23.739058+0000","last_clean":"2024-08-17T02:24:23.739058+0000","last_became_active":"2024-08-17T02:24:23.738781+0000","last_became_peered":"2024-08-17T02:24:23.738781+0000","last_unstale":"2024-08-17T02:24:23.739058+0000","last_undegraded":"2024-08-17T02:24:23.739058+0000","last_fullsized":"2024-08-17T02:24:23.739058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:44.234769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.751996+0000","last_change":"2024-08-17T02:24:22.733379+0000","last_active":"2024-08-17T02:24:23.751996+0000","last_peered":"2024-08-17T02:24:23.751996+0000","last_clean":"2024-08-17T02:24:23.751996+0000","last_became_active":"2024-08-17T02:24:22.733020+0000","last_became_peered":"2024-08-17T02:24:22.733020+0000","last_unstale":"2024-08-17T02:24:23.751996+0000","last_undegraded":"2024-08-17T02:24:23.751996+0000","last_fullsized":"2024-08-17T02:24:23.751996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:25:44.126698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.736040+0000","last_change":"2024-08-17T02:24:23.733788+0000","last_active":"2024-08-17T02:24:23.736040+0000","last_peered":"2024-08-17T02:24:23.736040+0000","last_clean":"2024-08-17T02:24:23.736040+0000","last_became_active":"2024-08-17T02:24:23.733488+0000","last_became_peered":"2024-08-17T02:24:23.733488+0000","last_unstale":"2024-08-17T02:24:23.736040+0000","last_undegraded":"2024-08-17T02:24:23.736040+0000","last_fullsized":"2024-08-17T02:24:23.736040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:06:58.770100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.719789+0000","last_change":"2024-08-17T02:24:22.729858+0000","last_active":"2024-08-17T02:24:23.719789+0000","last_peered":"2024-08-17T02:24:23.719789+0000","last_clean":"2024-08-17T02:24:23.719789+0000","last_became_active":"2024-08-17T02:24:22.729584+0000","last_became_peered":"2024-08-17T02:24:22.729584+0000","last_unstale":"2024-08-17T02:24:23.719789+0000","last_undegraded":"2024-08-17T02:24:23.719789+0000","last_fullsized":"2024-08-17T02:24:23.719789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:51:40.350049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.753289+0000","last_change":"2024-08-17T02:24:23.752470+0000","last_active":"2024-08-17T02:24:23.753289+0000","last_peered":"2024-08-17T02:24:23.753289+0000","last_clean":"2024-08-17T02:24:23.753289+0000","last_became_active":"2024-08-17T02:24:23.752230+0000","last_became_peered":"2024-08-17T02:24:23.752230+0000","last_unstale":"2024-08-17T02:24:23.753289+0000","last_undegraded":"2024-08-17T02:24:23.753289+0000","last_fullsized":"2024-08-17T02:24:23.753289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:26.380538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:24:22.742584+0000","last_change":"2024-08-17T02:24:22.738082+0000","last_active":"2024-08-17T02:24:22.742584+0000","last_peered":"2024-08-17T02:24:22.742584+0000","last_clean":"2024-08-17T02:24:22.742584+0000","last_became_active":"2024-08-17T02:24:22.737829+0000","last_became_peered":"2024-08-17T02:24:22.737829+0000","last_unstale":"2024-08-17T02:24:22.742584+0000","last_undegraded":"2024-08-17T02:24:22.742584+0000","last_fullsized":"2024-08-17T02:24:22.742584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:58.753958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.735175+0000","last_change":"2024-08-17T02:24:23.735175+0000","last_active":"2024-08-17T02:24:23.735175+0000","last_peered":"2024-08-17T02:24:23.735175+0000","last_clean":"2024-08-17T02:24:23.735175+0000","last_became_active":"2024-08-17T02:24:23.734014+0000","last_became_peered":"2024-08-17T02:24:23.734014+0000","last_unstale":"2024-08-17T02:24:23.735175+0000","last_undegraded":"2024-08-17T02:24:23.735175+0000","last_fullsized":"2024-08-17T02:24:23.735175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:45.471313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.719016+0000","last_change":"2024-08-17T02:24:22.732065+0000","last_active":"2024-08-17T02:24:23.719016+0000","last_peered":"2024-08-17T02:24:23.719016+0000","last_clean":"2024-08-17T02:24:23.719016+0000","last_became_active":"2024-08-17T02:24:22.731824+0000","last_became_peered":"2024-08-17T02:24:22.731824+0000","last_unstale":"2024-08-17T02:24:23.719016+0000","last_undegraded":"2024-08-17T02:24:23.719016+0000","last_fullsized":"2024-08-17T02:24:23.719016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:34.314529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.749642+0000","last_change":"2024-08-17T02:24:23.741975+0000","last_active":"2024-08-17T02:24:23.749642+0000","last_peered":"2024-08-17T02:24:23.749642+0000","last_clean":"2024-08-17T02:24:23.749642+0000","last_became_active":"2024-08-17T02:24:23.740909+0000","last_became_peered":"2024-08-17T02:24:23.740909+0000","last_unstale":"2024-08-17T02:24:23.749642+0000","last_undegraded":"2024-08-17T02:24:23.749642+0000","last_fullsized":"2024-08-17T02:24:23.749642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:20:03.013029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:24:22.740205+0000","last_change":"2024-08-17T02:24:22.733895+0000","last_active":"2024-08-17T02:24:22.740205+0000","last_peered":"2024-08-17T02:24:22.740205+0000","last_clean":"2024-08-17T02:24:22.740205+0000","last_became_active":"2024-08-17T02:24:22.733634+0000","last_became_peered":"2024-08-17T02:24:22.733634+0000","last_unstale":"2024-08-17T02:24:22.740205+0000","last_undegraded":"2024-08-17T02:24:22.740205+0000","last_fullsized":"2024-08-17T02:24:22.740205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:43:02.800534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.762808+0000","last_change":"2024-08-17T02:24:23.755237+0000","last_active":"2024-08-17T02:24:23.762808+0000","last_peered":"2024-08-17T02:24:23.762808+0000","last_clean":"2024-08-17T02:24:23.762808+0000","last_became_active":"2024-08-17T02:24:23.753595+0000","last_became_peered":"2024-08-17T02:24:23.753595+0000","last_unstale":"2024-08-17T02:24:23.762808+0000","last_undegraded":"2024-08-17T02:24:23.762808+0000","last_fullsized":"2024-08-17T02:24:23.762808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:02:21.524568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:24:22.738364+0000","last_change":"2024-08-17T02:24:22.732671+0000","last_active":"2024-08-17T02:24:22.738364+0000","last_peered":"2024-08-17T02:24:22.738364+0000","last_clean":"2024-08-17T02:24:22.738364+0000","last_became_active":"2024-08-17T02:24:22.732379+0000","last_became_peered":"2024-08-17T02:24:22.732379+0000","last_unstale":"2024-08-17T02:24:22.738364+0000","last_undegraded":"2024-08-17T02:24:22.738364+0000","last_fullsized":"2024-08-17T02:24:22.738364+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:03:43.687672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.750404+0000","last_change":"2024-08-17T02:24:23.750404+0000","last_active":"2024-08-17T02:24:23.750404+0000","last_peered":"2024-08-17T02:24:23.750404+0000","last_clean":"2024-08-17T02:24:23.750404+0000","last_became_active":"2024-08-17T02:24:23.750130+0000","last_became_peered":"2024-08-17T02:24:23.750130+0000","last_unstale":"2024-08-17T02:24:23.750404+0000","last_undegraded":"2024-08-17T02:24:23.750404+0000","last_fullsized":"2024-08-17T02:24:23.750404+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:15:34.819566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.732663+0000","last_change":"2024-08-17T02:24:22.740966+0000","last_active":"2024-08-17T02:24:23.732663+0000","last_peered":"2024-08-17T02:24:23.732663+0000","last_clean":"2024-08-17T02:24:23.732663+0000","last_became_active":"2024-08-17T02:24:22.740641+0000","last_became_peered":"2024-08-17T02:24:22.740641+0000","last_unstale":"2024-08-17T02:24:23.732663+0000","last_undegraded":"2024-08-17T02:24:23.732663+0000","last_fullsized":"2024-08-17T02:24:23.732663+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:14:35.412373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.736055+0000","last_change":"2024-08-17T02:24:23.731503+0000","last_active":"2024-08-17T02:24:23.736055+0000","last_peered":"2024-08-17T02:24:23.736055+0000","last_clean":"2024-08-17T02:24:23.736055+0000","last_became_active":"2024-08-17T02:24:23.731161+0000","last_became_peered":"2024-08-17T02:24:23.731161+0000","last_unstale":"2024-08-17T02:24:23.736055+0000","last_undegraded":"2024-08-17T02:24:23.736055+0000","last_fullsized":"2024-08-17T02:24:23.736055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:37:20.039928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:24:22.740916+0000","last_change":"2024-08-17T02:24:22.735592+0000","last_active":"2024-08-17T02:24:22.740916+0000","last_peered":"2024-08-17T02:24:22.740916+0000","last_clean":"2024-08-17T02:24:22.740916+0000","last_became_active":"2024-08-17T02:24:22.734402+0000","last_became_peered":"2024-08-17T02:24:22.734402+0000","last_unstale":"2024-08-17T02:24:22.740916+0000","last_undegraded":"2024-08-17T02:24:22.740916+0000","last_fullsized":"2024-08-17T02:24:22.740916+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:25:44.126698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.722760+0000","last_change":"2024-08-17T02:23:27.953699+0000","last_active":"2024-08-17T02:24:23.722760+0000","last_peered":"2024-08-17T02:24:23.722760+0000","last_clean":"2024-08-17T02:24:23.722760+0000","last_became_active":"2024-08-17T02:23:27.952879+0000","last_became_peered":"2024-08-17T02:23:27.952879+0000","last_unstale":"2024-08-17T02:24:23.722760+0000","last_undegraded":"2024-08-17T02:24:23.722760+0000","last_fullsized":"2024-08-17T02:24:23.722760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:26.811202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:26.811202+0000","last_clean_scrub_stamp":"2024-08-17T02:23:26.811202+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:48.565059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":958464,"data_stored":728831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":356352,"data_stored":132689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":368640,"data_stored":139033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":356352,"data_stored":132189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301872,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069968,"statfs":{"total":96636764160,"available":96327647232,"internally_reserved":0,"allocated":364544,"data_stored":133659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301860,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069980,"statfs":{"total":96636764160,"available":96327659520,"internally_reserved":0,"allocated":352256,"data_stored":132155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301872,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069968,"statfs":{"total":96636764160,"available":96327647232,"internally_reserved":0,"allocated":364544,"data_stored":133659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302444,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069396,"statfs":{"total":96636764160,"available":96327061504,"internally_reserved":0,"allocated":942080,"data_stored":722453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:24:27.923 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:24:28.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.109+0000 7fc092000640 1 Processor -- start 2024-08-17T02:24:28.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.109+0000 7fc092000640 1 -- start start 2024-08-17T02:24:28.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.110+0000 7fc092000640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc08c0afca0 0x7fc08c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.110+0000 7fc092000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc08c1590b0 0x7fc08c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.110+0000 7fc092000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc08c15a4e0 con 0x7fc08c0acf10 2024-08-17T02:24:28.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.111+0000 7fc092000640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc08c0b0980 con 0x7fc08c0afca0 2024-08-17T02:24:28.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.111+0000 7fc092000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c0c92b0 con 0x7fc08c1590b0 2024-08-17T02:24:28.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.111+0000 7fc083e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc08c0acf10 0x7fc08c1589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54410/0 (socket says 172.21.15.2:54410) 2024-08-17T02:24:28.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.111+0000 7fc083e00640 1 -- 172.21.15.2:0/453927548 learned_addr learned my addr 172.21.15.2:0/453927548 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:28.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.111+0000 7fc08be00640 1 --2- 172.21.15.2:0/453927548 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc08c1590b0 0x7fc08c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.111+0000 7fc08b400640 1 --2- 172.21.15.2:0/453927548 >> v2:172.21.15.145:3300/0 conn(0x7fc08c0afca0 0x7fc08c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.111+0000 7fc08aa00640 1 -- 172.21.15.2:0/453927548 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 97748615 0 0) 0x7fc074001110 con 0x7fc08c0acf10 2024-08-17T02:24:28.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.111+0000 7fc08aa00640 1 -- 172.21.15.2:0/453927548 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0700034e0 con 0x7fc08c0acf10 2024-08-17T02:24:28.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.111+0000 7fc08be00640 1 -- 172.21.15.2:0/453927548 >> v2:172.21.15.145:3300/0 conn(0x7fc08c0afca0 msgr2=0x7fc08c0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:28.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.111+0000 7fc08be00640 1 --2- 172.21.15.2:0/453927548 >> v2:172.21.15.145:3300/0 conn(0x7fc08c0afca0 0x7fc08c0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.112+0000 7fc08be00640 1 -- 172.21.15.2:0/453927548 >> v1:172.21.15.2:6789/0 conn(0x7fc08c0acf10 legacy=0x7fc08c1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.112+0000 7fc08be00640 1 -- 172.21.15.2:0/453927548 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c0ad480 con 0x7fc08c1590b0 2024-08-17T02:24:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.113+0000 7fc08be00640 1 --2- 172.21.15.2:0/453927548 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc08c1590b0 0x7fc08c159fa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc084009e60 tx=0x7fc084009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6a57bc41a2e6ee8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.113+0000 7fc08aa00640 1 -- 172.21.15.2:0/453927548 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084007550 con 0x7fc08c1590b0 2024-08-17T02:24:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.113+0000 7fc08aa00640 1 -- 172.21.15.2:0/453927548 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08402d050 con 0x7fc08c1590b0 2024-08-17T02:24:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.113+0000 7fc08aa00640 1 -- 172.21.15.2:0/453927548 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084007920 con 0x7fc08c1590b0 2024-08-17T02:24:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.113+0000 7fc092000640 1 -- 172.21.15.2:0/453927548 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc08c1590b0 msgr2=0x7fc08c159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.113+0000 7fc092000640 1 --2- 172.21.15.2:0/453927548 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc08c1590b0 0x7fc08c159fa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc084009e60 tx=0x7fc084009780 comp rx=0 tx=0).stop 2024-08-17T02:24:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.114+0000 7fc092000640 1 -- 172.21.15.2:0/453927548 shutdown_connections 2024-08-17T02:24:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.114+0000 7fc092000640 1 --2- 172.21.15.2:0/453927548 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc08c1590b0 0x7fc08c159fa0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.114+0000 7fc092000640 1 --2- 172.21.15.2:0/453927548 >> v2:172.21.15.145:3300/0 conn(0x7fc08c0afca0 0x7fc08c0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.114+0000 7fc092000640 1 -- 172.21.15.2:0/453927548 >> 172.21.15.2:0/453927548 conn(0x7fc08c066e60 msgr2=0x7fc08c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.114+0000 7fc092000640 1 -- 172.21.15.2:0/453927548 shutdown_connections 2024-08-17T02:24:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.114+0000 7fc092000640 1 -- 172.21.15.2:0/453927548 wait complete. 2024-08-17T02:24:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.115+0000 7fc092000640 1 Processor -- start 2024-08-17T02:24:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.115+0000 7fc092000640 1 -- start start 2024-08-17T02:24:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.116+0000 7fc092000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc08c0acf10 0x7fc08c0c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.116+0000 7fc092000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc08c0afca0 0x7fc08c13f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.116+0000 7fc092000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc08c1590b0 0x7fc08c16c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.116+0000 7fc092000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c14edb0 con 0x7fc08c0afca0 2024-08-17T02:24:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.116+0000 7fc092000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c152a10 con 0x7fc08c1590b0 2024-08-17T02:24:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.116+0000 7fc092000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c152cf0 con 0x7fc08c0acf10 2024-08-17T02:24:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.116+0000 7fc083e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc08c0afca0 0x7fc08c13f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.116+0000 7fc083e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc08c0afca0 0x7fc08c13f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36244/0 (socket says 172.21.15.2:36244) 2024-08-17T02:24:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.116+0000 7fc083e00640 1 -- 172.21.15.2:0/3395744821 learned_addr learned my addr 172.21.15.2:0/3395744821 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.117+0000 7fc08b400640 1 --2- 172.21.15.2:0/3395744821 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc08c0acf10 0x7fc08c0c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.117+0000 7fc08be00640 1 --2- 172.21.15.2:0/3395744821 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc08c1590b0 0x7fc08c16c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.117+0000 7fc083e00640 1 -- 172.21.15.2:0/3395744821 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc08c0acf10 msgr2=0x7fc08c0c4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.117+0000 7fc083e00640 1 --2- 172.21.15.2:0/3395744821 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc08c0acf10 0x7fc08c0c4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.117+0000 7fc083e00640 1 -- 172.21.15.2:0/3395744821 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc08c1590b0 msgr2=0x7fc08c16c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.117+0000 7fc083e00640 1 --2- 172.21.15.2:0/3395744821 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc08c1590b0 0x7fc08c16c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.117+0000 7fc083e00640 1 -- 172.21.15.2:0/3395744821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc084009a20 con 0x7fc08c0afca0 2024-08-17T02:24:28.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.117+0000 7fc083e00640 1 --2- 172.21.15.2:0/3395744821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc08c0afca0 0x7fc08c13f210 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc07400c7c0 tx=0x7fc074007be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:28.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.117+0000 7fc082a00640 1 -- 172.21.15.2:0/3395744821 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07400ce90 con 0x7fc08c0afca0 2024-08-17T02:24:28.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.117+0000 7fc082a00640 1 -- 172.21.15.2:0/3395744821 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc074005870 con 0x7fc08c0afca0 2024-08-17T02:24:28.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.117+0000 7fc082a00640 1 -- 172.21.15.2:0/3395744821 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074005c90 con 0x7fc08c0afca0 2024-08-17T02:24:28.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.117+0000 7fc092000640 1 -- 172.21.15.2:0/3395744821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08c152fd0 con 0x7fc08c0afca0 2024-08-17T02:24:28.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.118+0000 7fc092000640 1 -- 172.21.15.2:0/3395744821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08c0c5130 con 0x7fc08c0afca0 2024-08-17T02:24:28.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.118+0000 7fc092000640 1 -- 172.21.15.2:0/3395744821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc08c063fb0 con 0x7fc08c0afca0 2024-08-17T02:24:28.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.119+0000 7fc082a00640 1 -- 172.21.15.2:0/3395744821 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc074007300 con 0x7fc08c0afca0 2024-08-17T02:24:28.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.120+0000 7fc082a00640 1 --2- 172.21.15.2:0/3395744821 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc068065150 0x7fc068067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.120+0000 7fc082a00640 1 -- 172.21.15.2:0/3395744821 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc074081d30 con 0x7fc08c0afca0 2024-08-17T02:24:28.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.120+0000 7fc08b400640 1 --2- 172.21.15.2:0/3395744821 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc068065150 0x7fc068067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.121+0000 7fc08b400640 1 --2- 172.21.15.2:0/3395744821 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc068065150 0x7fc068067600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc07c009d20 tx=0x7fc07c0090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:28.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.124+0000 7fc082a00640 1 -- 172.21.15.2:0/3395744821 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc07404fdd0 con 0x7fc08c0afca0 2024-08-17T02:24:28.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.302+0000 7fc092000640 1 -- 172.21.15.2:0/3395744821 --> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc08c15a4e0 con 0x7fc068065150 2024-08-17T02:24:28.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.309+0000 7fc082a00640 1 -- 172.21.15.2:0/3395744821 <== mgr.4108 v2:172.21.15.145:6832/36841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264615 (secure 0 0 0) 0x7fc08c15a4e0 con 0x7fc068065150 2024-08-17T02:24:28.312 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:24:28.314 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-17T02:24:28.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.313+0000 7fc092000640 1 -- 172.21.15.2:0/3395744821 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc068065150 msgr2=0x7fc068067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.313+0000 7fc092000640 1 --2- 172.21.15.2:0/3395744821 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc068065150 0x7fc068067600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc07c009d20 tx=0x7fc07c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.313+0000 7fc092000640 1 -- 172.21.15.2:0/3395744821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc08c0afca0 msgr2=0x7fc08c13f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.313+0000 7fc092000640 1 --2- 172.21.15.2:0/3395744821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc08c0afca0 0x7fc08c13f210 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc07400c7c0 tx=0x7fc074007be0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.313+0000 7fc092000640 1 -- 172.21.15.2:0/3395744821 shutdown_connections 2024-08-17T02:24:28.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.313+0000 7fc092000640 1 --2- 172.21.15.2:0/3395744821 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc08c1590b0 0x7fc08c16c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.313+0000 7fc092000640 1 --2- 172.21.15.2:0/3395744821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc08c0afca0 0x7fc08c13f210 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.313+0000 7fc092000640 1 --2- 172.21.15.2:0/3395744821 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc068065150 0x7fc068067600 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.313+0000 7fc092000640 1 --2- 172.21.15.2:0/3395744821 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc08c0acf10 0x7fc08c0c4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.313+0000 7fc092000640 1 -- 172.21.15.2:0/3395744821 >> 172.21.15.2:0/3395744821 conn(0x7fc08c066e60 msgr2=0x7fc08c0cac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:28.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.313+0000 7fc092000640 1 -- 172.21.15.2:0/3395744821 shutdown_connections 2024-08-17T02:24:28.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.313+0000 7fc092000640 1 -- 172.21.15.2:0/3395744821 wait complete. 2024-08-17T02:24:28.329 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-08-17T02:24:28.064224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399476,"kb_used_data":3968,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575244,"statfs":{"total":773094113280,"available":770637049856,"internally_reserved":0,"allocated":4063232,"data_stored":2254668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001528"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.739706+0000","last_change":"2024-08-17T02:24:23.739706+0000","last_active":"2024-08-17T02:24:23.739706+0000","last_peered":"2024-08-17T02:24:23.739706+0000","last_clean":"2024-08-17T02:24:23.739706+0000","last_became_active":"2024-08-17T02:24:23.737938+0000","last_became_peered":"2024-08-17T02:24:23.737938+0000","last_unstale":"2024-08-17T02:24:23.739706+0000","last_undegraded":"2024-08-17T02:24:23.739706+0000","last_fullsized":"2024-08-17T02:24:23.739706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:27.260103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.763163+0000","last_change":"2024-08-17T02:24:23.754746+0000","last_active":"2024-08-17T02:24:23.763163+0000","last_peered":"2024-08-17T02:24:23.763163+0000","last_clean":"2024-08-17T02:24:23.763163+0000","last_became_active":"2024-08-17T02:24:23.754088+0000","last_became_peered":"2024-08-17T02:24:23.754088+0000","last_unstale":"2024-08-17T02:24:23.763163+0000","last_undegraded":"2024-08-17T02:24:23.763163+0000","last_fullsized":"2024-08-17T02:24:23.763163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:14:53.912320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.753806+0000","last_change":"2024-08-17T02:24:23.748418+0000","last_active":"2024-08-17T02:24:23.753806+0000","last_peered":"2024-08-17T02:24:23.753806+0000","last_clean":"2024-08-17T02:24:23.753806+0000","last_became_active":"2024-08-17T02:24:23.748154+0000","last_became_peered":"2024-08-17T02:24:23.748154+0000","last_unstale":"2024-08-17T02:24:23.753806+0000","last_undegraded":"2024-08-17T02:24:23.753806+0000","last_fullsized":"2024-08-17T02:24:23.753806+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:34:34.721761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.742187+0000","last_change":"2024-08-17T02:24:23.742187+0000","last_active":"2024-08-17T02:24:23.742187+0000","last_peered":"2024-08-17T02:24:23.742187+0000","last_clean":"2024-08-17T02:24:23.742187+0000","last_became_active":"2024-08-17T02:24:23.741951+0000","last_became_peered":"2024-08-17T02:24:23.741951+0000","last_unstale":"2024-08-17T02:24:23.742187+0000","last_undegraded":"2024-08-17T02:24:23.742187+0000","last_fullsized":"2024-08-17T02:24:23.742187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:42.224525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.748311+0000","last_change":"2024-08-17T02:24:23.748311+0000","last_active":"2024-08-17T02:24:23.748311+0000","last_peered":"2024-08-17T02:24:23.748311+0000","last_clean":"2024-08-17T02:24:23.748311+0000","last_became_active":"2024-08-17T02:24:23.747380+0000","last_became_peered":"2024-08-17T02:24:23.747380+0000","last_unstale":"2024-08-17T02:24:23.748311+0000","last_undegraded":"2024-08-17T02:24:23.748311+0000","last_fullsized":"2024-08-17T02:24:23.748311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:02:16.400838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.759152+0000","last_change":"2024-08-17T02:24:23.748803+0000","last_active":"2024-08-17T02:24:23.759152+0000","last_peered":"2024-08-17T02:24:23.759152+0000","last_clean":"2024-08-17T02:24:23.759152+0000","last_became_active":"2024-08-17T02:24:23.748523+0000","last_became_peered":"2024-08-17T02:24:23.748523+0000","last_unstale":"2024-08-17T02:24:23.759152+0000","last_undegraded":"2024-08-17T02:24:23.759152+0000","last_fullsized":"2024-08-17T02:24:23.759152+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:43.227359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.747381+0000","last_change":"2024-08-17T02:24:23.742018+0000","last_active":"2024-08-17T02:24:23.747381+0000","last_peered":"2024-08-17T02:24:23.747381+0000","last_clean":"2024-08-17T02:24:23.747381+0000","last_became_active":"2024-08-17T02:24:23.741565+0000","last_became_peered":"2024-08-17T02:24:23.741565+0000","last_unstale":"2024-08-17T02:24:23.747381+0000","last_undegraded":"2024-08-17T02:24:23.747381+0000","last_fullsized":"2024-08-17T02:24:23.747381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:28:51.875416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.745061+0000","last_change":"2024-08-17T02:24:23.735817+0000","last_active":"2024-08-17T02:24:23.745061+0000","last_peered":"2024-08-17T02:24:23.745061+0000","last_clean":"2024-08-17T02:24:23.745061+0000","last_became_active":"2024-08-17T02:24:23.735541+0000","last_became_peered":"2024-08-17T02:24:23.735541+0000","last_unstale":"2024-08-17T02:24:23.745061+0000","last_undegraded":"2024-08-17T02:24:23.745061+0000","last_fullsized":"2024-08-17T02:24:23.745061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:43.227359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.749059+0000","last_change":"2024-08-17T02:24:23.749059+0000","last_active":"2024-08-17T02:24:23.749059+0000","last_peered":"2024-08-17T02:24:23.749059+0000","last_clean":"2024-08-17T02:24:23.749059+0000","last_became_active":"2024-08-17T02:24:23.748759+0000","last_became_peered":"2024-08-17T02:24:23.748759+0000","last_unstale":"2024-08-17T02:24:23.749059+0000","last_undegraded":"2024-08-17T02:24:23.749059+0000","last_fullsized":"2024-08-17T02:24:23.749059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:26.380538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.756686+0000","last_change":"2024-08-17T02:24:23.756686+0000","last_active":"2024-08-17T02:24:23.756686+0000","last_peered":"2024-08-17T02:24:23.756686+0000","last_clean":"2024-08-17T02:24:23.756686+0000","last_became_active":"2024-08-17T02:24:23.756392+0000","last_became_peered":"2024-08-17T02:24:23.756392+0000","last_unstale":"2024-08-17T02:24:23.756686+0000","last_undegraded":"2024-08-17T02:24:23.756686+0000","last_fullsized":"2024-08-17T02:24:23.756686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:10.116414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.753488+0000","last_change":"2024-08-17T02:24:23.750055+0000","last_active":"2024-08-17T02:24:23.753488+0000","last_peered":"2024-08-17T02:24:23.753488+0000","last_clean":"2024-08-17T02:24:23.753488+0000","last_became_active":"2024-08-17T02:24:23.749762+0000","last_became_peered":"2024-08-17T02:24:23.749762+0000","last_unstale":"2024-08-17T02:24:23.753488+0000","last_undegraded":"2024-08-17T02:24:23.753488+0000","last_fullsized":"2024-08-17T02:24:23.753488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:25:00.964150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.753660+0000","last_change":"2024-08-17T02:24:23.748834+0000","last_active":"2024-08-17T02:24:23.753660+0000","last_peered":"2024-08-17T02:24:23.753660+0000","last_clean":"2024-08-17T02:24:23.753660+0000","last_became_active":"2024-08-17T02:24:23.748545+0000","last_became_peered":"2024-08-17T02:24:23.748545+0000","last_unstale":"2024-08-17T02:24:23.753660+0000","last_undegraded":"2024-08-17T02:24:23.753660+0000","last_fullsized":"2024-08-17T02:24:23.753660+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:47:32.978182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.737361+0000","last_change":"2024-08-17T02:24:23.737361+0000","last_active":"2024-08-17T02:24:23.737361+0000","last_peered":"2024-08-17T02:24:23.737361+0000","last_clean":"2024-08-17T02:24:23.737361+0000","last_became_active":"2024-08-17T02:24:23.737083+0000","last_became_peered":"2024-08-17T02:24:23.737083+0000","last_unstale":"2024-08-17T02:24:23.737361+0000","last_undegraded":"2024-08-17T02:24:23.737361+0000","last_fullsized":"2024-08-17T02:24:23.737361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:59.763928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.761474+0000","last_change":"2024-08-17T02:24:23.754894+0000","last_active":"2024-08-17T02:24:23.761474+0000","last_peered":"2024-08-17T02:24:23.761474+0000","last_clean":"2024-08-17T02:24:23.761474+0000","last_became_active":"2024-08-17T02:24:23.749193+0000","last_became_peered":"2024-08-17T02:24:23.749193+0000","last_unstale":"2024-08-17T02:24:23.761474+0000","last_undegraded":"2024-08-17T02:24:23.761474+0000","last_fullsized":"2024-08-17T02:24:23.761474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:28:51.875416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.749680+0000","last_change":"2024-08-17T02:24:23.743606+0000","last_active":"2024-08-17T02:24:23.749680+0000","last_peered":"2024-08-17T02:24:23.749680+0000","last_clean":"2024-08-17T02:24:23.749680+0000","last_became_active":"2024-08-17T02:24:23.743101+0000","last_became_peered":"2024-08-17T02:24:23.743101+0000","last_unstale":"2024-08-17T02:24:23.749680+0000","last_undegraded":"2024-08-17T02:24:23.749680+0000","last_fullsized":"2024-08-17T02:24:23.749680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:46:20.760004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.753468+0000","last_change":"2024-08-17T02:24:23.750577+0000","last_active":"2024-08-17T02:24:23.753468+0000","last_peered":"2024-08-17T02:24:23.753468+0000","last_clean":"2024-08-17T02:24:23.753468+0000","last_became_active":"2024-08-17T02:24:23.749499+0000","last_became_peered":"2024-08-17T02:24:23.749499+0000","last_unstale":"2024-08-17T02:24:23.753468+0000","last_undegraded":"2024-08-17T02:24:23.753468+0000","last_fullsized":"2024-08-17T02:24:23.753468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:47:32.978182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.747524+0000","last_change":"2024-08-17T02:24:23.740065+0000","last_active":"2024-08-17T02:24:23.747524+0000","last_peered":"2024-08-17T02:24:23.747524+0000","last_clean":"2024-08-17T02:24:23.747524+0000","last_became_active":"2024-08-17T02:24:23.739819+0000","last_became_peered":"2024-08-17T02:24:23.739819+0000","last_unstale":"2024-08-17T02:24:23.747524+0000","last_undegraded":"2024-08-17T02:24:23.747524+0000","last_fullsized":"2024-08-17T02:24:23.747524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:39:42.983738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.763201+0000","last_change":"2024-08-17T02:24:23.757764+0000","last_active":"2024-08-17T02:24:23.763201+0000","last_peered":"2024-08-17T02:24:23.763201+0000","last_clean":"2024-08-17T02:24:23.763201+0000","last_became_active":"2024-08-17T02:24:23.754549+0000","last_became_peered":"2024-08-17T02:24:23.754549+0000","last_unstale":"2024-08-17T02:24:23.763201+0000","last_undegraded":"2024-08-17T02:24:23.763201+0000","last_fullsized":"2024-08-17T02:24:23.763201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:06:22.129551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.761374+0000","last_change":"2024-08-17T02:24:23.754145+0000","last_active":"2024-08-17T02:24:23.761374+0000","last_peered":"2024-08-17T02:24:23.761374+0000","last_clean":"2024-08-17T02:24:23.761374+0000","last_became_active":"2024-08-17T02:24:23.753754+0000","last_became_peered":"2024-08-17T02:24:23.753754+0000","last_unstale":"2024-08-17T02:24:23.761374+0000","last_undegraded":"2024-08-17T02:24:23.761374+0000","last_fullsized":"2024-08-17T02:24:23.761374+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:47:35.260059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.737152+0000","last_change":"2024-08-17T02:24:23.737152+0000","last_active":"2024-08-17T02:24:23.737152+0000","last_peered":"2024-08-17T02:24:23.737152+0000","last_clean":"2024-08-17T02:24:23.737152+0000","last_became_active":"2024-08-17T02:24:23.736857+0000","last_became_peered":"2024-08-17T02:24:23.736857+0000","last_unstale":"2024-08-17T02:24:23.737152+0000","last_undegraded":"2024-08-17T02:24:23.737152+0000","last_fullsized":"2024-08-17T02:24:23.737152+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:25:45.136668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.733807+0000","last_change":"2024-08-17T02:24:23.733807+0000","last_active":"2024-08-17T02:24:23.733807+0000","last_peered":"2024-08-17T02:24:23.733807+0000","last_clean":"2024-08-17T02:24:23.733807+0000","last_became_active":"2024-08-17T02:24:23.733480+0000","last_became_peered":"2024-08-17T02:24:23.733480+0000","last_unstale":"2024-08-17T02:24:23.733807+0000","last_undegraded":"2024-08-17T02:24:23.733807+0000","last_fullsized":"2024-08-17T02:24:23.733807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:51:41.360019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.759325+0000","last_change":"2024-08-17T02:24:23.759325+0000","last_active":"2024-08-17T02:24:23.759325+0000","last_peered":"2024-08-17T02:24:23.759325+0000","last_clean":"2024-08-17T02:24:23.759325+0000","last_became_active":"2024-08-17T02:24:23.759023+0000","last_became_peered":"2024-08-17T02:24:23.759023+0000","last_unstale":"2024-08-17T02:24:23.759325+0000","last_undegraded":"2024-08-17T02:24:23.759325+0000","last_fullsized":"2024-08-17T02:24:23.759325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:20:03.013029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.729341+0000","last_change":"2024-08-17T02:24:23.726546+0000","last_active":"2024-08-17T02:24:23.729341+0000","last_peered":"2024-08-17T02:24:23.729341+0000","last_clean":"2024-08-17T02:24:23.729341+0000","last_became_active":"2024-08-17T02:24:23.726261+0000","last_became_peered":"2024-08-17T02:24:23.726261+0000","last_unstale":"2024-08-17T02:24:23.729341+0000","last_undegraded":"2024-08-17T02:24:23.729341+0000","last_fullsized":"2024-08-17T02:24:23.729341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:15:34.819566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.749699+0000","last_change":"2024-08-17T02:24:23.741784+0000","last_active":"2024-08-17T02:24:23.749699+0000","last_peered":"2024-08-17T02:24:23.749699+0000","last_clean":"2024-08-17T02:24:23.749699+0000","last_became_active":"2024-08-17T02:24:23.741513+0000","last_became_peered":"2024-08-17T02:24:23.741513+0000","last_unstale":"2024-08-17T02:24:23.749699+0000","last_undegraded":"2024-08-17T02:24:23.749699+0000","last_fullsized":"2024-08-17T02:24:23.749699+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:43.227359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.750262+0000","last_change":"2024-08-17T02:24:23.750262+0000","last_active":"2024-08-17T02:24:23.750262+0000","last_peered":"2024-08-17T02:24:23.750262+0000","last_clean":"2024-08-17T02:24:23.750262+0000","last_became_active":"2024-08-17T02:24:23.749971+0000","last_became_peered":"2024-08-17T02:24:23.749971+0000","last_unstale":"2024-08-17T02:24:23.750262+0000","last_undegraded":"2024-08-17T02:24:23.750262+0000","last_fullsized":"2024-08-17T02:24:23.750262+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:03:53.684995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.763183+0000","last_change":"2024-08-17T02:24:23.755452+0000","last_active":"2024-08-17T02:24:23.763183+0000","last_peered":"2024-08-17T02:24:23.763183+0000","last_clean":"2024-08-17T02:24:23.763183+0000","last_became_active":"2024-08-17T02:24:23.754319+0000","last_became_peered":"2024-08-17T02:24:23.754319+0000","last_unstale":"2024-08-17T02:24:23.763183+0000","last_undegraded":"2024-08-17T02:24:23.763183+0000","last_fullsized":"2024-08-17T02:24:23.763183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:14.615283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.741640+0000","last_change":"2024-08-17T02:24:23.741640+0000","last_active":"2024-08-17T02:24:23.741640+0000","last_peered":"2024-08-17T02:24:23.741640+0000","last_clean":"2024-08-17T02:24:23.741640+0000","last_became_active":"2024-08-17T02:24:23.741362+0000","last_became_peered":"2024-08-17T02:24:23.741362+0000","last_unstale":"2024-08-17T02:24:23.741640+0000","last_undegraded":"2024-08-17T02:24:23.741640+0000","last_fullsized":"2024-08-17T02:24:23.741640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:25:00.964150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.746369+0000","last_change":"2024-08-17T02:24:23.737686+0000","last_active":"2024-08-17T02:24:23.746369+0000","last_peered":"2024-08-17T02:24:23.746369+0000","last_clean":"2024-08-17T02:24:23.746369+0000","last_became_active":"2024-08-17T02:24:23.737433+0000","last_became_peered":"2024-08-17T02:24:23.737433+0000","last_unstale":"2024-08-17T02:24:23.746369+0000","last_undegraded":"2024-08-17T02:24:23.746369+0000","last_fullsized":"2024-08-17T02:24:23.746369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:49:55.156739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.750702+0000","last_change":"2024-08-17T02:24:23.750702+0000","last_active":"2024-08-17T02:24:23.750702+0000","last_peered":"2024-08-17T02:24:23.750702+0000","last_clean":"2024-08-17T02:24:23.750702+0000","last_became_active":"2024-08-17T02:24:23.750428+0000","last_became_peered":"2024-08-17T02:24:23.750428+0000","last_unstale":"2024-08-17T02:24:23.750702+0000","last_undegraded":"2024-08-17T02:24:23.750702+0000","last_fullsized":"2024-08-17T02:24:23.750702+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:42.224525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.745826+0000","last_change":"2024-08-17T02:24:23.737691+0000","last_active":"2024-08-17T02:24:23.745826+0000","last_peered":"2024-08-17T02:24:23.745826+0000","last_clean":"2024-08-17T02:24:23.745826+0000","last_became_active":"2024-08-17T02:24:23.737415+0000","last_became_peered":"2024-08-17T02:24:23.737415+0000","last_unstale":"2024-08-17T02:24:23.745826+0000","last_undegraded":"2024-08-17T02:24:23.745826+0000","last_fullsized":"2024-08-17T02:24:23.745826+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:46:20.760004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.736481+0000","last_change":"2024-08-17T02:24:23.736481+0000","last_active":"2024-08-17T02:24:23.736481+0000","last_peered":"2024-08-17T02:24:23.736481+0000","last_clean":"2024-08-17T02:24:23.736481+0000","last_became_active":"2024-08-17T02:24:23.736084+0000","last_became_peered":"2024-08-17T02:24:23.736084+0000","last_unstale":"2024-08-17T02:24:23.736481+0000","last_undegraded":"2024-08-17T02:24:23.736481+0000","last_fullsized":"2024-08-17T02:24:23.736481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:12:48.697155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.745044+0000","last_change":"2024-08-17T02:24:23.732520+0000","last_active":"2024-08-17T02:24:23.745044+0000","last_peered":"2024-08-17T02:24:23.745044+0000","last_clean":"2024-08-17T02:24:23.745044+0000","last_became_active":"2024-08-17T02:24:23.731995+0000","last_became_peered":"2024-08-17T02:24:23.731995+0000","last_unstale":"2024-08-17T02:24:23.745044+0000","last_undegraded":"2024-08-17T02:24:23.745044+0000","last_fullsized":"2024-08-17T02:24:23.745044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:34:34.721761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.732585+0000","last_change":"2024-08-17T02:24:23.729673+0000","last_active":"2024-08-17T02:24:23.732585+0000","last_peered":"2024-08-17T02:24:23.732585+0000","last_clean":"2024-08-17T02:24:23.732585+0000","last_became_active":"2024-08-17T02:24:23.729435+0000","last_became_peered":"2024-08-17T02:24:23.729435+0000","last_unstale":"2024-08-17T02:24:23.732585+0000","last_undegraded":"2024-08-17T02:24:23.732585+0000","last_fullsized":"2024-08-17T02:24:23.732585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:42.224525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.752074+0000","last_change":"2024-08-17T02:24:22.737156+0000","last_active":"2024-08-17T02:24:23.752074+0000","last_peered":"2024-08-17T02:24:23.752074+0000","last_clean":"2024-08-17T02:24:23.752074+0000","last_became_active":"2024-08-17T02:24:22.736766+0000","last_became_peered":"2024-08-17T02:24:22.736766+0000","last_unstale":"2024-08-17T02:24:23.752074+0000","last_undegraded":"2024-08-17T02:24:23.752074+0000","last_fullsized":"2024-08-17T02:24:23.752074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:58.753958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.741627+0000","last_change":"2024-08-17T02:24:23.741627+0000","last_active":"2024-08-17T02:24:23.741627+0000","last_peered":"2024-08-17T02:24:23.741627+0000","last_clean":"2024-08-17T02:24:23.741627+0000","last_became_active":"2024-08-17T02:24:23.741377+0000","last_became_peered":"2024-08-17T02:24:23.741377+0000","last_unstale":"2024-08-17T02:24:23.741627+0000","last_undegraded":"2024-08-17T02:24:23.741627+0000","last_fullsized":"2024-08-17T02:24:23.741627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:03:53.684995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.754163+0000","last_change":"2024-08-17T02:24:22.733826+0000","last_active":"2024-08-17T02:24:23.754163+0000","last_peered":"2024-08-17T02:24:23.754163+0000","last_clean":"2024-08-17T02:24:23.754163+0000","last_became_active":"2024-08-17T02:24:22.733611+0000","last_became_peered":"2024-08-17T02:24:22.733611+0000","last_unstale":"2024-08-17T02:24:23.754163+0000","last_undegraded":"2024-08-17T02:24:23.754163+0000","last_fullsized":"2024-08-17T02:24:23.754163+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:23:14.788483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.750120+0000","last_change":"2024-08-17T02:24:23.750120+0000","last_active":"2024-08-17T02:24:23.750120+0000","last_peered":"2024-08-17T02:24:23.750120+0000","last_clean":"2024-08-17T02:24:23.750120+0000","last_became_active":"2024-08-17T02:24:23.749839+0000","last_became_peered":"2024-08-17T02:24:23.749839+0000","last_unstale":"2024-08-17T02:24:23.750120+0000","last_undegraded":"2024-08-17T02:24:23.750120+0000","last_fullsized":"2024-08-17T02:24:23.750120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:14:36.422342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.761700+0000","last_change":"2024-08-17T02:24:22.743348+0000","last_active":"2024-08-17T02:24:23.761700+0000","last_peered":"2024-08-17T02:24:23.761700+0000","last_clean":"2024-08-17T02:24:23.761700+0000","last_became_active":"2024-08-17T02:24:22.743067+0000","last_became_peered":"2024-08-17T02:24:22.743067+0000","last_unstale":"2024-08-17T02:24:23.761700+0000","last_undegraded":"2024-08-17T02:24:23.761700+0000","last_fullsized":"2024-08-17T02:24:23.761700+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:03:52.675025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.743720+0000","last_change":"2024-08-17T02:24:23.743720+0000","last_active":"2024-08-17T02:24:23.743720+0000","last_peered":"2024-08-17T02:24:23.743720+0000","last_clean":"2024-08-17T02:24:23.743720+0000","last_became_active":"2024-08-17T02:24:23.739921+0000","last_became_peered":"2024-08-17T02:24:23.739921+0000","last_unstale":"2024-08-17T02:24:23.743720+0000","last_undegraded":"2024-08-17T02:24:23.743720+0000","last_fullsized":"2024-08-17T02:24:23.743720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:14:36.422342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.755026+0000","last_change":"2024-08-17T02:24:22.738509+0000","last_active":"2024-08-17T02:24:23.755026+0000","last_peered":"2024-08-17T02:24:23.755026+0000","last_clean":"2024-08-17T02:24:23.755026+0000","last_became_active":"2024-08-17T02:24:22.738148+0000","last_became_peered":"2024-08-17T02:24:22.738148+0000","last_unstale":"2024-08-17T02:24:23.755026+0000","last_undegraded":"2024-08-17T02:24:23.755026+0000","last_fullsized":"2024-08-17T02:24:23.755026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:34:49.589657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.747469+0000","last_change":"2024-08-17T02:24:23.742559+0000","last_active":"2024-08-17T02:24:23.747469+0000","last_peered":"2024-08-17T02:24:23.747469+0000","last_clean":"2024-08-17T02:24:23.747469+0000","last_became_active":"2024-08-17T02:24:23.742176+0000","last_became_peered":"2024-08-17T02:24:23.742176+0000","last_unstale":"2024-08-17T02:24:23.747469+0000","last_undegraded":"2024-08-17T02:24:23.747469+0000","last_fullsized":"2024-08-17T02:24:23.747469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:10.116414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.729490+0000","last_change":"2024-08-17T02:24:22.745981+0000","last_active":"2024-08-17T02:24:23.729490+0000","last_peered":"2024-08-17T02:24:23.729490+0000","last_clean":"2024-08-17T02:24:23.729490+0000","last_became_active":"2024-08-17T02:24:22.745385+0000","last_became_peered":"2024-08-17T02:24:22.745385+0000","last_unstale":"2024-08-17T02:24:23.729490+0000","last_undegraded":"2024-08-17T02:24:23.729490+0000","last_fullsized":"2024-08-17T02:24:23.729490+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:43:02.800534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.735999+0000","last_change":"2024-08-17T02:24:23.731998+0000","last_active":"2024-08-17T02:24:23.735999+0000","last_peered":"2024-08-17T02:24:23.735999+0000","last_clean":"2024-08-17T02:24:23.735999+0000","last_became_active":"2024-08-17T02:24:23.731720+0000","last_became_peered":"2024-08-17T02:24:23.731720+0000","last_unstale":"2024-08-17T02:24:23.735999+0000","last_undegraded":"2024-08-17T02:24:23.735999+0000","last_fullsized":"2024-08-17T02:24:23.735999+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:39:42.983738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.729002+0000","last_change":"2024-08-17T02:24:22.741383+0000","last_active":"2024-08-17T02:24:23.729002+0000","last_peered":"2024-08-17T02:24:23.729002+0000","last_clean":"2024-08-17T02:24:23.729002+0000","last_became_active":"2024-08-17T02:24:22.741114+0000","last_became_peered":"2024-08-17T02:24:22.741114+0000","last_unstale":"2024-08-17T02:24:23.729002+0000","last_undegraded":"2024-08-17T02:24:23.729002+0000","last_fullsized":"2024-08-17T02:24:23.729002+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:22:39.132246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.738005+0000","last_change":"2024-08-17T02:24:23.738005+0000","last_active":"2024-08-17T02:24:23.738005+0000","last_peered":"2024-08-17T02:24:23.738005+0000","last_clean":"2024-08-17T02:24:23.738005+0000","last_became_active":"2024-08-17T02:24:23.737761+0000","last_became_peered":"2024-08-17T02:24:23.737761+0000","last_unstale":"2024-08-17T02:24:23.738005+0000","last_undegraded":"2024-08-17T02:24:23.738005+0000","last_fullsized":"2024-08-17T02:24:23.738005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:12:48.697155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.734012+0000","last_change":"2024-08-17T02:24:22.737771+0000","last_active":"2024-08-17T02:24:23.734012+0000","last_peered":"2024-08-17T02:24:23.734012+0000","last_clean":"2024-08-17T02:24:23.734012+0000","last_became_active":"2024-08-17T02:24:22.736301+0000","last_became_peered":"2024-08-17T02:24:22.736301+0000","last_unstale":"2024-08-17T02:24:23.734012+0000","last_undegraded":"2024-08-17T02:24:23.734012+0000","last_fullsized":"2024-08-17T02:24:23.734012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:25.370569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.739228+0000","last_change":"2024-08-17T02:24:23.739228+0000","last_active":"2024-08-17T02:24:23.739228+0000","last_peered":"2024-08-17T02:24:23.739228+0000","last_clean":"2024-08-17T02:24:23.739228+0000","last_became_active":"2024-08-17T02:24:23.738393+0000","last_became_peered":"2024-08-17T02:24:23.738393+0000","last_unstale":"2024-08-17T02:24:23.739228+0000","last_undegraded":"2024-08-17T02:24:23.739228+0000","last_fullsized":"2024-08-17T02:24:23.739228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:26.380538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:24:22.738686+0000","last_change":"2024-08-17T02:24:22.733404+0000","last_active":"2024-08-17T02:24:22.738686+0000","last_peered":"2024-08-17T02:24:22.738686+0000","last_clean":"2024-08-17T02:24:22.738686+0000","last_became_active":"2024-08-17T02:24:22.733149+0000","last_became_peered":"2024-08-17T02:24:22.733149+0000","last_unstale":"2024-08-17T02:24:22.738686+0000","last_undegraded":"2024-08-17T02:24:22.738686+0000","last_fullsized":"2024-08-17T02:24:22.738686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:03:18.416445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.757504+0000","last_change":"2024-08-17T02:24:23.756609+0000","last_active":"2024-08-17T02:24:23.757504+0000","last_peered":"2024-08-17T02:24:23.757504+0000","last_clean":"2024-08-17T02:24:23.757504+0000","last_became_active":"2024-08-17T02:24:23.756368+0000","last_became_peered":"2024-08-17T02:24:23.756368+0000","last_unstale":"2024-08-17T02:24:23.757504+0000","last_undegraded":"2024-08-17T02:24:23.757504+0000","last_fullsized":"2024-08-17T02:24:23.757504+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:05.656289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.731821+0000","last_change":"2024-08-17T02:24:22.742118+0000","last_active":"2024-08-17T02:24:23.731821+0000","last_peered":"2024-08-17T02:24:23.731821+0000","last_clean":"2024-08-17T02:24:23.731821+0000","last_became_active":"2024-08-17T02:24:22.740691+0000","last_became_peered":"2024-08-17T02:24:22.740691+0000","last_unstale":"2024-08-17T02:24:23.731821+0000","last_undegraded":"2024-08-17T02:24:23.731821+0000","last_fullsized":"2024-08-17T02:24:23.731821+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:44.461344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.761421+0000","last_change":"2024-08-17T02:24:23.753927+0000","last_active":"2024-08-17T02:24:23.761421+0000","last_peered":"2024-08-17T02:24:23.761421+0000","last_clean":"2024-08-17T02:24:23.761421+0000","last_became_active":"2024-08-17T02:24:23.753561+0000","last_became_peered":"2024-08-17T02:24:23.753561+0000","last_unstale":"2024-08-17T02:24:23.761421+0000","last_undegraded":"2024-08-17T02:24:23.761421+0000","last_fullsized":"2024-08-17T02:24:23.761421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:56:18.273049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.719878+0000","last_change":"2024-08-17T02:24:22.744037+0000","last_active":"2024-08-17T02:24:23.719878+0000","last_peered":"2024-08-17T02:24:23.719878+0000","last_clean":"2024-08-17T02:24:23.719878+0000","last_became_active":"2024-08-17T02:24:22.743749+0000","last_became_peered":"2024-08-17T02:24:22.743749+0000","last_unstale":"2024-08-17T02:24:23.719878+0000","last_undegraded":"2024-08-17T02:24:23.719878+0000","last_fullsized":"2024-08-17T02:24:23.719878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:02:15.390868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.759274+0000","last_change":"2024-08-17T02:24:23.749232+0000","last_active":"2024-08-17T02:24:23.759274+0000","last_peered":"2024-08-17T02:24:23.759274+0000","last_clean":"2024-08-17T02:24:23.759274+0000","last_became_active":"2024-08-17T02:24:23.748981+0000","last_became_peered":"2024-08-17T02:24:23.748981+0000","last_unstale":"2024-08-17T02:24:23.759274+0000","last_undegraded":"2024-08-17T02:24:23.759274+0000","last_fullsized":"2024-08-17T02:24:23.759274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:41.566939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.750491+0000","last_change":"2024-08-17T02:24:22.735686+0000","last_active":"2024-08-17T02:24:23.750491+0000","last_peered":"2024-08-17T02:24:23.750491+0000","last_clean":"2024-08-17T02:24:23.750491+0000","last_became_active":"2024-08-17T02:24:22.735370+0000","last_became_peered":"2024-08-17T02:24:22.735370+0000","last_unstale":"2024-08-17T02:24:23.750491+0000","last_undegraded":"2024-08-17T02:24:23.750491+0000","last_fullsized":"2024-08-17T02:24:23.750491+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:44.461344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.753823+0000","last_change":"2024-08-17T02:24:23.748538+0000","last_active":"2024-08-17T02:24:23.753823+0000","last_peered":"2024-08-17T02:24:23.753823+0000","last_clean":"2024-08-17T02:24:23.753823+0000","last_became_active":"2024-08-17T02:24:23.748241+0000","last_became_peered":"2024-08-17T02:24:23.748241+0000","last_unstale":"2024-08-17T02:24:23.753823+0000","last_undegraded":"2024-08-17T02:24:23.753823+0000","last_fullsized":"2024-08-17T02:24:23.753823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:28:51.875416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.765337+0000","last_change":"2024-08-17T02:24:22.744426+0000","last_active":"2024-08-17T02:24:23.765337+0000","last_peered":"2024-08-17T02:24:23.765337+0000","last_clean":"2024-08-17T02:24:23.765337+0000","last_became_active":"2024-08-17T02:24:22.744134+0000","last_became_peered":"2024-08-17T02:24:22.744134+0000","last_unstale":"2024-08-17T02:24:23.765337+0000","last_undegraded":"2024-08-17T02:24:23.765337+0000","last_fullsized":"2024-08-17T02:24:23.765337+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:41.214555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.745343+0000","last_change":"2024-08-17T02:24:23.745343+0000","last_active":"2024-08-17T02:24:23.745343+0000","last_peered":"2024-08-17T02:24:23.745343+0000","last_clean":"2024-08-17T02:24:23.745343+0000","last_became_active":"2024-08-17T02:24:23.745161+0000","last_became_peered":"2024-08-17T02:24:23.745161+0000","last_unstale":"2024-08-17T02:24:23.745343+0000","last_undegraded":"2024-08-17T02:24:23.745343+0000","last_fullsized":"2024-08-17T02:24:23.745343+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:20:03.013029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.752003+0000","last_change":"2024-08-17T02:24:22.738453+0000","last_active":"2024-08-17T02:24:23.752003+0000","last_peered":"2024-08-17T02:24:23.752003+0000","last_clean":"2024-08-17T02:24:23.752003+0000","last_became_active":"2024-08-17T02:24:22.738196+0000","last_became_peered":"2024-08-17T02:24:22.738196+0000","last_unstale":"2024-08-17T02:24:23.752003+0000","last_undegraded":"2024-08-17T02:24:23.752003+0000","last_fullsized":"2024-08-17T02:24:23.752003+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:44.165143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.761488+0000","last_change":"2024-08-17T02:24:23.755010+0000","last_active":"2024-08-17T02:24:23.761488+0000","last_peered":"2024-08-17T02:24:23.761488+0000","last_clean":"2024-08-17T02:24:23.761488+0000","last_became_active":"2024-08-17T02:24:23.754747+0000","last_became_peered":"2024-08-17T02:24:23.754747+0000","last_unstale":"2024-08-17T02:24:23.761488+0000","last_undegraded":"2024-08-17T02:24:23.761488+0000","last_fullsized":"2024-08-17T02:24:23.761488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:39:42.983738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:24:22.740184+0000","last_change":"2024-08-17T02:24:22.731757+0000","last_active":"2024-08-17T02:24:22.740184+0000","last_peered":"2024-08-17T02:24:22.740184+0000","last_clean":"2024-08-17T02:24:22.740184+0000","last_became_active":"2024-08-17T02:24:22.731086+0000","last_became_peered":"2024-08-17T02:24:22.731086+0000","last_unstale":"2024-08-17T02:24:22.740184+0000","last_undegraded":"2024-08-17T02:24:22.740184+0000","last_fullsized":"2024-08-17T02:24:22.740184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:39:10.244175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.745026+0000","last_change":"2024-08-17T02:24:23.732314+0000","last_active":"2024-08-17T02:24:23.745026+0000","last_peered":"2024-08-17T02:24:23.745026+0000","last_clean":"2024-08-17T02:24:23.745026+0000","last_became_active":"2024-08-17T02:24:23.731598+0000","last_became_peered":"2024-08-17T02:24:23.731598+0000","last_unstale":"2024-08-17T02:24:23.745026+0000","last_undegraded":"2024-08-17T02:24:23.745026+0000","last_fullsized":"2024-08-17T02:24:23.745026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:06:58.770100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.733914+0000","last_change":"2024-08-17T02:24:22.740500+0000","last_active":"2024-08-17T02:24:23.733914+0000","last_peered":"2024-08-17T02:24:23.733914+0000","last_clean":"2024-08-17T02:24:23.733914+0000","last_became_active":"2024-08-17T02:24:22.740070+0000","last_became_peered":"2024-08-17T02:24:22.740070+0000","last_unstale":"2024-08-17T02:24:23.733914+0000","last_undegraded":"2024-08-17T02:24:23.733914+0000","last_fullsized":"2024-08-17T02:24:23.733914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:15:33.809597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.741465+0000","last_change":"2024-08-17T02:24:23.741465+0000","last_active":"2024-08-17T02:24:23.741465+0000","last_peered":"2024-08-17T02:24:23.741465+0000","last_clean":"2024-08-17T02:24:23.741465+0000","last_became_active":"2024-08-17T02:24:23.741165+0000","last_became_peered":"2024-08-17T02:24:23.741165+0000","last_unstale":"2024-08-17T02:24:23.741465+0000","last_undegraded":"2024-08-17T02:24:23.741465+0000","last_fullsized":"2024-08-17T02:24:23.741465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:30:15.345252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.766815+0000","last_change":"2024-08-17T02:24:22.743014+0000","last_active":"2024-08-17T02:24:23.766815+0000","last_peered":"2024-08-17T02:24:23.766815+0000","last_clean":"2024-08-17T02:24:23.766815+0000","last_became_active":"2024-08-17T02:24:22.742697+0000","last_became_peered":"2024-08-17T02:24:22.742697+0000","last_unstale":"2024-08-17T02:24:23.766815+0000","last_undegraded":"2024-08-17T02:24:23.766815+0000","last_fullsized":"2024-08-17T02:24:23.766815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:20:02.003059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.737363+0000","last_change":"2024-08-17T02:24:23.737363+0000","last_active":"2024-08-17T02:24:23.737363+0000","last_peered":"2024-08-17T02:24:23.737363+0000","last_clean":"2024-08-17T02:24:23.737363+0000","last_became_active":"2024-08-17T02:24:23.737066+0000","last_became_peered":"2024-08-17T02:24:23.737066+0000","last_unstale":"2024-08-17T02:24:23.737363+0000","last_undegraded":"2024-08-17T02:24:23.737363+0000","last_fullsized":"2024-08-17T02:24:23.737363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:03:53.684995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.739800+0000","last_change":"2024-08-17T02:24:22.745381+0000","last_active":"2024-08-17T02:24:23.739800+0000","last_peered":"2024-08-17T02:24:23.739800+0000","last_clean":"2024-08-17T02:24:23.739800+0000","last_became_active":"2024-08-17T02:24:22.744883+0000","last_became_peered":"2024-08-17T02:24:22.744883+0000","last_unstale":"2024-08-17T02:24:23.739800+0000","last_undegraded":"2024-08-17T02:24:23.739800+0000","last_fullsized":"2024-08-17T02:24:23.739800+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:43.224799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.749193+0000","last_change":"2024-08-17T02:24:23.740791+0000","last_active":"2024-08-17T02:24:23.749193+0000","last_peered":"2024-08-17T02:24:23.749193+0000","last_clean":"2024-08-17T02:24:23.749193+0000","last_became_active":"2024-08-17T02:24:23.740524+0000","last_became_peered":"2024-08-17T02:24:23.740524+0000","last_unstale":"2024-08-17T02:24:23.749193+0000","last_undegraded":"2024-08-17T02:24:23.749193+0000","last_fullsized":"2024-08-17T02:24:23.749193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:37:20.039928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.751972+0000","last_change":"2024-08-17T02:24:22.740849+0000","last_active":"2024-08-17T02:24:23.751972+0000","last_peered":"2024-08-17T02:24:23.751972+0000","last_clean":"2024-08-17T02:24:23.751972+0000","last_became_active":"2024-08-17T02:24:22.740546+0000","last_became_peered":"2024-08-17T02:24:22.740546+0000","last_unstale":"2024-08-17T02:24:23.751972+0000","last_undegraded":"2024-08-17T02:24:23.751972+0000","last_fullsized":"2024-08-17T02:24:23.751972+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:58.753958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.745443+0000","last_change":"2024-08-17T02:24:23.745443+0000","last_active":"2024-08-17T02:24:23.745443+0000","last_peered":"2024-08-17T02:24:23.745443+0000","last_clean":"2024-08-17T02:24:23.745443+0000","last_became_active":"2024-08-17T02:24:23.742136+0000","last_became_peered":"2024-08-17T02:24:23.742136+0000","last_unstale":"2024-08-17T02:24:23.745443+0000","last_undegraded":"2024-08-17T02:24:23.745443+0000","last_fullsized":"2024-08-17T02:24:23.745443+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:15:34.819566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.729851+0000","last_change":"2024-08-17T02:24:22.743218+0000","last_active":"2024-08-17T02:24:23.729851+0000","last_peered":"2024-08-17T02:24:23.729851+0000","last_clean":"2024-08-17T02:24:23.729851+0000","last_became_active":"2024-08-17T02:24:22.742838+0000","last_became_peered":"2024-08-17T02:24:22.742838+0000","last_unstale":"2024-08-17T02:24:23.729851+0000","last_undegraded":"2024-08-17T02:24:23.729851+0000","last_fullsized":"2024-08-17T02:24:23.729851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:34:49.589657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.742874+0000","last_change":"2024-08-17T02:24:23.742874+0000","last_active":"2024-08-17T02:24:23.742874+0000","last_peered":"2024-08-17T02:24:23.742874+0000","last_clean":"2024-08-17T02:24:23.742874+0000","last_became_active":"2024-08-17T02:24:23.742620+0000","last_became_peered":"2024-08-17T02:24:23.742620+0000","last_unstale":"2024-08-17T02:24:23.742874+0000","last_undegraded":"2024-08-17T02:24:23.742874+0000","last_fullsized":"2024-08-17T02:24:23.742874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:23:15.798453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:24:22.746761+0000","last_change":"2024-08-17T02:24:22.745640+0000","last_active":"2024-08-17T02:24:22.746761+0000","last_peered":"2024-08-17T02:24:22.746761+0000","last_clean":"2024-08-17T02:24:22.746761+0000","last_became_active":"2024-08-17T02:24:22.745365+0000","last_became_peered":"2024-08-17T02:24:22.745365+0000","last_unstale":"2024-08-17T02:24:22.746761+0000","last_undegraded":"2024-08-17T02:24:22.746761+0000","last_fullsized":"2024-08-17T02:24:22.746761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:29:29.959746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.738715+0000","last_change":"2024-08-17T02:24:23.738715+0000","last_active":"2024-08-17T02:24:23.738715+0000","last_peered":"2024-08-17T02:24:23.738715+0000","last_clean":"2024-08-17T02:24:23.738715+0000","last_became_active":"2024-08-17T02:24:23.735222+0000","last_became_peered":"2024-08-17T02:24:23.735222+0000","last_unstale":"2024-08-17T02:24:23.738715+0000","last_undegraded":"2024-08-17T02:24:23.738715+0000","last_fullsized":"2024-08-17T02:24:23.738715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:39:11.254144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.755484+0000","last_change":"2024-08-17T02:24:22.729448+0000","last_active":"2024-08-17T02:24:23.755484+0000","last_peered":"2024-08-17T02:24:23.755484+0000","last_clean":"2024-08-17T02:24:23.755484+0000","last_became_active":"2024-08-17T02:24:22.729075+0000","last_became_peered":"2024-08-17T02:24:22.729075+0000","last_unstale":"2024-08-17T02:24:23.755484+0000","last_undegraded":"2024-08-17T02:24:23.755484+0000","last_fullsized":"2024-08-17T02:24:23.755484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:25.554270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.733148+0000","last_change":"2024-08-17T02:24:23.733148+0000","last_active":"2024-08-17T02:24:23.733148+0000","last_peered":"2024-08-17T02:24:23.733148+0000","last_clean":"2024-08-17T02:24:23.733148+0000","last_became_active":"2024-08-17T02:24:23.732298+0000","last_became_peered":"2024-08-17T02:24:23.732298+0000","last_unstale":"2024-08-17T02:24:23.733148+0000","last_undegraded":"2024-08-17T02:24:23.733148+0000","last_fullsized":"2024-08-17T02:24:23.733148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:35.324498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:24:22.743035+0000","last_change":"2024-08-17T02:24:22.739580+0000","last_active":"2024-08-17T02:24:22.743035+0000","last_peered":"2024-08-17T02:24:22.743035+0000","last_clean":"2024-08-17T02:24:22.743035+0000","last_became_active":"2024-08-17T02:24:22.737821+0000","last_became_peered":"2024-08-17T02:24:22.737821+0000","last_unstale":"2024-08-17T02:24:22.743035+0000","last_undegraded":"2024-08-17T02:24:22.743035+0000","last_fullsized":"2024-08-17T02:24:22.743035+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:43:02.800534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.734427+0000","last_change":"2024-08-17T02:24:23.734427+0000","last_active":"2024-08-17T02:24:23.734427+0000","last_peered":"2024-08-17T02:24:23.734427+0000","last_clean":"2024-08-17T02:24:23.734427+0000","last_became_active":"2024-08-17T02:24:23.734092+0000","last_became_peered":"2024-08-17T02:24:23.734092+0000","last_unstale":"2024-08-17T02:24:23.734427+0000","last_undegraded":"2024-08-17T02:24:23.734427+0000","last_fullsized":"2024-08-17T02:24:23.734427+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:43:03.810504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:24:22.732788+0000","last_change":"2024-08-17T02:24:22.729596+0000","last_active":"2024-08-17T02:24:22.732788+0000","last_peered":"2024-08-17T02:24:22.732788+0000","last_clean":"2024-08-17T02:24:22.732788+0000","last_became_active":"2024-08-17T02:24:22.729228+0000","last_became_peered":"2024-08-17T02:24:22.729228+0000","last_unstale":"2024-08-17T02:24:22.732788+0000","last_undegraded":"2024-08-17T02:24:22.732788+0000","last_fullsized":"2024-08-17T02:24:22.732788+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:21.261277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.747360+0000","last_change":"2024-08-17T02:24:23.741792+0000","last_active":"2024-08-17T02:24:23.747360+0000","last_peered":"2024-08-17T02:24:23.747360+0000","last_clean":"2024-08-17T02:24:23.747360+0000","last_became_active":"2024-08-17T02:24:23.741244+0000","last_became_peered":"2024-08-17T02:24:23.741244+0000","last_unstale":"2024-08-17T02:24:23.747360+0000","last_undegraded":"2024-08-17T02:24:23.747360+0000","last_fullsized":"2024-08-17T02:24:23.747360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:49:55.156739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.722751+0000","last_change":"2024-08-17T02:24:22.737394+0000","last_active":"2024-08-17T02:24:23.722751+0000","last_peered":"2024-08-17T02:24:23.722751+0000","last_clean":"2024-08-17T02:24:23.722751+0000","last_became_active":"2024-08-17T02:24:22.737125+0000","last_became_peered":"2024-08-17T02:24:22.737125+0000","last_unstale":"2024-08-17T02:24:23.722751+0000","last_undegraded":"2024-08-17T02:24:23.722751+0000","last_fullsized":"2024-08-17T02:24:23.722751+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:12:47.687186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.739058+0000","last_change":"2024-08-17T02:24:23.739058+0000","last_active":"2024-08-17T02:24:23.739058+0000","last_peered":"2024-08-17T02:24:23.739058+0000","last_clean":"2024-08-17T02:24:23.739058+0000","last_became_active":"2024-08-17T02:24:23.738781+0000","last_became_peered":"2024-08-17T02:24:23.738781+0000","last_unstale":"2024-08-17T02:24:23.739058+0000","last_undegraded":"2024-08-17T02:24:23.739058+0000","last_fullsized":"2024-08-17T02:24:23.739058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:44.234769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.751996+0000","last_change":"2024-08-17T02:24:22.733379+0000","last_active":"2024-08-17T02:24:23.751996+0000","last_peered":"2024-08-17T02:24:23.751996+0000","last_clean":"2024-08-17T02:24:23.751996+0000","last_became_active":"2024-08-17T02:24:22.733020+0000","last_became_peered":"2024-08-17T02:24:22.733020+0000","last_unstale":"2024-08-17T02:24:23.751996+0000","last_undegraded":"2024-08-17T02:24:23.751996+0000","last_fullsized":"2024-08-17T02:24:23.751996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:25:44.126698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.736040+0000","last_change":"2024-08-17T02:24:23.733788+0000","last_active":"2024-08-17T02:24:23.736040+0000","last_peered":"2024-08-17T02:24:23.736040+0000","last_clean":"2024-08-17T02:24:23.736040+0000","last_became_active":"2024-08-17T02:24:23.733488+0000","last_became_peered":"2024-08-17T02:24:23.733488+0000","last_unstale":"2024-08-17T02:24:23.736040+0000","last_undegraded":"2024-08-17T02:24:23.736040+0000","last_fullsized":"2024-08-17T02:24:23.736040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:06:58.770100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.719789+0000","last_change":"2024-08-17T02:24:22.729858+0000","last_active":"2024-08-17T02:24:23.719789+0000","last_peered":"2024-08-17T02:24:23.719789+0000","last_clean":"2024-08-17T02:24:23.719789+0000","last_became_active":"2024-08-17T02:24:22.729584+0000","last_became_peered":"2024-08-17T02:24:22.729584+0000","last_unstale":"2024-08-17T02:24:23.719789+0000","last_undegraded":"2024-08-17T02:24:23.719789+0000","last_fullsized":"2024-08-17T02:24:23.719789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:51:40.350049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.753289+0000","last_change":"2024-08-17T02:24:23.752470+0000","last_active":"2024-08-17T02:24:23.753289+0000","last_peered":"2024-08-17T02:24:23.753289+0000","last_clean":"2024-08-17T02:24:23.753289+0000","last_became_active":"2024-08-17T02:24:23.752230+0000","last_became_peered":"2024-08-17T02:24:23.752230+0000","last_unstale":"2024-08-17T02:24:23.753289+0000","last_undegraded":"2024-08-17T02:24:23.753289+0000","last_fullsized":"2024-08-17T02:24:23.753289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:26.380538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:24:22.742584+0000","last_change":"2024-08-17T02:24:22.738082+0000","last_active":"2024-08-17T02:24:22.742584+0000","last_peered":"2024-08-17T02:24:22.742584+0000","last_clean":"2024-08-17T02:24:22.742584+0000","last_became_active":"2024-08-17T02:24:22.737829+0000","last_became_peered":"2024-08-17T02:24:22.737829+0000","last_unstale":"2024-08-17T02:24:22.742584+0000","last_undegraded":"2024-08-17T02:24:22.742584+0000","last_fullsized":"2024-08-17T02:24:22.742584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:58.753958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.735175+0000","last_change":"2024-08-17T02:24:23.735175+0000","last_active":"2024-08-17T02:24:23.735175+0000","last_peered":"2024-08-17T02:24:23.735175+0000","last_clean":"2024-08-17T02:24:23.735175+0000","last_became_active":"2024-08-17T02:24:23.734014+0000","last_became_peered":"2024-08-17T02:24:23.734014+0000","last_unstale":"2024-08-17T02:24:23.735175+0000","last_undegraded":"2024-08-17T02:24:23.735175+0000","last_fullsized":"2024-08-17T02:24:23.735175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:45.471313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.719016+0000","last_change":"2024-08-17T02:24:22.732065+0000","last_active":"2024-08-17T02:24:23.719016+0000","last_peered":"2024-08-17T02:24:23.719016+0000","last_clean":"2024-08-17T02:24:23.719016+0000","last_became_active":"2024-08-17T02:24:22.731824+0000","last_became_peered":"2024-08-17T02:24:22.731824+0000","last_unstale":"2024-08-17T02:24:23.719016+0000","last_undegraded":"2024-08-17T02:24:23.719016+0000","last_fullsized":"2024-08-17T02:24:23.719016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:34.314529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.749642+0000","last_change":"2024-08-17T02:24:23.741975+0000","last_active":"2024-08-17T02:24:23.749642+0000","last_peered":"2024-08-17T02:24:23.749642+0000","last_clean":"2024-08-17T02:24:23.749642+0000","last_became_active":"2024-08-17T02:24:23.740909+0000","last_became_peered":"2024-08-17T02:24:23.740909+0000","last_unstale":"2024-08-17T02:24:23.749642+0000","last_undegraded":"2024-08-17T02:24:23.749642+0000","last_fullsized":"2024-08-17T02:24:23.749642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:20:03.013029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:24:22.740205+0000","last_change":"2024-08-17T02:24:22.733895+0000","last_active":"2024-08-17T02:24:22.740205+0000","last_peered":"2024-08-17T02:24:22.740205+0000","last_clean":"2024-08-17T02:24:22.740205+0000","last_became_active":"2024-08-17T02:24:22.733634+0000","last_became_peered":"2024-08-17T02:24:22.733634+0000","last_unstale":"2024-08-17T02:24:22.740205+0000","last_undegraded":"2024-08-17T02:24:22.740205+0000","last_fullsized":"2024-08-17T02:24:22.740205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:43:02.800534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.762808+0000","last_change":"2024-08-17T02:24:23.755237+0000","last_active":"2024-08-17T02:24:23.762808+0000","last_peered":"2024-08-17T02:24:23.762808+0000","last_clean":"2024-08-17T02:24:23.762808+0000","last_became_active":"2024-08-17T02:24:23.753595+0000","last_became_peered":"2024-08-17T02:24:23.753595+0000","last_unstale":"2024-08-17T02:24:23.762808+0000","last_undegraded":"2024-08-17T02:24:23.762808+0000","last_fullsized":"2024-08-17T02:24:23.762808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:02:21.524568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:24:22.738364+0000","last_change":"2024-08-17T02:24:22.732671+0000","last_active":"2024-08-17T02:24:22.738364+0000","last_peered":"2024-08-17T02:24:22.738364+0000","last_clean":"2024-08-17T02:24:22.738364+0000","last_became_active":"2024-08-17T02:24:22.732379+0000","last_became_peered":"2024-08-17T02:24:22.732379+0000","last_unstale":"2024-08-17T02:24:22.738364+0000","last_undegraded":"2024-08-17T02:24:22.738364+0000","last_fullsized":"2024-08-17T02:24:22.738364+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:03:43.687672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.750404+0000","last_change":"2024-08-17T02:24:23.750404+0000","last_active":"2024-08-17T02:24:23.750404+0000","last_peered":"2024-08-17T02:24:23.750404+0000","last_clean":"2024-08-17T02:24:23.750404+0000","last_became_active":"2024-08-17T02:24:23.750130+0000","last_became_peered":"2024-08-17T02:24:23.750130+0000","last_unstale":"2024-08-17T02:24:23.750404+0000","last_undegraded":"2024-08-17T02:24:23.750404+0000","last_fullsized":"2024-08-17T02:24:23.750404+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:15:34.819566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.732663+0000","last_change":"2024-08-17T02:24:22.740966+0000","last_active":"2024-08-17T02:24:23.732663+0000","last_peered":"2024-08-17T02:24:23.732663+0000","last_clean":"2024-08-17T02:24:23.732663+0000","last_became_active":"2024-08-17T02:24:22.740641+0000","last_became_peered":"2024-08-17T02:24:22.740641+0000","last_unstale":"2024-08-17T02:24:23.732663+0000","last_undegraded":"2024-08-17T02:24:23.732663+0000","last_fullsized":"2024-08-17T02:24:23.732663+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:14:35.412373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.736055+0000","last_change":"2024-08-17T02:24:23.731503+0000","last_active":"2024-08-17T02:24:23.736055+0000","last_peered":"2024-08-17T02:24:23.736055+0000","last_clean":"2024-08-17T02:24:23.736055+0000","last_became_active":"2024-08-17T02:24:23.731161+0000","last_became_peered":"2024-08-17T02:24:23.731161+0000","last_unstale":"2024-08-17T02:24:23.736055+0000","last_undegraded":"2024-08-17T02:24:23.736055+0000","last_fullsized":"2024-08-17T02:24:23.736055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:22.707738+0000","last_clean_scrub_stamp":"2024-08-17T02:24:22.707738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:37:20.039928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:24:22.740916+0000","last_change":"2024-08-17T02:24:22.735592+0000","last_active":"2024-08-17T02:24:22.740916+0000","last_peered":"2024-08-17T02:24:22.740916+0000","last_clean":"2024-08-17T02:24:22.740916+0000","last_became_active":"2024-08-17T02:24:22.734402+0000","last_became_peered":"2024-08-17T02:24:22.734402+0000","last_unstale":"2024-08-17T02:24:22.740916+0000","last_undegraded":"2024-08-17T02:24:22.740916+0000","last_fullsized":"2024-08-17T02:24:22.740916+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:21.697768+0000","last_clean_scrub_stamp":"2024-08-17T02:24:21.697768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:25:44.126698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:24:23.722760+0000","last_change":"2024-08-17T02:23:27.953699+0000","last_active":"2024-08-17T02:24:23.722760+0000","last_peered":"2024-08-17T02:24:23.722760+0000","last_clean":"2024-08-17T02:24:23.722760+0000","last_became_active":"2024-08-17T02:23:27.952879+0000","last_became_peered":"2024-08-17T02:23:27.952879+0000","last_unstale":"2024-08-17T02:24:23.722760+0000","last_undegraded":"2024-08-17T02:24:23.722760+0000","last_fullsized":"2024-08-17T02:24:23.722760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:26.811202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:26.811202+0000","last_clean_scrub_stamp":"2024-08-17T02:23:26.811202+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:48.565059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":958464,"data_stored":728831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":356352,"data_stored":132689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":368640,"data_stored":139033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":356352,"data_stored":132189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301872,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069968,"statfs":{"total":96636764160,"available":96327647232,"internally_reserved":0,"allocated":364544,"data_stored":133659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301860,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069980,"statfs":{"total":96636764160,"available":96327659520,"internally_reserved":0,"allocated":352256,"data_stored":132155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301872,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069968,"statfs":{"total":96636764160,"available":96327647232,"internally_reserved":0,"allocated":364544,"data_stored":133659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302444,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069396,"statfs":{"total":96636764160,"available":96327061504,"internally_reserved":0,"allocated":942080,"data_stored":722453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:24:28.333 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:24:28.334 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-17T02:24:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.528+0000 7f8174e00640 1 Processor -- start 2024-08-17T02:24:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.528+0000 7f8174e00640 1 -- start start 2024-08-17T02:24:28.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.529+0000 7f8174e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81700adfc0 0x7f81700b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.529+0000 7f8174e00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8170067570 0x7f81700b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.529+0000 7f8174e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81700acb20 con 0x7f8170156e40 2024-08-17T02:24:28.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.529+0000 7f8174e00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81700b26e0 con 0x7f8170067570 2024-08-17T02:24:28.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.529+0000 7f8174e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81700ac1f0 con 0x7f81700adfc0 2024-08-17T02:24:28.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.529+0000 7f816de00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8170156e40 0x7f8170066e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54426/0 (socket says 172.21.15.2:54426) 2024-08-17T02:24:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.529+0000 7f816de00640 1 -- 172.21.15.2:0/179036908 learned_addr learned my addr 172.21.15.2:0/179036908 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.530+0000 7f816e800640 1 --2- 172.21.15.2:0/179036908 >> v2:172.21.15.145:3300/0 conn(0x7f8170067570 0x7f81700b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.530+0000 7f8165400640 1 --2- 172.21.15.2:0/179036908 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81700adfc0 0x7f81700b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.530+0000 7f816d400640 1 -- 172.21.15.2:0/179036908 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839085119 0 0) 0x7f81700acb20 con 0x7f8170156e40 2024-08-17T02:24:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.530+0000 7f816d400640 1 -- 172.21.15.2:0/179036908 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81540034e0 con 0x7f8170156e40 2024-08-17T02:24:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.530+0000 7f816e800640 1 -- 172.21.15.2:0/179036908 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81700adfc0 msgr2=0x7f81700b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.530+0000 7f816e800640 1 --2- 172.21.15.2:0/179036908 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81700adfc0 0x7f81700b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.530+0000 7f816e800640 1 -- 172.21.15.2:0/179036908 >> v1:172.21.15.2:6789/0 conn(0x7f8170156e40 legacy=0x7f8170066e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.530+0000 7f816e800640 1 -- 172.21.15.2:0/179036908 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81700ac4d0 con 0x7f8170067570 2024-08-17T02:24:28.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.531+0000 7f816e800640 1 --2- 172.21.15.2:0/179036908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8170067570 0x7f81700b1130 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8168009e60 tx=0x7f8168009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beeb774bae1f30ff server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:28.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.532+0000 7f816d400640 1 -- 172.21.15.2:0/179036908 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8168007550 con 0x7f8170067570 2024-08-17T02:24:28.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.532+0000 7f816d400640 1 -- 172.21.15.2:0/179036908 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816802d050 con 0x7f8170067570 2024-08-17T02:24:28.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.532+0000 7f816d400640 1 -- 172.21.15.2:0/179036908 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8168007900 con 0x7f8170067570 2024-08-17T02:24:28.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.532+0000 7f8174e00640 1 -- 172.21.15.2:0/179036908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8170067570 msgr2=0x7f81700b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.532+0000 7f8174e00640 1 --2- 172.21.15.2:0/179036908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8170067570 0x7f81700b1130 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8168009e60 tx=0x7f8168009780 comp rx=0 tx=0).stop 2024-08-17T02:24:28.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.532+0000 7f8174e00640 1 -- 172.21.15.2:0/179036908 shutdown_connections 2024-08-17T02:24:28.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.532+0000 7f8174e00640 1 --2- 172.21.15.2:0/179036908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8170067570 0x7f81700b1130 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.532+0000 7f8174e00640 1 --2- 172.21.15.2:0/179036908 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81700adfc0 0x7f81700b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.532+0000 7f8174e00640 1 -- 172.21.15.2:0/179036908 >> 172.21.15.2:0/179036908 conn(0x7f8170095a70 msgr2=0x7f8170095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:28.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.533+0000 7f8174e00640 1 -- 172.21.15.2:0/179036908 shutdown_connections 2024-08-17T02:24:28.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.533+0000 7f8174e00640 1 -- 172.21.15.2:0/179036908 wait complete. 2024-08-17T02:24:28.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.534+0000 7f8174e00640 1 Processor -- start 2024-08-17T02:24:28.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.534+0000 7f8174e00640 1 -- start start 2024-08-17T02:24:28.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.535+0000 7f8174e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8170067570 0x7f817014ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.535+0000 7f8174e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8170156e40 0x7f817014fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.535+0000 7f8174e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f817014ffa0 0x7f817014d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.535+0000 7f8174e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817014b3a0 con 0x7f817014ffa0 2024-08-17T02:24:28.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.535+0000 7f8174e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81700aa0d0 con 0x7f8170067570 2024-08-17T02:24:28.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.535+0000 7f8174e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81700aaef0 con 0x7f8170156e40 2024-08-17T02:24:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.535+0000 7f816e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f817014ffa0 0x7f817014d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.536+0000 7f816e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f817014ffa0 0x7f817014d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36252/0 (socket says 172.21.15.2:36252) 2024-08-17T02:24:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.536+0000 7f816e800640 1 -- 172.21.15.2:0/3862329237 learned_addr learned my addr 172.21.15.2:0/3862329237 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.536+0000 7f8165400640 1 --2- 172.21.15.2:0/3862329237 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8170156e40 0x7f817014fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.536+0000 7f816de00640 1 --2- 172.21.15.2:0/3862329237 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8170067570 0x7f817014ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.536+0000 7f816e800640 1 -- 172.21.15.2:0/3862329237 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8170156e40 msgr2=0x7f817014fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.536+0000 7f816e800640 1 --2- 172.21.15.2:0/3862329237 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8170156e40 0x7f817014fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.536+0000 7f816e800640 1 -- 172.21.15.2:0/3862329237 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8170067570 msgr2=0x7f817014ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.536+0000 7f816e800640 1 --2- 172.21.15.2:0/3862329237 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8170067570 0x7f817014ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.536+0000 7f816e800640 1 -- 172.21.15.2:0/3862329237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8168009a20 con 0x7f817014ffa0 2024-08-17T02:24:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.536+0000 7f816e800640 1 --2- 172.21.15.2:0/3862329237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f817014ffa0 0x7f817014d6e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f81680097c0 tx=0x7f8168037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:28.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.536+0000 7f8166000640 1 -- 172.21.15.2:0/3862329237 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8168031ac0 con 0x7f817014ffa0 2024-08-17T02:24:28.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.536+0000 7f8166000640 1 -- 172.21.15.2:0/3862329237 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8168031c20 con 0x7f817014ffa0 2024-08-17T02:24:28.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.537+0000 7f8166000640 1 -- 172.21.15.2:0/3862329237 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816803c420 con 0x7f817014ffa0 2024-08-17T02:24:28.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.537+0000 7f8174e00640 1 -- 172.21.15.2:0/3862329237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8170168b70 con 0x7f817014ffa0 2024-08-17T02:24:28.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.537+0000 7f8174e00640 1 -- 172.21.15.2:0/3862329237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81700aa5c0 con 0x7f817014ffa0 2024-08-17T02:24:28.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.538+0000 7f8174e00640 1 -- 172.21.15.2:0/3862329237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8170063fb0 con 0x7f817014ffa0 2024-08-17T02:24:28.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.538+0000 7f8166000640 1 -- 172.21.15.2:0/3862329237 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8168003040 con 0x7f817014ffa0 2024-08-17T02:24:28.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.539+0000 7f8166000640 1 --2- 172.21.15.2:0/3862329237 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f814c065180 0x7f814c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.539+0000 7f8166000640 1 -- 172.21.15.2:0/3862329237 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f81680a37b0 con 0x7f817014ffa0 2024-08-17T02:24:28.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.540+0000 7f816de00640 1 --2- 172.21.15.2:0/3862329237 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f814c065180 0x7f814c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.540+0000 7f816de00640 1 --2- 172.21.15.2:0/3862329237 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f814c065180 0x7f814c067630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8170064480 tx=0x7f8160009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:28.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.544+0000 7f8166000640 1 -- 172.21.15.2:0/3862329237 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8168071880 con 0x7f817014ffa0 2024-08-17T02:24:28.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.792+0000 7f8174e00640 1 -- 172.21.15.2:0/3862329237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f81700ab030 con 0x7f817014ffa0 2024-08-17T02:24:28.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.795+0000 7f8166000640 1 -- 172.21.15.2:0/3862329237 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f8168074ea0 con 0x7f817014ffa0 2024-08-17T02:24:28.796 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2024-08-17T02:24:28.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.797+0000 7f8174e00640 1 -- 172.21.15.2:0/3862329237 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f814c065180 msgr2=0x7f814c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.798+0000 7f8174e00640 1 --2- 172.21.15.2:0/3862329237 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f814c065180 0x7f814c067630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8170064480 tx=0x7f8160009040 comp rx=0 tx=0).stop 2024-08-17T02:24:28.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.798+0000 7f8174e00640 1 -- 172.21.15.2:0/3862329237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f817014ffa0 msgr2=0x7f817014d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.798+0000 7f8174e00640 1 --2- 172.21.15.2:0/3862329237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f817014ffa0 0x7f817014d6e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f81680097c0 tx=0x7f8168037000 comp rx=0 tx=0).stop 2024-08-17T02:24:28.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.798+0000 7f8174e00640 1 -- 172.21.15.2:0/3862329237 shutdown_connections 2024-08-17T02:24:28.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.798+0000 7f8174e00640 1 --2- 172.21.15.2:0/3862329237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f817014ffa0 0x7f817014d6e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.798+0000 7f8174e00640 1 --2- 172.21.15.2:0/3862329237 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f814c065180 0x7f814c067630 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.798+0000 7f8174e00640 1 --2- 172.21.15.2:0/3862329237 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8170156e40 0x7f817014fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.798+0000 7f8174e00640 1 --2- 172.21.15.2:0/3862329237 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8170067570 0x7f817014ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.798+0000 7f8174e00640 1 -- 172.21.15.2:0/3862329237 >> 172.21.15.2:0/3862329237 conn(0x7f8170095a70 msgr2=0x7f81700ae3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:28.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.798+0000 7f8174e00640 1 -- 172.21.15.2:0/3862329237 shutdown_connections 2024-08-17T02:24:28.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.798+0000 7f8174e00640 1 -- 172.21.15.2:0/3862329237 wait complete. 2024-08-17T02:24:28.814 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:24:28.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.964+0000 7f72aa400640 1 Processor -- start 2024-08-17T02:24:28.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.964+0000 7f72aa400640 1 -- start start 2024-08-17T02:24:28.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.966+0000 7f72aa400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f72a40add30 0x7f72a4156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.966+0000 7f72aa400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a40cb160 con 0x7f72a40ad960 2024-08-17T02:24:28.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.966+0000 7f72aa400640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a40b0d10 con 0x7f72a40ca050 2024-08-17T02:24:28.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.966+0000 7f72aa400640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a40ca550 con 0x7f72a40add30 2024-08-17T02:24:28.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.966+0000 7f72a3400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f72a40ad960 0x7f72a4156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54440/0 (socket says 172.21.15.2:54440) 2024-08-17T02:24:28.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.966+0000 7f72a3400640 1 -- 172.21.15.2:0/2231050510 learned_addr learned my addr 172.21.15.2:0/2231050510 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:28.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.966+0000 7f72a3e00640 1 --2- 172.21.15.2:0/2231050510 >> v2:172.21.15.145:3300/0 conn(0x7f72a40add30 0x7f72a4156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.966+0000 7f72a2a00640 1 -- 172.21.15.2:0/2231050510 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1535608375 0 0) 0x7f72a40cb160 con 0x7f72a40ad960 2024-08-17T02:24:28.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.966+0000 7f72a2a00640 1 -- 172.21.15.2:0/2231050510 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72880034e0 con 0x7f72a40ad960 2024-08-17T02:24:28.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.967+0000 7f72a2a00640 1 -- 172.21.15.2:0/2231050510 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 637554275 0 0) 0x7f72880034e0 con 0x7f72a40ad960 2024-08-17T02:24:28.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.967+0000 7f72a2a00640 1 -- 172.21.15.2:0/2231050510 >> v2:172.21.15.145:3300/0 conn(0x7f72a40add30 msgr2=0x7f72a4156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:28.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.967+0000 7f72a2a00640 1 --2- 172.21.15.2:0/2231050510 >> v2:172.21.15.145:3300/0 conn(0x7f72a40add30 0x7f72a4156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.967+0000 7f72a2a00640 1 -- 172.21.15.2:0/2231050510 >> v1:172.21.15.145:6789/0 conn(0x7f72a40ca050 legacy=0x7f72a40aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.967+0000 7f72a2a00640 1 -- 172.21.15.2:0/2231050510 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a40ca830 con 0x7f72a40ad960 2024-08-17T02:24:28.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.967+0000 7f72a2a00640 1 -- 172.21.15.2:0/2231050510 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7f7294001470 con 0x7f72a40ad960 2024-08-17T02:24:28.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.967+0000 7f72a2a00640 1 -- 172.21.15.2:0/2231050510 >> v1:172.21.15.2:6789/0 conn(0x7f72a40ad960 legacy=0x7f72a4156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.967+0000 7f72a2a00640 1 --2- 172.21.15.2:0/2231050510 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72880039d0 0x7f7288003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.967+0000 7f72a2a00640 1 --2- 172.21.15.2:0/2231050510 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7288004780 0x7f7288004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.967+0000 7f72a2a00640 1 --2- 172.21.15.2:0/2231050510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7288005130 0x7f728800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.967+0000 7f72a2a00640 1 -- 172.21.15.2:0/2231050510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a40ca550 con 0x7f7288005130 2024-08-17T02:24:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.967+0000 7f72a2a00640 1 -- 172.21.15.2:0/2231050510 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728800c040 con 0x7f7288004780 2024-08-17T02:24:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.967+0000 7f72a2a00640 1 -- 172.21.15.2:0/2231050510 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728800c200 con 0x7f72880039d0 2024-08-17T02:24:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.967+0000 7f72a3e00640 1 --2- 172.21.15.2:0/2231050510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7288005130 0x7f728800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.967+0000 7f72a3400640 1 --2- 172.21.15.2:0/2231050510 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72880039d0 0x7f7288003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.967+0000 7f729aa00640 1 --2- 172.21.15.2:0/2231050510 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7288004780 0x7f7288004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.967+0000 7f72a3e00640 1 -- 172.21.15.2:0/2231050510 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72880039d0 msgr2=0x7f7288003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.967+0000 7f72a3e00640 1 --2- 172.21.15.2:0/2231050510 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72880039d0 0x7f7288003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.967+0000 7f72a3e00640 1 -- 172.21.15.2:0/2231050510 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7288004780 msgr2=0x7f7288004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:28.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.967+0000 7f72a3e00640 1 --2- 172.21.15.2:0/2231050510 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7288004780 0x7f7288004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.968+0000 7f72a3e00640 1 -- 172.21.15.2:0/2231050510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72880034e0 con 0x7f7288005130 2024-08-17T02:24:28.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.968+0000 7f729aa00640 1 --2- 172.21.15.2:0/2231050510 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7288004780 0x7f7288004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:28.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.968+0000 7f72a3e00640 1 -- 172.21.15.2:0/2231050510 reap_dead start 2024-08-17T02:24:28.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.968+0000 7f72a3e00640 1 --2- 172.21.15.2:0/2231050510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7288005130 0x7f728800b9d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f729c00e210 tx=0x7f729c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aad8fffa6dc0d6e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:28.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.969+0000 7f72a2a00640 1 -- 172.21.15.2:0/2231050510 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c02c040 con 0x7f7288005130 2024-08-17T02:24:28.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.969+0000 7f72a2a00640 1 -- 172.21.15.2:0/2231050510 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729c00f040 con 0x7f7288005130 2024-08-17T02:24:28.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.969+0000 7f72a2a00640 1 -- 172.21.15.2:0/2231050510 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c030650 con 0x7f7288005130 2024-08-17T02:24:28.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.969+0000 7f72aa400640 1 -- 172.21.15.2:0/2231050510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7288005130 msgr2=0x7f728800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.969+0000 7f72aa400640 1 --2- 172.21.15.2:0/2231050510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7288005130 0x7f728800b9d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f729c00e210 tx=0x7f729c00b040 comp rx=0 tx=0).stop 2024-08-17T02:24:28.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.969+0000 7f72aa400640 1 -- 172.21.15.2:0/2231050510 shutdown_connections 2024-08-17T02:24:28.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.969+0000 7f72aa400640 1 --2- 172.21.15.2:0/2231050510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7288005130 0x7f728800b9d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.969+0000 7f72aa400640 1 -- 172.21.15.2:0/2231050510 >> 172.21.15.2:0/2231050510 conn(0x7f72a4066e60 msgr2=0x7f72a4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:28.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.969+0000 7f72aa400640 1 -- 172.21.15.2:0/2231050510 shutdown_connections 2024-08-17T02:24:28.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.969+0000 7f72aa400640 1 -- 172.21.15.2:0/2231050510 wait complete. 2024-08-17T02:24:28.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.971+0000 7f72aa400640 1 Processor -- start 2024-08-17T02:24:28.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.971+0000 7f72aa400640 1 -- start start 2024-08-17T02:24:28.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.972+0000 7f72aa400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7288005130 0x7f72a40a73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.972+0000 7f72aa400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72a4155180 0x7f72a41555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.972+0000 7f72aa400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72a416a0b0 0x7f72a416a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.972+0000 7f72aa400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a4155b30 con 0x7f7288005130 2024-08-17T02:24:28.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.972+0000 7f72aa400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a4167430 con 0x7f72a416a0b0 2024-08-17T02:24:28.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.972+0000 7f72aa400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a4166b00 con 0x7f72a4155180 2024-08-17T02:24:28.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.972+0000 7f72a3400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7288005130 0x7f72a40a73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.972+0000 7f72a3400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7288005130 0x7f72a40a73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36278/0 (socket says 172.21.15.2:36278) 2024-08-17T02:24:28.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.972+0000 7f72a3400640 1 -- 172.21.15.2:0/22206193 learned_addr learned my addr 172.21.15.2:0/22206193 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:28.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.972+0000 7f72a3e00640 1 --2- 172.21.15.2:0/22206193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72a416a0b0 0x7f72a416a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.972+0000 7f729aa00640 1 --2- 172.21.15.2:0/22206193 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72a4155180 0x7f72a41555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.972+0000 7f72a3400640 1 -- 172.21.15.2:0/22206193 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72a4155180 msgr2=0x7f72a41555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.972+0000 7f72a3400640 1 --2- 172.21.15.2:0/22206193 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72a4155180 0x7f72a41555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.973+0000 7f72a3400640 1 -- 172.21.15.2:0/22206193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72a416a0b0 msgr2=0x7f72a416a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.973+0000 7f72a3400640 1 --2- 172.21.15.2:0/22206193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72a416a0b0 0x7f72a416a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.973+0000 7f72a3400640 1 -- 172.21.15.2:0/22206193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a4166de0 con 0x7f7288005130 2024-08-17T02:24:28.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.973+0000 7f72a3400640 1 --2- 172.21.15.2:0/22206193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7288005130 0x7f72a40a73a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7294007fd0 tx=0x7f7294001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:28.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.973+0000 7f729b400640 1 -- 172.21.15.2:0/22206193 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7294018030 con 0x7f7288005130 2024-08-17T02:24:28.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.973+0000 7f729b400640 1 -- 172.21.15.2:0/22206193 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729400f960 con 0x7f7288005130 2024-08-17T02:24:28.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.973+0000 7f729b400640 1 -- 172.21.15.2:0/22206193 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729400fd00 con 0x7f7288005130 2024-08-17T02:24:28.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.973+0000 7f72aa400640 1 -- 172.21.15.2:0/22206193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a41670c0 con 0x7f7288005130 2024-08-17T02:24:28.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.973+0000 7f72aa400640 1 -- 172.21.15.2:0/22206193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a416aa60 con 0x7f7288005130 2024-08-17T02:24:28.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.974+0000 7f72aa400640 1 -- 172.21.15.2:0/22206193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a4063fb0 con 0x7f7288005130 2024-08-17T02:24:28.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.975+0000 7f729b400640 1 -- 172.21.15.2:0/22206193 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f729401b070 con 0x7f7288005130 2024-08-17T02:24:28.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.976+0000 7f729b400640 1 --2- 172.21.15.2:0/22206193 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7280065150 0x7f7280067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.976+0000 7f729b400640 1 -- 172.21.15.2:0/22206193 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7294019070 con 0x7f7288005130 2024-08-17T02:24:28.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.976+0000 7f729aa00640 1 --2- 172.21.15.2:0/22206193 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7280065150 0x7f7280067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.977+0000 7f729aa00640 1 --2- 172.21.15.2:0/22206193 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7280065150 0x7f7280067600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f728c000c00 tx=0x7f728c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:28.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:28.980+0000 7f729b400640 1 -- 172.21.15.2:0/22206193 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f72940503b0 con 0x7f7288005130 2024-08-17T02:24:29.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.202+0000 7f72aa400640 1 -- 172.21.15.2:0/22206193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72a40687b0 con 0x7f7288005130 2024-08-17T02:24:29.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.203+0000 7f729b400640 1 -- 172.21.15.2:0/22206193 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f72940539d0 con 0x7f7288005130 2024-08-17T02:24:29.204 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:24:29.204 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1347318932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1347318932},{"type":"v1","addr":"172.21.15.2:6834","nonce":1347318932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6836/4156967978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":4156967978},{"type":"v1","addr":"172.21.15.145:6836","nonce":4156967978}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4903,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/1729489536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":1729489536},{"type":"v1","addr":"172.21.15.145:6837","nonce":1729489536}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:23.151218+0000","modified":"2024-08-17T02:24:26.741121+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4950},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4950":{"gid":4950,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/3013258535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3013258535},{"type":"v1","addr":"172.21.15.2:6835","nonce":3013258535}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:24:29.204 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2024-08-17T02:24:29.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.205+0000 7f72aa400640 1 -- 172.21.15.2:0/22206193 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7280065150 msgr2=0x7f7280067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.205+0000 7f72aa400640 1 --2- 172.21.15.2:0/22206193 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7280065150 0x7f7280067600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f728c000c00 tx=0x7f728c009040 comp rx=0 tx=0).stop 2024-08-17T02:24:29.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.205+0000 7f72aa400640 1 -- 172.21.15.2:0/22206193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7288005130 msgr2=0x7f72a40a73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.205+0000 7f72aa400640 1 --2- 172.21.15.2:0/22206193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7288005130 0x7f72a40a73a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7294007fd0 tx=0x7f7294001e50 comp rx=0 tx=0).stop 2024-08-17T02:24:29.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.205+0000 7f72aa400640 1 -- 172.21.15.2:0/22206193 shutdown_connections 2024-08-17T02:24:29.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.205+0000 7f72aa400640 1 --2- 172.21.15.2:0/22206193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72a416a0b0 0x7f72a416a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.205+0000 7f72aa400640 1 --2- 172.21.15.2:0/22206193 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7280065150 0x7f7280067600 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.205+0000 7f72aa400640 1 --2- 172.21.15.2:0/22206193 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f72a4155180 0x7f72a41555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.205+0000 7f72aa400640 1 --2- 172.21.15.2:0/22206193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7288005130 0x7f72a40a73a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.205+0000 7f72aa400640 1 -- 172.21.15.2:0/22206193 >> 172.21.15.2:0/22206193 conn(0x7f72a4066e60 msgr2=0x7f72a415a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:29.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.205+0000 7f72aa400640 1 -- 172.21.15.2:0/22206193 shutdown_connections 2024-08-17T02:24:29.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.205+0000 7f72aa400640 1 -- 172.21.15.2:0/22206193 wait complete. 2024-08-17T02:24:29.623 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:24:23.151218+0000', 'modified': '2024-08-17T02:24:26.741121+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4950}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4950': {'gid': 4950, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6835/3013258535', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6833', 'nonce': 3013258535}, {'type': 'v1', 'addr': '172.21.15.2:6835', 'nonce': 3013258535}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:24:29.624 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:24:29.624 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-17T02:24:29.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.778+0000 7f23c0c00640 1 Processor -- start 2024-08-17T02:24:29.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.779+0000 7f23c0c00640 1 -- start start 2024-08-17T02:24:29.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.780+0000 7f23c0c00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f23bc159eb0 0x7f23bc156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.780+0000 7f23c0c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f23bc0c81a0 0x7f23bc0ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.780+0000 7f23c0c00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23bc157430 con 0x7f23bc0c8620 2024-08-17T02:24:29.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.780+0000 7f23c0c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23bc0b0c50 con 0x7f23bc0c81a0 2024-08-17T02:24:29.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.780+0000 7f23c0c00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23bc0cb1e0 con 0x7f23bc159eb0 2024-08-17T02:24:29.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.780+0000 7f23baa00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f23bc0c81a0 0x7f23bc0ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.780+0000 7f23baa00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f23bc0c81a0 0x7f23bc0ad5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36282/0 (socket says 172.21.15.2:36282) 2024-08-17T02:24:29.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.780+0000 7f23baa00640 1 -- 172.21.15.2:0/248529275 learned_addr learned my addr 172.21.15.2:0/248529275 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:29.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.780+0000 7f23bb400640 1 --2- 172.21.15.2:0/248529275 >> v2:172.21.15.145:3300/0 conn(0x7f23bc159eb0 0x7f23bc156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.781+0000 7f23baa00640 1 -- 172.21.15.2:0/248529275 >> v2:172.21.15.145:3300/0 conn(0x7f23bc159eb0 msgr2=0x7f23bc156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:29.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.781+0000 7f23baa00640 1 --2- 172.21.15.2:0/248529275 >> v2:172.21.15.145:3300/0 conn(0x7f23bc159eb0 0x7f23bc156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.781+0000 7f23baa00640 1 -- 172.21.15.2:0/248529275 >> v1:172.21.15.145:6789/0 conn(0x7f23bc0c8620 legacy=0x7f23bc0af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.781+0000 7f23baa00640 1 -- 172.21.15.2:0/248529275 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23bc0cac20 con 0x7f23bc0c81a0 2024-08-17T02:24:29.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.782+0000 7f23baa00640 1 --2- 172.21.15.2:0/248529275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23bc0c81a0 0x7f23bc0ad5c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f23bc06ca30 tx=0x7f23a80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364cdd20876047e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:29.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.782+0000 7f23ba000640 1 -- 172.21.15.2:0/248529275 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a802ad40 con 0x7f23bc0c81a0 2024-08-17T02:24:29.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.782+0000 7f23ba000640 1 -- 172.21.15.2:0/248529275 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a8032440 con 0x7f23bc0c81a0 2024-08-17T02:24:29.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.782+0000 7f23ba000640 1 -- 172.21.15.2:0/248529275 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a802aea0 con 0x7f23bc0c81a0 2024-08-17T02:24:29.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.783+0000 7f23c0c00640 1 -- 172.21.15.2:0/248529275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23bc0c81a0 msgr2=0x7f23bc0ad5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.783+0000 7f23c0c00640 1 --2- 172.21.15.2:0/248529275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23bc0c81a0 0x7f23bc0ad5c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f23bc06ca30 tx=0x7f23a80091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.783+0000 7f23c0c00640 1 -- 172.21.15.2:0/248529275 shutdown_connections 2024-08-17T02:24:29.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.783+0000 7f23c0c00640 1 --2- 172.21.15.2:0/248529275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23bc0c81a0 0x7f23bc0ad5c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.783+0000 7f23c0c00640 1 --2- 172.21.15.2:0/248529275 >> v2:172.21.15.145:3300/0 conn(0x7f23bc159eb0 0x7f23bc156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.783+0000 7f23c0c00640 1 -- 172.21.15.2:0/248529275 >> 172.21.15.2:0/248529275 conn(0x7f23bc066e60 msgr2=0x7f23bc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:29.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.783+0000 7f23c0c00640 1 -- 172.21.15.2:0/248529275 shutdown_connections 2024-08-17T02:24:29.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.783+0000 7f23c0c00640 1 -- 172.21.15.2:0/248529275 wait complete. 2024-08-17T02:24:29.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.784+0000 7f23c0c00640 1 Processor -- start 2024-08-17T02:24:29.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.784+0000 7f23c0c00640 1 -- start start 2024-08-17T02:24:29.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.785+0000 7f23c0c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23bc0c81a0 0x7f23bc13eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.785+0000 7f23c0c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f23bc0c8620 0x7f23bc169120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.785+0000 7f23c0c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23bc159eb0 0x7f23bc0af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.785+0000 7f23c0c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc16a150 con 0x7f23bc0c81a0 2024-08-17T02:24:29.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.785+0000 7f23c0c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc16cc90 con 0x7f23bc159eb0 2024-08-17T02:24:29.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.785+0000 7f23c0c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc169b90 con 0x7f23bc0c8620 2024-08-17T02:24:29.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.786+0000 7f23bb400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23bc0c81a0 0x7f23bc13eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.786+0000 7f23bb400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23bc0c81a0 0x7f23bc13eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36290/0 (socket says 172.21.15.2:36290) 2024-08-17T02:24:29.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.786+0000 7f23bb400640 1 -- 172.21.15.2:0/334293842 learned_addr learned my addr 172.21.15.2:0/334293842 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:29.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.786+0000 7f23bbe00640 1 --2- 172.21.15.2:0/334293842 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23bc159eb0 0x7f23bc0af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.786+0000 7f23baa00640 1 --2- 172.21.15.2:0/334293842 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f23bc0c8620 0x7f23bc169120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.786+0000 7f23bb400640 1 -- 172.21.15.2:0/334293842 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f23bc0c8620 msgr2=0x7f23bc169120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.786+0000 7f23bb400640 1 --2- 172.21.15.2:0/334293842 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f23bc0c8620 0x7f23bc169120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.786+0000 7f23bb400640 1 -- 172.21.15.2:0/334293842 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23bc159eb0 msgr2=0x7f23bc0af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.786+0000 7f23bb400640 1 --2- 172.21.15.2:0/334293842 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23bc159eb0 0x7f23bc0af110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.786+0000 7f23bb400640 1 -- 172.21.15.2:0/334293842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a8009450 con 0x7f23bc0c81a0 2024-08-17T02:24:29.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.786+0000 7f23bb400640 1 --2- 172.21.15.2:0/334293842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23bc0c81a0 0x7f23bc13eb40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f23ac00e900 tx=0x7f23ac0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:29.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.787+0000 7f23b2a00640 1 -- 172.21.15.2:0/334293842 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac00c8e0 con 0x7f23bc0c81a0 2024-08-17T02:24:29.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.787+0000 7f23b2a00640 1 -- 172.21.15.2:0/334293842 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ac00ca40 con 0x7f23bc0c81a0 2024-08-17T02:24:29.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.787+0000 7f23b2a00640 1 -- 172.21.15.2:0/334293842 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac00cde0 con 0x7f23bc0c81a0 2024-08-17T02:24:29.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.787+0000 7f23c0c00640 1 -- 172.21.15.2:0/334293842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23bc169e70 con 0x7f23bc0c81a0 2024-08-17T02:24:29.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.787+0000 7f23c0c00640 1 -- 172.21.15.2:0/334293842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23bc13f080 con 0x7f23bc0c81a0 2024-08-17T02:24:29.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.789+0000 7f23b2a00640 1 -- 172.21.15.2:0/334293842 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f23ac013680 con 0x7f23bc0c81a0 2024-08-17T02:24:29.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.789+0000 7f23b2a00640 1 --2- 172.21.15.2:0/334293842 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f239c065180 0x7f239c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.789+0000 7f23b2a00640 1 -- 172.21.15.2:0/334293842 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f23ac082650 con 0x7f23bc0c81a0 2024-08-17T02:24:29.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.790+0000 7f23baa00640 1 --2- 172.21.15.2:0/334293842 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f239c065180 0x7f239c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.790+0000 7f23c47c5740 1 Processor -- start 2024-08-17T02:24:29.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.790+0000 7f23c47c5740 1 -- start start 2024-08-17T02:24:29.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.791+0000 7f23baa00640 1 --2- 172.21.15.2:0/334293842 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f239c065180 0x7f239c067630 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f23a8034000 tx=0x7f23a8032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:29.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.791+0000 7f23c47c5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c4651bc0 0x5588c4651f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.791+0000 7f23c47c5740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5588c462d230 0x5588c466f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.791+0000 7f23c47c5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5588c466fca0 0x5588c4626a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.791+0000 7f23c47c5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c45e7380 con 0x5588c4651bc0 2024-08-17T02:24:29.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.791+0000 7f23c47c5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c45909e0 con 0x5588c466fca0 2024-08-17T02:24:29.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.791+0000 7f23c47c5740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588c458e170 con 0x5588c462d230 2024-08-17T02:24:29.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.791+0000 7f23bb400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c4651bc0 0x5588c4651f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.791+0000 7f23bb400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c4651bc0 0x5588c4651f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36298/0 (socket says 172.21.15.2:36298) 2024-08-17T02:24:29.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.791+0000 7f23bb400640 1 -- 172.21.15.2:0/3552385433 learned_addr learned my addr 172.21.15.2:0/3552385433 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:29.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.791+0000 7f23baa00640 1 --2- 172.21.15.2:0/3552385433 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5588c462d230 0x5588c466f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.792+0000 7f23bbe00640 1 --2- 172.21.15.2:0/3552385433 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5588c466fca0 0x5588c4626a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.792+0000 7f23bb400640 1 -- 172.21.15.2:0/3552385433 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5588c462d230 msgr2=0x5588c466f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:29.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.792+0000 7f23bb400640 1 --2- 172.21.15.2:0/3552385433 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5588c462d230 0x5588c466f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.792+0000 7f23bb400640 1 -- 172.21.15.2:0/3552385433 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5588c466fca0 msgr2=0x5588c4626a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:29.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.792+0000 7f23bb400640 1 --2- 172.21.15.2:0/3552385433 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5588c466fca0 0x5588c4626a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.792+0000 7f23bb400640 1 -- 172.21.15.2:0/3552385433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588c453d820 con 0x5588c4651bc0 2024-08-17T02:24:29.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.792+0000 7f23baa00640 1 --2- 172.21.15.2:0/3552385433 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5588c462d230 0x5588c466f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:29.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.792+0000 7f23bb400640 1 --2- 172.21.15.2:0/3552385433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c4651bc0 0x5588c4651f90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f23ac053dd0 tx=0x7f23ac080a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4774e424f88a3197 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:29.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.792+0000 7f23a7400640 1 -- 172.21.15.2:0/3552385433 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac0543f0 con 0x5588c4651bc0 2024-08-17T02:24:29.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.792+0000 7f23a7400640 1 -- 172.21.15.2:0/3552385433 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ac057640 con 0x5588c4651bc0 2024-08-17T02:24:29.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.792+0000 7f23a7400640 1 -- 172.21.15.2:0/3552385433 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac05b390 con 0x5588c4651bc0 2024-08-17T02:24:29.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.793+0000 7f23c47c5740 1 -- 172.21.15.2:0/3552385433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c4651bc0 msgr2=0x5588c4651f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.793+0000 7f23c47c5740 1 --2- 172.21.15.2:0/3552385433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c4651bc0 0x5588c4651f90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f23ac053dd0 tx=0x7f23ac080a30 comp rx=0 tx=0).stop 2024-08-17T02:24:29.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.793+0000 7f23c47c5740 1 -- 172.21.15.2:0/3552385433 shutdown_connections 2024-08-17T02:24:29.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.793+0000 7f23c47c5740 1 --2- 172.21.15.2:0/3552385433 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5588c466fca0 0x5588c4626a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.793+0000 7f23c47c5740 1 --2- 172.21.15.2:0/3552385433 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5588c462d230 0x5588c466f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.793+0000 7f23c47c5740 1 --2- 172.21.15.2:0/3552385433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c4651bc0 0x5588c4651f90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.793+0000 7f23c47c5740 1 -- 172.21.15.2:0/3552385433 >> 172.21.15.2:0/3552385433 conn(0x5588c45c5030 msgr2=0x5588c4673e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:29.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.793+0000 7f23c47c5740 1 -- 172.21.15.2:0/3552385433 shutdown_connections 2024-08-17T02:24:29.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.793+0000 7f23c47c5740 1 -- 172.21.15.2:0/3552385433 wait complete. 2024-08-17T02:24:29.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.794+0000 7f23c47c5740 1 -- start start 2024-08-17T02:24:29.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.794+0000 7f23c47c5740 1 Processor -- start 2024-08-17T02:24:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.795+0000 7f23c47c5740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5588c462d230 0x5588c4653a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.795+0000 7f23c47c5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c4651bc0 0x5588c4650380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.795+0000 7f23c47c5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5588c466fca0 0x5588c464cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.795+0000 7f23c47c5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c4589f60 con 0x5588c4651bc0 2024-08-17T02:24:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.795+0000 7f23c47c5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c4532690 con 0x5588c466fca0 2024-08-17T02:24:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.795+0000 7f23c47c5740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588c4532330 con 0x5588c462d230 2024-08-17T02:24:29.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.795+0000 7f23c47c5740 10 client.0 _ll_register_callbacks cb 0x5588c452c2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:24:29.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.795+0000 7f23baa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c4651bc0 0x5588c4650380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.795+0000 7f23baa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c4651bc0 0x5588c4650380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36310/0 (socket says 172.21.15.2:36310) 2024-08-17T02:24:29.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.795+0000 7f23baa00640 1 -- 172.21.15.2:0/2901785299 learned_addr learned my addr 172.21.15.2:0/2901785299 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:29.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.795+0000 7f23bbe00640 1 --2- 172.21.15.2:0/2901785299 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5588c466fca0 0x5588c464cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.795+0000 7f23bb400640 1 --2- 172.21.15.2:0/2901785299 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5588c462d230 0x5588c4653a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.795+0000 7f23baa00640 1 -- 172.21.15.2:0/2901785299 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5588c462d230 msgr2=0x5588c4653a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:29.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.795+0000 7f23baa00640 1 --2- 172.21.15.2:0/2901785299 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5588c462d230 0x5588c4653a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.795+0000 7f23baa00640 1 -- 172.21.15.2:0/2901785299 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5588c466fca0 msgr2=0x5588c464cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:29.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.795+0000 7f23baa00640 1 --2- 172.21.15.2:0/2901785299 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5588c466fca0 0x5588c464cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.795+0000 7f23baa00640 1 -- 172.21.15.2:0/2901785299 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23bc13f080 con 0x5588c4651bc0 2024-08-17T02:24:29.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.795+0000 7f23bbe00640 1 --2- 172.21.15.2:0/2901785299 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5588c466fca0 0x5588c464cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:29.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.795+0000 7f23bb400640 1 --2- 172.21.15.2:0/2901785299 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5588c462d230 0x5588c4653a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:29.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.796+0000 7f23baa00640 1 --2- 172.21.15.2:0/2901785299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c4651bc0 0x5588c4650380 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f23a8009940 tx=0x7f23a803c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850801f10d5136aa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:29.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.796+0000 7f239be00640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-17T02:24:29.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.796+0000 7f239be00640 1 -- 172.21.15.2:0/2901785299 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a8000ce0 con 0x5588c4651bc0 2024-08-17T02:24:29.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.796+0000 7f23c47c5740 1 -- 172.21.15.2:0/2901785299 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588c45bdd20 con 0x5588c4651bc0 2024-08-17T02:24:29.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.796+0000 7f239be00640 1 -- 172.21.15.2:0/2901785299 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f23a8042040 con 0x5588c4651bc0 2024-08-17T02:24:29.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.796+0000 7f239be00640 1 -- 172.21.15.2:0/2901785299 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23a803f910 con 0x5588c4651bc0 2024-08-17T02:24:29.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.796+0000 7f23c47c5740 10 client.5109 fetch_fsmap learned FSMap version 17 2024-08-17T02:24:29.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.796+0000 7f23c47c5740 1 -- 172.21.15.2:0/2901785299 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5588c4553ab0 con 0x5588c4651bc0 2024-08-17T02:24:29.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.796+0000 7f239be00640 1 -- 172.21.15.2:0/2901785299 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5588c45bdd20 con 0x5588c4651bc0 2024-08-17T02:24:29.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.797+0000 7f239be00640 1 -- 172.21.15.2:0/2901785299 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f23a803fd40 con 0x5588c4651bc0 2024-08-17T02:24:29.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.797+0000 7f23c47c5740 10 client.5109 fetch_fsmap finished waiting for FSMap version 17 2024-08-17T02:24:29.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.797+0000 7f23c47c5740 10 client.5109 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:24:29.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.797+0000 7f23c47c5740 20 client.5109 populate_metadata read hostname 'smithi002' 2024-08-17T02:24:29.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.797+0000 7f23c47c5740 1 --2- 172.21.15.2:0/2901785299 >> [v2:172.21.15.2:6833/3013258535,v1:172.21.15.2:6835/3013258535] conn(0x5588c464e710 0x5588c46718c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.797+0000 7f23c47c5740 4 client.5109 mds_command: new command op to 4950 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:24:29.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.797+0000 7f23c47c5740 1 -- 172.21.15.2:0/2901785299 --> [v2:172.21.15.2:6833/3013258535,v1:172.21.15.2:6835/3013258535] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5588c42913c0 con 0x5588c464e710 2024-08-17T02:24:29.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.797+0000 7f23bb400640 1 --2- 172.21.15.2:0/2901785299 >> [v2:172.21.15.2:6833/3013258535,v1:172.21.15.2:6835/3013258535] conn(0x5588c464e710 0x5588c46718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.797+0000 7f23bb400640 1 --2- 172.21.15.2:0/2901785299 >> [v2:172.21.15.2:6833/3013258535,v1:172.21.15.2:6835/3013258535] conn(0x5588c464e710 0x5588c46718c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c93ecdc2cf7560a3 server_cookie=63ba32931bb58608 in_seq=0 out_seq=0 2024-08-17T02:24:29.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.797+0000 7f239be00640 10 client.5109 ms_handle_connect on v2:172.21.15.2:6833/3013258535 2024-08-17T02:24:29.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.798+0000 7f239be00640 1 -- 172.21.15.2:0/2901785299 <== mds.0 v2:172.21.15.2:6833/3013258535 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x5588c42913c0 con 0x5588c464e710 2024-08-17T02:24:29.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.798+0000 7f239be00640 10 client.5109 handle_command_reply: tid=0 2024-08-17T02:24:29.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.798+0000 7f23c47c5740 1 client.5109 shutdown 2024-08-17T02:24:29.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.798+0000 7f23c47c5740 1 -- 172.21.15.2:0/2901785299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c4651bc0 msgr2=0x5588c4650380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.798+0000 7f23c47c5740 1 --2- 172.21.15.2:0/2901785299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c4651bc0 0x5588c4650380 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f23a8009940 tx=0x7f23a803c000 comp rx=0 tx=0).stop 2024-08-17T02:24:29.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.798+0000 7f23c47c5740 1 -- 172.21.15.2:0/2901785299 shutdown_connections 2024-08-17T02:24:29.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.798+0000 7f23c47c5740 1 --2- 172.21.15.2:0/2901785299 >> [v2:172.21.15.2:6833/3013258535,v1:172.21.15.2:6835/3013258535] conn(0x5588c464e710 0x5588c46718c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.798+0000 7f23c47c5740 1 --2- 172.21.15.2:0/2901785299 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5588c466fca0 0x5588c464cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.798+0000 7f23c47c5740 1 --2- 172.21.15.2:0/2901785299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c4651bc0 0x5588c4650380 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.798+0000 7f239be00640 0 client.5109 ms_handle_reset on v2:172.21.15.2:6833/3013258535 2024-08-17T02:24:29.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.798+0000 7f23c47c5740 1 --2- 172.21.15.2:0/2901785299 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5588c462d230 0x5588c4653a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.798+0000 7f23c47c5740 1 -- 172.21.15.2:0/2901785299 >> 172.21.15.2:0/2901785299 conn(0x5588c45c5030 msgr2=0x5588c4673b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:29.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.799+0000 7f23c47c5740 1 -- 172.21.15.2:0/2901785299 shutdown_connections 2024-08-17T02:24:29.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.799+0000 7f23c47c5740 1 -- 172.21.15.2:0/2901785299 wait complete. 2024-08-17T02:24:29.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.799+0000 7f23c47c5740 20 client.5109 trim_cache size 0 max 16384 2024-08-17T02:24:29.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.814+0000 7f23c47c5740 1 Processor -- start 2024-08-17T02:24:29.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.815+0000 7f23c47c5740 1 -- start start 2024-08-17T02:24:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.815+0000 7f23c47c5740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5588c462d230 0x5588c4671920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.815+0000 7f23c47c5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5588c4651bc0 0x5588c4688c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.815+0000 7f23c47c5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c466fca0 0x5588c46891d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.815+0000 7f23c47c5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c4304f20 con 0x5588c466fca0 2024-08-17T02:24:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.815+0000 7f23c47c5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c4628510 con 0x5588c4651bc0 2024-08-17T02:24:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.815+0000 7f23c47c5740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588c462cb10 con 0x5588c462d230 2024-08-17T02:24:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.816+0000 7f23bbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c466fca0 0x5588c46891d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.816+0000 7f23bbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c466fca0 0x5588c46891d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36316/0 (socket says 172.21.15.2:36316) 2024-08-17T02:24:29.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.816+0000 7f23bbe00640 1 -- 172.21.15.2:0/1127192407 learned_addr learned my addr 172.21.15.2:0/1127192407 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:29.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.816+0000 7f23bbe00640 1 -- 172.21.15.2:0/1127192407 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5588c462d230 msgr2=0x5588c4671920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:29.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.816+0000 7f23bb400640 1 --2- 172.21.15.2:0/1127192407 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5588c462d230 0x5588c4671920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.816+0000 7f23bbe00640 1 --2- 172.21.15.2:0/1127192407 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5588c462d230 0x5588c4671920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.816+0000 7f23baa00640 1 --2- 172.21.15.2:0/1127192407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5588c4651bc0 0x5588c4688c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.816+0000 7f23bbe00640 1 -- 172.21.15.2:0/1127192407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5588c4651bc0 msgr2=0x5588c4688c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:29.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.816+0000 7f23bbe00640 1 --2- 172.21.15.2:0/1127192407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5588c4651bc0 0x5588c4688c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.816+0000 7f23bbe00640 1 -- 172.21.15.2:0/1127192407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588c4557490 con 0x5588c466fca0 2024-08-17T02:24:29.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.816+0000 7f23baa00640 1 --2- 172.21.15.2:0/1127192407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5588c4651bc0 0x5588c4688c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:29.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.816+0000 7f23bbe00640 1 --2- 172.21.15.2:0/1127192407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c466fca0 0x5588c46891d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f23b4001850 tx=0x7f23b4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911f6dea0856e40b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:29.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.817+0000 7f23a7e00640 1 -- 172.21.15.2:0/1127192407 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b4003a40 con 0x5588c466fca0 2024-08-17T02:24:29.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.817+0000 7f23a7e00640 1 -- 172.21.15.2:0/1127192407 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b4003ba0 con 0x5588c466fca0 2024-08-17T02:24:29.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.817+0000 7f23a7e00640 1 -- 172.21.15.2:0/1127192407 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b4003f60 con 0x5588c466fca0 2024-08-17T02:24:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.817+0000 7f23c47c5740 1 -- 172.21.15.2:0/1127192407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c466fca0 msgr2=0x5588c46891d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.817+0000 7f23c47c5740 1 --2- 172.21.15.2:0/1127192407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c466fca0 0x5588c46891d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f23b4001850 tx=0x7f23b4009040 comp rx=0 tx=0).stop 2024-08-17T02:24:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.817+0000 7f23c47c5740 1 -- 172.21.15.2:0/1127192407 shutdown_connections 2024-08-17T02:24:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.817+0000 7f23c47c5740 1 --2- 172.21.15.2:0/1127192407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c466fca0 0x5588c46891d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.817+0000 7f23c47c5740 1 --2- 172.21.15.2:0/1127192407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5588c4651bc0 0x5588c4688c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.817+0000 7f23c47c5740 1 --2- 172.21.15.2:0/1127192407 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5588c462d230 0x5588c4671920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.817+0000 7f23c47c5740 1 -- 172.21.15.2:0/1127192407 >> 172.21.15.2:0/1127192407 conn(0x5588c45c5030 msgr2=0x5588c4673b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.817+0000 7f23c47c5740 1 -- 172.21.15.2:0/1127192407 shutdown_connections 2024-08-17T02:24:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.817+0000 7f23c47c5740 1 -- 172.21.15.2:0/1127192407 wait complete. 2024-08-17T02:24:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.818+0000 7f23c47c5740 1 -- start start 2024-08-17T02:24:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.818+0000 7f23c47c5740 1 Processor -- start 2024-08-17T02:24:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.819+0000 7f23c47c5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c462d230 0x5588c4650230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.819+0000 7f23c47c5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5588c4651bc0 0x5588c46bdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.819+0000 7f23c47c5740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5588c466fca0 0x5588c462ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.819+0000 7f23c47c5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c46d9270 con 0x5588c462d230 2024-08-17T02:24:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.819+0000 7f23c47c5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c46be460 con 0x5588c4651bc0 2024-08-17T02:24:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.819+0000 7f23c47c5740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588c46cf8d0 con 0x5588c466fca0 2024-08-17T02:24:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.819+0000 7f23c47c5740 10 client.0 _ll_register_callbacks cb 0x7f23a8003040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:24:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.819+0000 7f23bb400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c462d230 0x5588c4650230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.819+0000 7f23bb400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c462d230 0x5588c4650230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36332/0 (socket says 172.21.15.2:36332) 2024-08-17T02:24:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.819+0000 7f23bb400640 1 -- 172.21.15.2:0/667817616 learned_addr learned my addr 172.21.15.2:0/667817616 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.819+0000 7f23baa00640 1 --2- 172.21.15.2:0/667817616 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5588c4651bc0 0x5588c46bdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.819+0000 7f23bbe00640 1 --2- 172.21.15.2:0/667817616 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5588c466fca0 0x5588c462ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.820+0000 7f23bb400640 1 -- 172.21.15.2:0/667817616 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5588c466fca0 msgr2=0x5588c462ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.820+0000 7f23bb400640 1 --2- 172.21.15.2:0/667817616 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5588c466fca0 0x5588c462ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.820+0000 7f23bb400640 1 -- 172.21.15.2:0/667817616 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5588c4651bc0 msgr2=0x5588c46bdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.820+0000 7f23bb400640 1 --2- 172.21.15.2:0/667817616 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5588c4651bc0 0x5588c46bdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.820+0000 7f23bb400640 1 -- 172.21.15.2:0/667817616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b40015a0 con 0x5588c462d230 2024-08-17T02:24:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.820+0000 7f23bbe00640 1 --2- 172.21.15.2:0/667817616 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5588c466fca0 0x5588c462ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.820+0000 7f23bb400640 1 --2- 172.21.15.2:0/667817616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c462d230 0x5588c4650230 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0508f0 tx=0x7f23ac06c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850a2ac6a8d644e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.820+0000 7f239be00640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-17T02:24:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.820+0000 7f239be00640 1 -- 172.21.15.2:0/667817616 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac050730 con 0x5588c462d230 2024-08-17T02:24:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.820+0000 7f239be00640 1 -- 172.21.15.2:0/667817616 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f23ac052530 con 0x5588c462d230 2024-08-17T02:24:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.820+0000 7f23c47c5740 1 -- 172.21.15.2:0/667817616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f23ac057640 con 0x5588c462d230 2024-08-17T02:24:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.820+0000 7f239be00640 1 -- 172.21.15.2:0/667817616 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23ac05af00 con 0x5588c462d230 2024-08-17T02:24:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.820+0000 7f23c47c5740 10 client.5115 fetch_fsmap learned FSMap version 17 2024-08-17T02:24:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.820+0000 7f23c47c5740 1 -- 172.21.15.2:0/667817616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5588c45571e0 con 0x5588c462d230 2024-08-17T02:24:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.821+0000 7f239be00640 1 -- 172.21.15.2:0/667817616 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ac076020 con 0x5588c462d230 2024-08-17T02:24:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.821+0000 7f239be00640 1 -- 172.21.15.2:0/667817616 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f23ac011070 con 0x5588c462d230 2024-08-17T02:24:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.821+0000 7f23c47c5740 10 client.5115 fetch_fsmap finished waiting for FSMap version 17 2024-08-17T02:24:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.821+0000 7f23c47c5740 10 client.5115 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:24:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.821+0000 7f23c47c5740 20 client.5115 populate_metadata read hostname 'smithi002' 2024-08-17T02:24:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.821+0000 7f23c47c5740 1 --2- 172.21.15.2:0/667817616 >> [v2:172.21.15.2:6833/3013258535,v1:172.21.15.2:6835/3013258535] conn(0x5588c462b2e0 0x5588c46d8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.821+0000 7f23c47c5740 4 client.5115 mds_command: new command op to 4950 tid=0[{"prefix": "status"}] 2024-08-17T02:24:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.821+0000 7f23c47c5740 1 -- 172.21.15.2:0/667817616 --> [v2:172.21.15.2:6833/3013258535,v1:172.21.15.2:6835/3013258535] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5588c42a26c0 con 0x5588c462b2e0 2024-08-17T02:24:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.821+0000 7f23baa00640 1 --2- 172.21.15.2:0/667817616 >> [v2:172.21.15.2:6833/3013258535,v1:172.21.15.2:6835/3013258535] conn(0x5588c462b2e0 0x5588c46d8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.822+0000 7f23baa00640 1 --2- 172.21.15.2:0/667817616 >> [v2:172.21.15.2:6833/3013258535,v1:172.21.15.2:6835/3013258535] conn(0x5588c462b2e0 0x5588c46d8440 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6c79c2e5aa1678f server_cookie=d875b584cdecf5f8 in_seq=0 out_seq=0 2024-08-17T02:24:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.822+0000 7f239be00640 10 client.5115 ms_handle_connect on v2:172.21.15.2:6833/3013258535 2024-08-17T02:24:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.822+0000 7f239be00640 1 -- 172.21.15.2:0/667817616 <== mds.0 v2:172.21.15.2:6833/3013258535 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x5588c42a26c0 con 0x5588c462b2e0 2024-08-17T02:24:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.822+0000 7f239be00640 10 client.5115 handle_command_reply: tid=0 2024-08-17T02:24:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.822+0000 7f23c47c5740 1 client.5115 shutdown 2024-08-17T02:24:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.822+0000 7f23c47c5740 1 -- 172.21.15.2:0/667817616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c462d230 msgr2=0x5588c4650230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.822+0000 7f23c47c5740 1 --2- 172.21.15.2:0/667817616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c462d230 0x5588c4650230 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0508f0 tx=0x7f23ac06c040 comp rx=0 tx=0).stop 2024-08-17T02:24:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.822+0000 7f23c47c5740 1 -- 172.21.15.2:0/667817616 shutdown_connections 2024-08-17T02:24:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.822+0000 7f23c47c5740 1 --2- 172.21.15.2:0/667817616 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5588c466fca0 0x5588c462ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.822+0000 7f23c47c5740 1 --2- 172.21.15.2:0/667817616 >> [v2:172.21.15.2:6833/3013258535,v1:172.21.15.2:6835/3013258535] conn(0x5588c462b2e0 0x5588c46d8440 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.822+0000 7f23c47c5740 1 --2- 172.21.15.2:0/667817616 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5588c4651bc0 0x5588c46bdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.822+0000 7f23c47c5740 1 --2- 172.21.15.2:0/667817616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588c462d230 0x5588c4650230 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.822+0000 7f23c47c5740 1 -- 172.21.15.2:0/667817616 >> 172.21.15.2:0/667817616 conn(0x5588c45c5030 msgr2=0x5588c4688c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.822+0000 7f239be00640 0 client.5115 ms_handle_reset on v2:172.21.15.2:6833/3013258535 2024-08-17T02:24:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.822+0000 7f23c47c5740 1 -- 172.21.15.2:0/667817616 shutdown_connections 2024-08-17T02:24:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.822+0000 7f23c47c5740 1 -- 172.21.15.2:0/667817616 wait complete. 2024-08-17T02:24:29.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.822+0000 7f23c47c5740 20 client.5115 trim_cache size 0 max 16384 2024-08-17T02:24:29.834 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-17T02:24:29.834 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "66491975-1283-4d8c-92e2-26a46f113139", 2024-08-17T02:24:29.834 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-08-17T02:24:29.834 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 4950, 2024-08-17T02:24:29.834 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-08-17T02:24:29.834 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-08-17T02:24:29.834 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-08-17T02:24:29.834 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 6.106922977, 2024-08-17T02:24:29.835 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 17, 2024-08-17T02:24:29.835 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 32, 2024-08-17T02:24:29.835 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 32, 2024-08-17T02:24:29.835 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 13.994702572 2024-08-17T02:24:29.835 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-17T02:24:29.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.823+0000 7f23c0c00640 1 -- 172.21.15.2:0/334293842 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f239c065180 msgr2=0x7f239c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.823+0000 7f23c0c00640 1 --2- 172.21.15.2:0/334293842 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f239c065180 0x7f239c067630 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f23a8034000 tx=0x7f23a8032000 comp rx=0 tx=0).stop 2024-08-17T02:24:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.823+0000 7f23c0c00640 1 -- 172.21.15.2:0/334293842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23bc0c81a0 msgr2=0x7f23bc13eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.823+0000 7f23c0c00640 1 --2- 172.21.15.2:0/334293842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23bc0c81a0 0x7f23bc13eb40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f23ac00e900 tx=0x7f23ac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.823+0000 7f23c0c00640 1 -- 172.21.15.2:0/334293842 shutdown_connections 2024-08-17T02:24:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.823+0000 7f23c0c00640 1 --2- 172.21.15.2:0/334293842 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23bc159eb0 0x7f23bc0af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.823+0000 7f23c0c00640 1 --2- 172.21.15.2:0/334293842 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f239c065180 0x7f239c067630 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.823+0000 7f23c0c00640 1 --2- 172.21.15.2:0/334293842 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f23bc0c8620 0x7f23bc169120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.823+0000 7f23c0c00640 1 --2- 172.21.15.2:0/334293842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23bc0c81a0 0x7f23bc13eb40 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.823+0000 7f23c0c00640 1 -- 172.21.15.2:0/334293842 >> 172.21.15.2:0/334293842 conn(0x7f23bc066e60 msgr2=0x7f23bc06db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.823+0000 7f23c0c00640 1 -- 172.21.15.2:0/334293842 shutdown_connections 2024-08-17T02:24:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.823+0000 7f23c0c00640 1 -- 172.21.15.2:0/334293842 wait complete. 2024-08-17T02:24:29.840 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:24:29.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.991+0000 7f900ba00640 1 Processor -- start 2024-08-17T02:24:29.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.991+0000 7f900ba00640 1 -- start start 2024-08-17T02:24:29.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.992+0000 7f900ba00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f90040a9610 0x7f900415abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.992+0000 7f900ba00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90040a88e0 con 0x7f90040aab40 2024-08-17T02:24:29.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.992+0000 7f900ba00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90040a9180 con 0x7f9004158bf0 2024-08-17T02:24:29.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.992+0000 7f900ba00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90040a9a40 con 0x7f90040a9610 2024-08-17T02:24:29.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.992+0000 7f9003e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f90040aab40 0x7f900415a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54450/0 (socket says 172.21.15.2:54450) 2024-08-17T02:24:29.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.992+0000 7f9003e00640 1 -- 172.21.15.2:0/3239129048 learned_addr learned my addr 172.21.15.2:0/3239129048 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:29.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.993+0000 7f9009a00640 1 --2- 172.21.15.2:0/3239129048 >> v2:172.21.15.145:3300/0 conn(0x7f90040a9610 0x7f900415abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.993+0000 7f9003400640 1 -- 172.21.15.2:0/3239129048 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065844364 0 0) 0x7f90040a88e0 con 0x7f90040aab40 2024-08-17T02:24:29.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.993+0000 7f9003400640 1 -- 172.21.15.2:0/3239129048 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fec0034e0 con 0x7f90040aab40 2024-08-17T02:24:29.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.993+0000 7f9003400640 1 -- 172.21.15.2:0/3239129048 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2545915317 0 0) 0x7f8fec0034e0 con 0x7f90040aab40 2024-08-17T02:24:29.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.993+0000 7f9003400640 1 -- 172.21.15.2:0/3239129048 >> v2:172.21.15.145:3300/0 conn(0x7f90040a9610 msgr2=0x7f900415abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:29.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.993+0000 7f9003400640 1 --2- 172.21.15.2:0/3239129048 >> v2:172.21.15.145:3300/0 conn(0x7f90040a9610 0x7f900415abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.993+0000 7f9003400640 1 -- 172.21.15.2:0/3239129048 >> v1:172.21.15.145:6789/0 conn(0x7f9004158bf0 legacy=0x7f90040aa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.993+0000 7f9003400640 1 -- 172.21.15.2:0/3239129048 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900415a0e0 con 0x7f90040aab40 2024-08-17T02:24:29.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.993+0000 7f9003400640 1 -- 172.21.15.2:0/3239129048 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7f8ff0001470 con 0x7f90040aab40 2024-08-17T02:24:29.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.993+0000 7f9003400640 1 -- 172.21.15.2:0/3239129048 >> v1:172.21.15.2:6789/0 conn(0x7f90040aab40 legacy=0x7f900415a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.993+0000 7f9003400640 1 --2- 172.21.15.2:0/3239129048 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8fec003a20 0x7f8fec003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.993+0000 7f9003400640 1 --2- 172.21.15.2:0/3239129048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fec004780 0x7f8fec004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.993+0000 7f9003400640 1 --2- 172.21.15.2:0/3239129048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8fec005180 0x7f8fec00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.993+0000 7f9003400640 1 -- 172.21.15.2:0/3239129048 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90040a9a40 con 0x7f8fec004780 2024-08-17T02:24:29.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.993+0000 7f9003400640 1 -- 172.21.15.2:0/3239129048 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec00c0a0 con 0x7f8fec005180 2024-08-17T02:24:29.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.993+0000 7f9003400640 1 -- 172.21.15.2:0/3239129048 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec00c260 con 0x7f8fec003a20 2024-08-17T02:24:29.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.994+0000 7f9009000640 1 --2- 172.21.15.2:0/3239129048 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8fec003a20 0x7f8fec003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.994+0000 7f9003e00640 1 --2- 172.21.15.2:0/3239129048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fec004780 0x7f8fec004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.994+0000 7f9009a00640 1 --2- 172.21.15.2:0/3239129048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8fec005180 0x7f8fec00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.994+0000 7f9003e00640 1 -- 172.21.15.2:0/3239129048 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8fec003a20 msgr2=0x7f8fec003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:29.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.994+0000 7f9003e00640 1 --2- 172.21.15.2:0/3239129048 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8fec003a20 0x7f8fec003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.994+0000 7f9003e00640 1 -- 172.21.15.2:0/3239129048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8fec005180 msgr2=0x7f8fec00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:29.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.994+0000 7f9003e00640 1 --2- 172.21.15.2:0/3239129048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8fec005180 0x7f8fec00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.994+0000 7f9003e00640 1 -- 172.21.15.2:0/3239129048 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec0034e0 con 0x7f8fec004780 2024-08-17T02:24:29.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.994+0000 7f9009a00640 1 -- 172.21.15.2:0/3239129048 reap_dead start 2024-08-17T02:24:30.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.995+0000 7f9003e00640 1 --2- 172.21.15.2:0/3239129048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fec004780 0x7f8fec004bf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000c160 tx=0x7f8ff0001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac12e2d8e78d5b6c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:30.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.995+0000 7f9003400640 1 -- 172.21.15.2:0/3239129048 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0005890 con 0x7f8fec004780 2024-08-17T02:24:30.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.995+0000 7f9003400640 1 -- 172.21.15.2:0/3239129048 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff002d070 con 0x7f8fec004780 2024-08-17T02:24:30.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.995+0000 7f9003400640 1 -- 172.21.15.2:0/3239129048 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0005a50 con 0x7f8fec004780 2024-08-17T02:24:30.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.996+0000 7f900ba00640 1 -- 172.21.15.2:0/3239129048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fec004780 msgr2=0x7f8fec004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:30.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.996+0000 7f900ba00640 1 --2- 172.21.15.2:0/3239129048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fec004780 0x7f8fec004bf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000c160 tx=0x7f8ff0001d80 comp rx=0 tx=0).stop 2024-08-17T02:24:30.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.996+0000 7f900ba00640 1 -- 172.21.15.2:0/3239129048 shutdown_connections 2024-08-17T02:24:30.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.996+0000 7f900ba00640 1 --2- 172.21.15.2:0/3239129048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fec004780 0x7f8fec004bf0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.996+0000 7f900ba00640 1 -- 172.21.15.2:0/3239129048 >> 172.21.15.2:0/3239129048 conn(0x7f9004066e60 msgr2=0x7f9004067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:30.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.996+0000 7f900ba00640 1 -- 172.21.15.2:0/3239129048 shutdown_connections 2024-08-17T02:24:30.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.996+0000 7f900ba00640 1 -- 172.21.15.2:0/3239129048 wait complete. 2024-08-17T02:24:30.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.997+0000 7f900ba00640 1 Processor -- start 2024-08-17T02:24:30.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.997+0000 7f900ba00640 1 -- start start 2024-08-17T02:24:30.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.998+0000 7f900ba00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8fec004780 0x7f90040ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:30.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.998+0000 7f900ba00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90040cab90 0x7f90040ade30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:30.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.998+0000 7f900ba00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90040ae370 0x7f90041482f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:30.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.998+0000 7f900ba00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90040ad110 con 0x7f90040ae370 2024-08-17T02:24:30.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.998+0000 7f900ba00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90040ac590 con 0x7f90040cab90 2024-08-17T02:24:30.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.998+0000 7f900ba00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90040ac870 con 0x7f8fec004780 2024-08-17T02:24:30.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.999+0000 7f9009a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90040ae370 0x7f90041482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:30.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.999+0000 7f9009a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90040ae370 0x7f90041482f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36356/0 (socket says 172.21.15.2:36356) 2024-08-17T02:24:30.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.999+0000 7f9009a00640 1 -- 172.21.15.2:0/3508285430 learned_addr learned my addr 172.21.15.2:0/3508285430 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:30.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.999+0000 7f9003e00640 1 --2- 172.21.15.2:0/3508285430 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90040cab90 0x7f90040ade30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:30.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.999+0000 7f9009000640 1 --2- 172.21.15.2:0/3508285430 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8fec004780 0x7f90040ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:30.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.999+0000 7f9009a00640 1 -- 172.21.15.2:0/3508285430 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8fec004780 msgr2=0x7f90040ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:30.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.999+0000 7f9009a00640 1 --2- 172.21.15.2:0/3508285430 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8fec004780 0x7f90040ca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.999+0000 7f9009a00640 1 -- 172.21.15.2:0/3508285430 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90040cab90 msgr2=0x7f90040ade30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:30.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.999+0000 7f9009a00640 1 --2- 172.21.15.2:0/3508285430 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90040cab90 0x7f90040ade30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.999+0000 7f9009a00640 1 -- 172.21.15.2:0/3508285430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90040acb50 con 0x7f90040ae370 2024-08-17T02:24:30.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:29.999+0000 7f9009a00640 1 --2- 172.21.15.2:0/3508285430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90040ae370 0x7f90041482f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f90040cb9e0 tx=0x7f8ffc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:30.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.000+0000 7f8ff7e00640 1 -- 172.21.15.2:0/3508285430 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc00e040 con 0x7f90040ae370 2024-08-17T02:24:30.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.000+0000 7f8ff7e00640 1 -- 172.21.15.2:0/3508285430 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ffc00f040 con 0x7f90040ae370 2024-08-17T02:24:30.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.000+0000 7f8ff7e00640 1 -- 172.21.15.2:0/3508285430 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc015920 con 0x7f90040ae370 2024-08-17T02:24:30.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.000+0000 7f900ba00640 1 -- 172.21.15.2:0/3508285430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90040ace30 con 0x7f90040ae370 2024-08-17T02:24:30.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.000+0000 7f900ba00640 1 -- 172.21.15.2:0/3508285430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9004148830 con 0x7f90040ae370 2024-08-17T02:24:30.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.001+0000 7f900ba00640 1 -- 172.21.15.2:0/3508285430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9004168cb0 con 0x7f90040ae370 2024-08-17T02:24:30.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.001+0000 7f8ff7e00640 1 -- 172.21.15.2:0/3508285430 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8ffc015cd0 con 0x7f90040ae370 2024-08-17T02:24:30.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.003+0000 7f8ff7e00640 1 --2- 172.21.15.2:0/3508285430 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8fe4065180 0x7f8fe4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:30.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.003+0000 7f8ff7e00640 1 -- 172.21.15.2:0/3508285430 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ffc082620 con 0x7f90040ae370 2024-08-17T02:24:30.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.003+0000 7f9009000640 1 --2- 172.21.15.2:0/3508285430 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8fe4065180 0x7f8fe4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:30.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.004+0000 7f9009000640 1 --2- 172.21.15.2:0/3508285430 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8fe4065180 0x7f8fe4067630 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8000c00 tx=0x7f8ff8007ca0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:30.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.007+0000 7f8ff7e00640 1 -- 172.21.15.2:0/3508285430 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9004168cb0 con 0x7f90040ae370 2024-08-17T02:24:30.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.233+0000 7f900ba00640 1 -- 172.21.15.2:0/3508285430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9004168cb0 con 0x7f90040ae370 2024-08-17T02:24:30.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.234+0000 7f8ff7e00640 1 -- 172.21.15.2:0/3508285430 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9004168cb0 con 0x7f90040ae370 2024-08-17T02:24:30.235 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:24:30.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.236+0000 7f900ba00640 1 -- 172.21.15.2:0/3508285430 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8fe4065180 msgr2=0x7f8fe4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.236+0000 7f900ba00640 1 --2- 172.21.15.2:0/3508285430 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8fe4065180 0x7f8fe4067630 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8000c00 tx=0x7f8ff8007ca0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.236+0000 7f900ba00640 1 -- 172.21.15.2:0/3508285430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90040ae370 msgr2=0x7f90041482f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.236+0000 7f900ba00640 1 --2- 172.21.15.2:0/3508285430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90040ae370 0x7f90041482f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f90040cb9e0 tx=0x7f8ffc00b040 comp rx=0 tx=0).stop 2024-08-17T02:24:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.236+0000 7f900ba00640 1 -- 172.21.15.2:0/3508285430 shutdown_connections 2024-08-17T02:24:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.236+0000 7f900ba00640 1 --2- 172.21.15.2:0/3508285430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90040ae370 0x7f90041482f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.236+0000 7f900ba00640 1 --2- 172.21.15.2:0/3508285430 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90040cab90 0x7f90040ade30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.236+0000 7f900ba00640 1 --2- 172.21.15.2:0/3508285430 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8fe4065180 0x7f8fe4067630 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.236+0000 7f900ba00640 1 --2- 172.21.15.2:0/3508285430 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8fec004780 0x7f90040ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.236+0000 7f900ba00640 1 -- 172.21.15.2:0/3508285430 >> 172.21.15.2:0/3508285430 conn(0x7f9004066e60 msgr2=0x7f9004156b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:30.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.236+0000 7f900ba00640 1 -- 172.21.15.2:0/3508285430 shutdown_connections 2024-08-17T02:24:30.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:30.236+0000 7f900ba00640 1 -- 172.21.15.2:0/3508285430 wait complete. 2024-08-17T02:24:30.252 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:24:30.252 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:24:30.252 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-08-17T02:24:30.252 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:24:30.252 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:24:30.252 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:24:30.252 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:24:30.252 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:24:30.253 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:24:30.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:30.253 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-08-17T02:24:30.289 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:24:30.290 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:24:30.290 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:24:30.290 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:30.290 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-08-17T02:24:30.290 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:30.290 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:24:30.290 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:30.290 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-08-17T02:24:30.290 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:24:30.290 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:30.290 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-08-17T02:24:30.291 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:24:30.291 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:30.291 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-08-17T02:24:30.291 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:24:30.291 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42604sec preferred_lft 42604sec 2024-08-17T02:24:30.291 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link noprefixroute 2024-08-17T02:24:30.291 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:30.291 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:24:30.291 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:30.291 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-08-17T02:24:30.291 INFO:teuthology.orchestra.run.smithi002.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:24:30.291 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 2e:79:fb:f3:94:c1 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:30.291 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:24:30.292 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:30.292 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::f029:5dff:fe25:178a/64 scope link 2024-08-17T02:24:30.292 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:30.292 INFO:teuthology.orchestra.run.smithi002.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:24:30.292 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 6a:67:ee:dc:74:9b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:24:30.292 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::6867:eeff:fedc:749b/64 scope link 2024-08-17T02:24:30.292 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:30.292 INFO:teuthology.orchestra.run.smithi002.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:24:30.292 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 2e:79:fb:f3:94:c1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:24:30.292 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::2c79:fbff:fef3:94c1/64 scope link 2024-08-17T02:24:30.292 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:30.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:30.293 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:24:30.384 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-08-17T02:24:30.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:30.387 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-08-17T02:24:30.424 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-08-17T02:24:30.424 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:24:30.424 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:24:30.424 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:24:30.424 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:24:30.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:30.425 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2024-08-17T02:24:30.425 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-17T02:24:30.425 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:24:30.425 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:24:30.425 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:24:30.425 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-17T02:24:30.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:30.570 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-08-17T02:24:30.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:24:30.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:24:30.607 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:24:30.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:30.607 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2024-08-17T02:24:30.703 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:24:30.703 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:24:30.739 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:24:30.739 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:24:30.739 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:24:30.815 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:24:30.815 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:24:30.815 DEBUG:teuthology.orchestra.run.smithi002:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:30.937 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:30.937 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:24:30.964 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:30.964 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:24:30.964 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.145:3300,172.21.15.145:3301" 2024-08-17T02:24:30.964 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: trying mount with new device syntax: 0@66491975-1283-4d8c-92e2-26a46f113139.cephfs=/ 2024-08-17T02:24:30.964 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.2:3300/172.21.15.145:3300/172.21.15.145:3301" will pass to kernel 2024-08-17T02:24:30.966 INFO:teuthology.orchestra.run.smithi002.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:24:30.966 INFO:teuthology.orchestra.run.smithi002.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:24:30.966 INFO:teuthology.orchestra.run.smithi002.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:24:30.966 INFO:teuthology.orchestra.run.smithi002.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:24:30.966 INFO:teuthology.orchestra.run.smithi002.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:24:30.969 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:24:30.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:30.969 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:24:31.025 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:24:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.177+0000 7fc364e00640 1 Processor -- start 2024-08-17T02:24:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.177+0000 7fc364e00640 1 -- start start 2024-08-17T02:24:31.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.178+0000 7fc364e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3600b0e30 0x7fc3600b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.178+0000 7fc364e00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc36015a590 0x7fc36013fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.178+0000 7fc364e00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc36006d7c0 con 0x7fc360156f90 2024-08-17T02:24:31.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.178+0000 7fc364e00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36015ab30 con 0x7fc36015a590 2024-08-17T02:24:31.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.178+0000 7fc364e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36015ae10 con 0x7fc3600b0e30 2024-08-17T02:24:31.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.178+0000 7fc35f400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3600b0e30 0x7fc3600b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.178+0000 7fc35f400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3600b0e30 0x7fc3600b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:39644/0 (socket says 172.21.15.2:39644) 2024-08-17T02:24:31.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.178+0000 7fc35f400640 1 -- 172.21.15.2:0/2644398912 learned_addr learned my addr 172.21.15.2:0/2644398912 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:31.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.178+0000 7fc35fe00640 1 --2- 172.21.15.2:0/2644398912 >> v2:172.21.15.145:3300/0 conn(0x7fc36015a590 0x7fc36013fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.179+0000 7fc35f400640 1 -- 172.21.15.2:0/2644398912 >> v2:172.21.15.145:3300/0 conn(0x7fc36015a590 msgr2=0x7fc36013fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:31.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.179+0000 7fc35f400640 1 --2- 172.21.15.2:0/2644398912 >> v2:172.21.15.145:3300/0 conn(0x7fc36015a590 0x7fc36013fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.179+0000 7fc35f400640 1 -- 172.21.15.2:0/2644398912 >> v1:172.21.15.145:6789/0 conn(0x7fc360156f90 legacy=0x7fc3600cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:31.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.179+0000 7fc35f400640 1 -- 172.21.15.2:0/2644398912 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36015b0f0 con 0x7fc3600b0e30 2024-08-17T02:24:31.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.180+0000 7fc35f400640 1 --2- 172.21.15.2:0/2644398912 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3600b0e30 0x7fc3600b1200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc350009910 tx=0x7fc3500091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b89dfc0d35a88ef7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:31.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.180+0000 7fc35ea00640 1 -- 172.21.15.2:0/2644398912 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35002ae40 con 0x7fc3600b0e30 2024-08-17T02:24:31.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.180+0000 7fc35ea00640 1 -- 172.21.15.2:0/2644398912 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc350032440 con 0x7fc3600b0e30 2024-08-17T02:24:31.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.180+0000 7fc35ea00640 1 -- 172.21.15.2:0/2644398912 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc350032820 con 0x7fc3600b0e30 2024-08-17T02:24:31.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.181+0000 7fc364e00640 1 -- 172.21.15.2:0/2644398912 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3600b0e30 msgr2=0x7fc3600b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:31.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.181+0000 7fc364e00640 1 --2- 172.21.15.2:0/2644398912 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3600b0e30 0x7fc3600b1200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc350009910 tx=0x7fc3500091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.181+0000 7fc364e00640 1 -- 172.21.15.2:0/2644398912 shutdown_connections 2024-08-17T02:24:31.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.181+0000 7fc364e00640 1 --2- 172.21.15.2:0/2644398912 >> v2:172.21.15.145:3300/0 conn(0x7fc36015a590 0x7fc36013fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.181+0000 7fc364e00640 1 --2- 172.21.15.2:0/2644398912 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3600b0e30 0x7fc3600b1200 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.181+0000 7fc364e00640 1 -- 172.21.15.2:0/2644398912 >> 172.21.15.2:0/2644398912 conn(0x7fc360062af0 msgr2=0x7fc360062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:31.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.181+0000 7fc364e00640 1 -- 172.21.15.2:0/2644398912 shutdown_connections 2024-08-17T02:24:31.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.181+0000 7fc364e00640 1 -- 172.21.15.2:0/2644398912 wait complete. 2024-08-17T02:24:31.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.182+0000 7fc364e00640 1 Processor -- start 2024-08-17T02:24:31.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.182+0000 7fc364e00640 1 -- start start 2024-08-17T02:24:31.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.183+0000 7fc364e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3600b0e30 0x7fc360168a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.183+0000 7fc364e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc360156f90 0x7fc36013b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.183+0000 7fc364e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc36015a590 0x7fc36013d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.183+0000 7fc364e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36013cd30 con 0x7fc360156f90 2024-08-17T02:24:31.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.183+0000 7fc364e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36013c120 con 0x7fc3600b0e30 2024-08-17T02:24:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.183+0000 7fc364e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36013c400 con 0x7fc36015a590 2024-08-17T02:24:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.184+0000 7fc357e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc360156f90 0x7fc36013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.184+0000 7fc357e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc360156f90 0x7fc36013b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36368/0 (socket says 172.21.15.2:36368) 2024-08-17T02:24:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.184+0000 7fc357e00640 1 -- 172.21.15.2:0/3392756775 learned_addr learned my addr 172.21.15.2:0/3392756775 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.184+0000 7fc35f400640 1 --2- 172.21.15.2:0/3392756775 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3600b0e30 0x7fc360168a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.184+0000 7fc35fe00640 1 --2- 172.21.15.2:0/3392756775 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc36015a590 0x7fc36013d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.184+0000 7fc35f400640 1 -- 172.21.15.2:0/3392756775 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc36015a590 msgr2=0x7fc36013d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.184+0000 7fc35f400640 1 --2- 172.21.15.2:0/3392756775 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc36015a590 0x7fc36013d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.184+0000 7fc35f400640 1 -- 172.21.15.2:0/3392756775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc360156f90 msgr2=0x7fc36013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.184+0000 7fc35f400640 1 --2- 172.21.15.2:0/3392756775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc360156f90 0x7fc36013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.184+0000 7fc35f400640 1 -- 172.21.15.2:0/3392756775 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc350009450 con 0x7fc3600b0e30 2024-08-17T02:24:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.184+0000 7fc357e00640 1 --2- 172.21.15.2:0/3392756775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc360156f90 0x7fc36013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:31.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.185+0000 7fc35f400640 1 --2- 172.21.15.2:0/3392756775 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3600b0e30 0x7fc360168a90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc350031000 tx=0x7fc350032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:31.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.185+0000 7fc356a00640 1 -- 172.21.15.2:0/3392756775 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc350031c80 con 0x7fc3600b0e30 2024-08-17T02:24:31.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.185+0000 7fc356a00640 1 -- 172.21.15.2:0/3392756775 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc350031de0 con 0x7fc3600b0e30 2024-08-17T02:24:31.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.185+0000 7fc356a00640 1 -- 172.21.15.2:0/3392756775 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35003d670 con 0x7fc3600b0e30 2024-08-17T02:24:31.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.185+0000 7fc364e00640 1 -- 172.21.15.2:0/3392756775 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36013c6e0 con 0x7fc3600b0e30 2024-08-17T02:24:31.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.185+0000 7fc364e00640 1 -- 172.21.15.2:0/3392756775 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3601694e0 con 0x7fc3600b0e30 2024-08-17T02:24:31.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.186+0000 7fc364e00640 1 -- 172.21.15.2:0/3392756775 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc360070720 con 0x7fc3600b0e30 2024-08-17T02:24:31.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.187+0000 7fc356a00640 1 -- 172.21.15.2:0/3392756775 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc350039040 con 0x7fc3600b0e30 2024-08-17T02:24:31.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.188+0000 7fc356a00640 1 --2- 172.21.15.2:0/3392756775 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc33c065180 0x7fc33c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.188+0000 7fc356a00640 1 -- 172.21.15.2:0/3392756775 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc35002ae40 con 0x7fc3600b0e30 2024-08-17T02:24:31.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.188+0000 7fc357e00640 1 --2- 172.21.15.2:0/3392756775 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc33c065180 0x7fc33c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.189+0000 7fc357e00640 1 --2- 172.21.15.2:0/3392756775 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc33c065180 0x7fc33c067630 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc36015e380 tx=0x7fc348009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:31.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.193+0000 7fc356a00640 1 -- 172.21.15.2:0/3392756775 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc350070530 con 0x7fc3600b0e30 2024-08-17T02:24:31.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.417+0000 7fc364e00640 1 -- 172.21.15.2:0/3392756775 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc36006a470 con 0x7fc3600b0e30 2024-08-17T02:24:31.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.418+0000 7fc356a00640 1 -- 172.21.15.2:0/3392756775 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc350073b50 con 0x7fc3600b0e30 2024-08-17T02:24:31.420 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:24:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.420+0000 7fc364e00640 1 -- 172.21.15.2:0/3392756775 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc33c065180 msgr2=0x7fc33c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.420+0000 7fc364e00640 1 --2- 172.21.15.2:0/3392756775 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc33c065180 0x7fc33c067630 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc36015e380 tx=0x7fc348009040 comp rx=0 tx=0).stop 2024-08-17T02:24:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.420+0000 7fc364e00640 1 -- 172.21.15.2:0/3392756775 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3600b0e30 msgr2=0x7fc360168a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.420+0000 7fc364e00640 1 --2- 172.21.15.2:0/3392756775 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3600b0e30 0x7fc360168a90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc350031000 tx=0x7fc350032000 comp rx=0 tx=0).stop 2024-08-17T02:24:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.421+0000 7fc364e00640 1 -- 172.21.15.2:0/3392756775 shutdown_connections 2024-08-17T02:24:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.421+0000 7fc364e00640 1 --2- 172.21.15.2:0/3392756775 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc33c065180 0x7fc33c067630 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.421+0000 7fc364e00640 1 --2- 172.21.15.2:0/3392756775 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc36015a590 0x7fc36013d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.421+0000 7fc364e00640 1 --2- 172.21.15.2:0/3392756775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc360156f90 0x7fc36013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.421+0000 7fc364e00640 1 --2- 172.21.15.2:0/3392756775 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3600b0e30 0x7fc360168a90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.421+0000 7fc364e00640 1 -- 172.21.15.2:0/3392756775 >> 172.21.15.2:0/3392756775 conn(0x7fc360062af0 msgr2=0x7fc3600c8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.421+0000 7fc364e00640 1 -- 172.21.15.2:0/3392756775 shutdown_connections 2024-08-17T02:24:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:31.421+0000 7fc364e00640 1 -- 172.21.15.2:0/3392756775 wait complete. 2024-08-17T02:24:31.437 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:24:31.437 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:24:31.437 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi145.front.sepia.ceph.com 2024-08-17T02:24:31.437 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:24:31.437 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:24:31.438 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:24:31.438 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:24:31.438 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:24:31.438 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:24:31.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:31.438 DEBUG:teuthology.orchestra.run.smithi145:> ip addr 2024-08-17T02:24:31.479 INFO:teuthology.orchestra.run.smithi145.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:24:31.479 INFO:teuthology.orchestra.run.smithi145.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:24:31.479 INFO:teuthology.orchestra.run.smithi145.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:24:31.479 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:31.479 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 ::1/128 scope host 2024-08-17T02:24:31.479 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:31.479 INFO:teuthology.orchestra.run.smithi145.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:24:31.479 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:d9:38:66 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:31.479 INFO:teuthology.orchestra.run.smithi145.stdout: altname enp7s0f0 2024-08-17T02:24:31.479 INFO:teuthology.orchestra.run.smithi145.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:24:31.480 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:d9:38:67 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:31.480 INFO:teuthology.orchestra.run.smithi145.stdout: altname enp7s0f1 2024-08-17T02:24:31.480 INFO:teuthology.orchestra.run.smithi145.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:24:31.480 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:88:77:90 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:31.480 INFO:teuthology.orchestra.run.smithi145.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:24:31.480 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:88:77:91 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:31.480 INFO:teuthology.orchestra.run.smithi145.stdout: inet 172.21.15.145/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:24:31.480 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft 42588sec preferred_lft 42588sec 2024-08-17T02:24:31.480 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::ec4:7aff:fe88:7791/64 scope link 2024-08-17T02:24:31.480 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:31.480 INFO:teuthology.orchestra.run.smithi145.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:24:31.480 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 62:2d:db:26:6a:1a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:31.480 INFO:teuthology.orchestra.run.smithi145.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:24:31.481 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:31.481 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::68d8:59ff:fedb:b93e/64 scope link 2024-08-17T02:24:31.481 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:31.481 INFO:teuthology.orchestra.run.smithi145.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:24:31.481 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 62:2d:db:26:6a:1a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:24:31.481 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::602d:dbff:fe26:6a1a/64 scope link 2024-08-17T02:24:31.481 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:31.481 INFO:teuthology.orchestra.run.smithi145.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:24:31.481 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether a6:06:29:9a:04:bb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:24:31.481 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::a406:29ff:fe9a:4bb/64 scope link 2024-08-17T02:24:31.481 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:31.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:31.482 DEBUG:teuthology.orchestra.run.smithi145:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:24:31.576 INFO:teuthology.orchestra.run.smithi145.stdout:1 2024-08-17T02:24:31.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:31.580 DEBUG:teuthology.orchestra.run.smithi145:> route 2024-08-17T02:24:31.617 INFO:teuthology.orchestra.run.smithi145.stdout:Kernel IP routing table 2024-08-17T02:24:31.617 INFO:teuthology.orchestra.run.smithi145.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:24:31.617 INFO:teuthology.orchestra.run.smithi145.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:24:31.618 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:24:31.618 INFO:teuthology.orchestra.run.smithi145.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:24:31.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:31.618 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2024-08-17T02:24:31.618 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-08-17T02:24:31.618 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:24:31.618 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:24:31.618 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:24:31.618 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-08-17T02:24:31.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:31.766 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list 2024-08-17T02:24:31.801 INFO:teuthology.orchestra.run.smithi145.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:24:31.801 INFO:teuthology.orchestra.run.smithi145.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:24:31.802 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:24:31.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:31.802 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set brx.0 up 2024-08-17T02:24:31.900 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:24:31.901 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:24:31.936 INFO:teuthology.orchestra.run.smithi145.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:24:31.936 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:24:31.936 DEBUG:teuthology.orchestra.run.smithi145:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:24:32.011 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:24:32.011 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:24:32.011 DEBUG:teuthology.orchestra.run.smithi145:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:32.134 INFO:teuthology.orchestra.run.smithi145.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:32.134 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:24:32.161 INFO:teuthology.orchestra.run.smithi145.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:32.161 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:24:32.162 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.145:3300,172.21.15.145:3301" 2024-08-17T02:24:32.162 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: trying mount with new device syntax: 1@66491975-1283-4d8c-92e2-26a46f113139.cephfs=/ 2024-08-17T02:24:32.162 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.2:3300/172.21.15.145:3300/172.21.15.145:3301" will pass to kernel 2024-08-17T02:24:32.163 INFO:teuthology.orchestra.run.smithi145.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:24:32.163 INFO:teuthology.orchestra.run.smithi145.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:24:32.163 INFO:teuthology.orchestra.run.smithi145.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:24:32.164 INFO:teuthology.orchestra.run.smithi145.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:24:32.164 INFO:teuthology.orchestra.run.smithi145.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:24:32.166 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:24:32.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:32.167 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:24:32.223 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-08-17T02:24:32.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.380+0000 7f76a5a00640 1 Processor -- start 2024-08-17T02:24:32.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.381+0000 7f76a5a00640 1 -- start start 2024-08-17T02:24:32.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.382+0000 7f76a5a00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f76a00ad780 0x7f76a00adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.382+0000 7f76a5a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76a00ae6e0 0x7f76a0157100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.382+0000 7f76a5a00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a00ca060 con 0x7f76a00cae20 2024-08-17T02:24:32.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.382+0000 7f76a5a00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a00aead0 con 0x7f76a00ad780 2024-08-17T02:24:32.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.382+0000 7f76a5a00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a00ca340 con 0x7f76a00ae6e0 2024-08-17T02:24:32.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.382+0000 7f769fe00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f76a00ad780 0x7f76a00adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.382+0000 7f769fe00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f76a00ad780 0x7f76a00adb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:49770/0 (socket says 172.21.15.2:49770) 2024-08-17T02:24:32.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.382+0000 7f769fe00640 1 -- 172.21.15.2:0/1416764037 learned_addr learned my addr 172.21.15.2:0/1416764037 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:32.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.382+0000 7f76a5000640 1 --2- 172.21.15.2:0/1416764037 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76a00ae6e0 0x7f76a0157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.382+0000 7f7697e00640 1 --1- 172.21.15.2:0/1416764037 >> v1:172.21.15.145:6789/0 conn(0x7f76a00cae20 0x7f76a00af6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:35436/0 (socket says 172.21.15.2:35436) 2024-08-17T02:24:32.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.383+0000 7f769fe00640 1 -- 172.21.15.2:0/1416764037 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76a00ae6e0 msgr2=0x7f76a0157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:32.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.383+0000 7f769fe00640 1 --2- 172.21.15.2:0/1416764037 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76a00ae6e0 0x7f76a0157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.383+0000 7f769fe00640 1 -- 172.21.15.2:0/1416764037 >> v1:172.21.15.145:6789/0 conn(0x7f76a00cae20 legacy=0x7f76a00af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.383+0000 7f769fe00640 1 -- 172.21.15.2:0/1416764037 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a00ca620 con 0x7f76a00ad780 2024-08-17T02:24:32.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.384+0000 7f769fe00640 1 --2- 172.21.15.2:0/1416764037 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76a00ad780 0x7f76a00adb50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7690009910 tx=0x7f76900091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f39deeca3ce1931 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:32.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.384+0000 7f769f400640 1 -- 172.21.15.2:0/1416764037 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769002ae40 con 0x7f76a00ad780 2024-08-17T02:24:32.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.384+0000 7f769f400640 1 -- 172.21.15.2:0/1416764037 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7690032440 con 0x7f76a00ad780 2024-08-17T02:24:32.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.384+0000 7f769f400640 1 -- 172.21.15.2:0/1416764037 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690032820 con 0x7f76a00ad780 2024-08-17T02:24:32.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.385+0000 7f76a5a00640 1 -- 172.21.15.2:0/1416764037 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76a00ad780 msgr2=0x7f76a00adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.385+0000 7f76a5a00640 1 --2- 172.21.15.2:0/1416764037 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76a00ad780 0x7f76a00adb50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7690009910 tx=0x7f76900091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.385+0000 7f76a5a00640 1 -- 172.21.15.2:0/1416764037 shutdown_connections 2024-08-17T02:24:32.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.385+0000 7f76a5a00640 1 --2- 172.21.15.2:0/1416764037 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76a00ae6e0 0x7f76a0157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.385+0000 7f76a5a00640 1 --2- 172.21.15.2:0/1416764037 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76a00ad780 0x7f76a00adb50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.385+0000 7f76a5a00640 1 -- 172.21.15.2:0/1416764037 >> 172.21.15.2:0/1416764037 conn(0x7f76a0066e60 msgr2=0x7f76a0067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:32.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.385+0000 7f76a5a00640 1 -- 172.21.15.2:0/1416764037 shutdown_connections 2024-08-17T02:24:32.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.385+0000 7f76a5a00640 1 -- 172.21.15.2:0/1416764037 wait complete. 2024-08-17T02:24:32.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.386+0000 7f76a5a00640 1 Processor -- start 2024-08-17T02:24:32.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.386+0000 7f76a5a00640 1 -- start start 2024-08-17T02:24:32.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.387+0000 7f76a5a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76a00ad780 0x7f76a0152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.387+0000 7f76a5a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76a00ae6e0 0x7f76a015d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.387+0000 7f76a5a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76a00cae20 0x7f76a015b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.387+0000 7f76a5a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a0155200 con 0x7f76a00ae6e0 2024-08-17T02:24:32.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.387+0000 7f76a5a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a0153490 con 0x7f76a00cae20 2024-08-17T02:24:32.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.387+0000 7f76a5a00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a0154aa0 con 0x7f76a00ad780 2024-08-17T02:24:32.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.387+0000 7f7697e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76a00ae6e0 0x7f76a015d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.387+0000 7f7697e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76a00ae6e0 0x7f76a015d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36378/0 (socket says 172.21.15.2:36378) 2024-08-17T02:24:32.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.387+0000 7f7697e00640 1 -- 172.21.15.2:0/2401077942 learned_addr learned my addr 172.21.15.2:0/2401077942 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:32.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.387+0000 7f769fe00640 1 --2- 172.21.15.2:0/2401077942 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76a00ad780 0x7f76a0152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.387+0000 7f76a5000640 1 --2- 172.21.15.2:0/2401077942 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76a00cae20 0x7f76a015b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.388+0000 7f769fe00640 1 -- 172.21.15.2:0/2401077942 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76a00cae20 msgr2=0x7f76a015b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.388+0000 7f769fe00640 1 --2- 172.21.15.2:0/2401077942 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76a00cae20 0x7f76a015b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.388+0000 7f769fe00640 1 -- 172.21.15.2:0/2401077942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76a00ae6e0 msgr2=0x7f76a015d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.388+0000 7f769fe00640 1 --2- 172.21.15.2:0/2401077942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76a00ae6e0 0x7f76a015d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.388+0000 7f769fe00640 1 -- 172.21.15.2:0/2401077942 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7690009450 con 0x7f76a00ad780 2024-08-17T02:24:32.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.388+0000 7f769fe00640 1 --2- 172.21.15.2:0/2401077942 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76a00ad780 0x7f76a0152f50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7690031000 tx=0x7f7690032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:32.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.388+0000 7f7697400640 1 -- 172.21.15.2:0/2401077942 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690031c80 con 0x7f76a00ad780 2024-08-17T02:24:32.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.389+0000 7f7697400640 1 -- 172.21.15.2:0/2401077942 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7690031de0 con 0x7f76a00ad780 2024-08-17T02:24:32.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.389+0000 7f7697400640 1 -- 172.21.15.2:0/2401077942 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769003d670 con 0x7f76a00ad780 2024-08-17T02:24:32.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.389+0000 7f76a5a00640 1 -- 172.21.15.2:0/2401077942 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a0155d10 con 0x7f76a00ad780 2024-08-17T02:24:32.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.389+0000 7f76a5a00640 1 -- 172.21.15.2:0/2401077942 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a01556c0 con 0x7f76a00ad780 2024-08-17T02:24:32.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.390+0000 7f76a5a00640 1 -- 172.21.15.2:0/2401077942 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a0063f10 con 0x7f76a00ad780 2024-08-17T02:24:32.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.391+0000 7f7697400640 1 -- 172.21.15.2:0/2401077942 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7690039040 con 0x7f76a00ad780 2024-08-17T02:24:32.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.391+0000 7f7697400640 1 --2- 172.21.15.2:0/2401077942 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f767c065150 0x7f767c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.391+0000 7f7697400640 1 -- 172.21.15.2:0/2401077942 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f769002ae40 con 0x7f76a00ad780 2024-08-17T02:24:32.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.392+0000 7f7697e00640 1 --2- 172.21.15.2:0/2401077942 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f767c065150 0x7f767c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.392+0000 7f7697e00640 1 --2- 172.21.15.2:0/2401077942 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f767c065150 0x7f767c067600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f76a0157010 tx=0x7f7688007f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:32.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.396+0000 7f7697400640 1 -- 172.21.15.2:0/2401077942 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7690070630 con 0x7f76a00ad780 2024-08-17T02:24:32.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.615+0000 7f76a5a00640 1 -- 172.21.15.2:0/2401077942 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f76a00699b0 con 0x7f76a00ad780 2024-08-17T02:24:32.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.770+0000 7f7697400640 1 -- 172.21.15.2:0/2401077942 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 136+0+0 (secure 0 0 0) 0x7f7690073c50 con 0x7f76a00ad780 2024-08-17T02:24:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.772+0000 7f76a5a00640 1 -- 172.21.15.2:0/2401077942 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f767c065150 msgr2=0x7f767c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.772+0000 7f76a5a00640 1 --2- 172.21.15.2:0/2401077942 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f767c065150 0x7f767c067600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f76a0157010 tx=0x7f7688007f90 comp rx=0 tx=0).stop 2024-08-17T02:24:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.772+0000 7f76a5a00640 1 -- 172.21.15.2:0/2401077942 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76a00ad780 msgr2=0x7f76a0152f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.772+0000 7f76a5a00640 1 --2- 172.21.15.2:0/2401077942 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76a00ad780 0x7f76a0152f50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7690031000 tx=0x7f7690032000 comp rx=0 tx=0).stop 2024-08-17T02:24:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.773+0000 7f76a5a00640 1 -- 172.21.15.2:0/2401077942 shutdown_connections 2024-08-17T02:24:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.773+0000 7f76a5a00640 1 --2- 172.21.15.2:0/2401077942 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76a00cae20 0x7f76a015b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.773+0000 7f76a5a00640 1 --2- 172.21.15.2:0/2401077942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76a00ae6e0 0x7f76a015d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.773+0000 7f76a5a00640 1 --2- 172.21.15.2:0/2401077942 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f767c065150 0x7f767c067600 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.773+0000 7f76a5a00640 1 --2- 172.21.15.2:0/2401077942 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76a00ad780 0x7f76a0152f50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.773+0000 7f76a5a00640 1 -- 172.21.15.2:0/2401077942 >> 172.21.15.2:0/2401077942 conn(0x7f76a0066e60 msgr2=0x7f76a00ab4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.773+0000 7f76a5a00640 1 -- 172.21.15.2:0/2401077942 shutdown_connections 2024-08-17T02:24:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.773+0000 7f76a5a00640 1 -- 172.21.15.2:0/2401077942 wait complete. 2024-08-17T02:24:32.789 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:24:32.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.941+0000 7fbb4f200640 1 Processor -- start 2024-08-17T02:24:32.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.941+0000 7fbb4f200640 1 -- start start 2024-08-17T02:24:32.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.942+0000 7fbb4f200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbb4806c0e0 0x7fbb48163a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.942+0000 7fbb4f200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb480a9840 con 0x7fbb48152f60 2024-08-17T02:24:32.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.942+0000 7fbb4f200640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb480a8c30 con 0x7fbb48153330 2024-08-17T02:24:32.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.942+0000 7fbb4f200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb480a8f10 con 0x7fbb4806c0e0 2024-08-17T02:24:32.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.942+0000 7fbb4de00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbb48152f60 0x7fbb48159b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54452/0 (socket says 172.21.15.2:54452) 2024-08-17T02:24:32.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.942+0000 7fbb4de00640 1 -- 172.21.15.2:0/1820669272 learned_addr learned my addr 172.21.15.2:0/1820669272 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:32.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.942+0000 7fbb4e800640 1 --2- 172.21.15.2:0/1820669272 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbb4806c0e0 0x7fbb48163a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.943+0000 7fbb4ca00640 1 -- 172.21.15.2:0/1820669272 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596729611 0 0) 0x7fbb480a9840 con 0x7fbb48152f60 2024-08-17T02:24:32.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.943+0000 7fbb4ca00640 1 -- 172.21.15.2:0/1820669272 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb300034e0 con 0x7fbb48152f60 2024-08-17T02:24:32.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.943+0000 7fbb4ca00640 1 -- 172.21.15.2:0/1820669272 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1973532654 0 0) 0x7fbb480a8c30 con 0x7fbb48153330 2024-08-17T02:24:32.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.943+0000 7fbb4ca00640 1 -- 172.21.15.2:0/1820669272 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb480a9840 con 0x7fbb48153330 2024-08-17T02:24:32.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.943+0000 7fbb4e800640 1 -- 172.21.15.2:0/1820669272 >> v1:172.21.15.145:6789/0 conn(0x7fbb48153330 legacy=0x7fbb4806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.943+0000 7fbb4e800640 1 -- 172.21.15.2:0/1820669272 >> v1:172.21.15.2:6789/0 conn(0x7fbb48152f60 legacy=0x7fbb48159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.943+0000 7fbb4e800640 1 -- 172.21.15.2:0/1820669272 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb480a91f0 con 0x7fbb4806c0e0 2024-08-17T02:24:32.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.944+0000 7fbb4e800640 1 --2- 172.21.15.2:0/1820669272 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbb4806c0e0 0x7fbb48163a80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009e90 tx=0x7fbb44009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da41f420d700e4e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:32.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.944+0000 7fbb4ca00640 1 -- 172.21.15.2:0/1820669272 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb44007550 con 0x7fbb4806c0e0 2024-08-17T02:24:32.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.944+0000 7fbb4ca00640 1 -- 172.21.15.2:0/1820669272 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4402d050 con 0x7fbb4806c0e0 2024-08-17T02:24:32.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.944+0000 7fbb4ca00640 1 -- 172.21.15.2:0/1820669272 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb440078e0 con 0x7fbb4806c0e0 2024-08-17T02:24:32.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.945+0000 7fbb4f200640 1 -- 172.21.15.2:0/1820669272 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbb4806c0e0 msgr2=0x7fbb48163a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.945+0000 7fbb4f200640 1 --2- 172.21.15.2:0/1820669272 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbb4806c0e0 0x7fbb48163a80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009e90 tx=0x7fbb44009780 comp rx=0 tx=0).stop 2024-08-17T02:24:32.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.945+0000 7fbb4f200640 1 -- 172.21.15.2:0/1820669272 shutdown_connections 2024-08-17T02:24:32.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.945+0000 7fbb4f200640 1 --2- 172.21.15.2:0/1820669272 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbb4806c0e0 0x7fbb48163a80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.945+0000 7fbb4f200640 1 -- 172.21.15.2:0/1820669272 >> 172.21.15.2:0/1820669272 conn(0x7fbb480678e0 msgr2=0x7fbb480b0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:32.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.945+0000 7fbb4f200640 1 -- 172.21.15.2:0/1820669272 shutdown_connections 2024-08-17T02:24:32.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.945+0000 7fbb4f200640 1 -- 172.21.15.2:0/1820669272 wait complete. 2024-08-17T02:24:32.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.946+0000 7fbb4f200640 1 Processor -- start 2024-08-17T02:24:32.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.946+0000 7fbb4f200640 1 -- start start 2024-08-17T02:24:32.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.947+0000 7fbb4f200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbb4806c0e0 0x7fbb4813d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.947+0000 7fbb4f200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbb48152f60 0x7fbb48150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.947+0000 7fbb4f200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb48153330 0x7fbb48151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.947+0000 7fbb4f200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4813d730 con 0x7fbb48153330 2024-08-17T02:24:32.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.947+0000 7fbb4f200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb481551d0 con 0x7fbb4806c0e0 2024-08-17T02:24:32.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.947+0000 7fbb4f200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb481554b0 con 0x7fbb48152f60 2024-08-17T02:24:32.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.948+0000 7fbb4e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb48153330 0x7fbb48151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.948+0000 7fbb4de00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbb4806c0e0 0x7fbb4813d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.948+0000 7fbb4e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb48153330 0x7fbb48151000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36380/0 (socket says 172.21.15.2:36380) 2024-08-17T02:24:32.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.948+0000 7fbb4e800640 1 -- 172.21.15.2:0/1317138964 learned_addr learned my addr 172.21.15.2:0/1317138964 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:32.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.948+0000 7fbb4d400640 1 --2- 172.21.15.2:0/1317138964 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbb48152f60 0x7fbb48150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.948+0000 7fbb4e800640 1 -- 172.21.15.2:0/1317138964 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbb48152f60 msgr2=0x7fbb48150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.948+0000 7fbb4e800640 1 --2- 172.21.15.2:0/1317138964 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbb48152f60 0x7fbb48150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.948+0000 7fbb4e800640 1 -- 172.21.15.2:0/1317138964 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbb4806c0e0 msgr2=0x7fbb4813d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.948+0000 7fbb4e800640 1 --2- 172.21.15.2:0/1317138964 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbb4806c0e0 0x7fbb4813d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.948+0000 7fbb4e800640 1 -- 172.21.15.2:0/1317138964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb44009a20 con 0x7fbb48153330 2024-08-17T02:24:32.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.948+0000 7fbb4e800640 1 --2- 172.21.15.2:0/1317138964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb48153330 0x7fbb48151000 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbb440099f0 tx=0x7fbb44037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:32.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.949+0000 7fbb41600640 1 -- 172.21.15.2:0/1317138964 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb440318b0 con 0x7fbb48153330 2024-08-17T02:24:32.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.949+0000 7fbb41600640 1 -- 172.21.15.2:0/1317138964 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb44040070 con 0x7fbb48153330 2024-08-17T02:24:32.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.949+0000 7fbb4f200640 1 -- 172.21.15.2:0/1317138964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb48155790 con 0x7fbb48153330 2024-08-17T02:24:32.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.949+0000 7fbb41600640 1 -- 172.21.15.2:0/1317138964 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb44031c40 con 0x7fbb48153330 2024-08-17T02:24:32.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.949+0000 7fbb4f200640 1 -- 172.21.15.2:0/1317138964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb48155d50 con 0x7fbb48153330 2024-08-17T02:24:32.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.950+0000 7fbb4f200640 1 -- 172.21.15.2:0/1317138964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb48070720 con 0x7fbb48153330 2024-08-17T02:24:32.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.951+0000 7fbb41600640 1 -- 172.21.15.2:0/1317138964 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbb44042030 con 0x7fbb48153330 2024-08-17T02:24:32.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.951+0000 7fbb41600640 1 --2- 172.21.15.2:0/1317138964 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbb2c065150 0x7fbb2c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.951+0000 7fbb41600640 1 -- 172.21.15.2:0/1317138964 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbb440a3bf0 con 0x7fbb48153330 2024-08-17T02:24:32.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.952+0000 7fbb4de00640 1 --2- 172.21.15.2:0/1317138964 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbb2c065150 0x7fbb2c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.952+0000 7fbb4de00640 1 --2- 172.21.15.2:0/1317138964 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbb2c065150 0x7fbb2c067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbb480ac770 tx=0x7fbb3c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:32.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:32.955+0000 7fbb41600640 1 -- 172.21.15.2:0/1317138964 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbb44071cc0 con 0x7fbb48153330 2024-08-17T02:24:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.165+0000 7fbb4f200640 1 -- 172.21.15.2:0/1317138964 --> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb48152b10 con 0x7fbb2c065150 2024-08-17T02:24:33.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.167+0000 7fbb41600640 1 -- 172.21.15.2:0/1317138964 <== mgr.4108 v2:172.21.15.145:6832/36841 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fbb48152b10 con 0x7fbb2c065150 2024-08-17T02:24:33.168 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2024-08-17T02:24:33.168 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:33.168 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephfs" 2024-08-17T02:24:33.168 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:33.168 INFO:teuthology.orchestra.run.smithi002.stdout:] 2024-08-17T02:24:33.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.169+0000 7fbb4f200640 1 -- 172.21.15.2:0/1317138964 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbb2c065150 msgr2=0x7fbb2c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.169+0000 7fbb4f200640 1 --2- 172.21.15.2:0/1317138964 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbb2c065150 0x7fbb2c067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbb480ac770 tx=0x7fbb3c009040 comp rx=0 tx=0).stop 2024-08-17T02:24:33.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.169+0000 7fbb4f200640 1 -- 172.21.15.2:0/1317138964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb48153330 msgr2=0x7fbb48151000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.169+0000 7fbb4f200640 1 --2- 172.21.15.2:0/1317138964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb48153330 0x7fbb48151000 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbb440099f0 tx=0x7fbb44037000 comp rx=0 tx=0).stop 2024-08-17T02:24:33.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.169+0000 7fbb4f200640 1 -- 172.21.15.2:0/1317138964 shutdown_connections 2024-08-17T02:24:33.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.169+0000 7fbb4f200640 1 --2- 172.21.15.2:0/1317138964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb48153330 0x7fbb48151000 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.169+0000 7fbb4f200640 1 --2- 172.21.15.2:0/1317138964 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbb2c065150 0x7fbb2c067600 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.169+0000 7fbb4f200640 1 --2- 172.21.15.2:0/1317138964 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbb48152f60 0x7fbb48150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.169+0000 7fbb4f200640 1 --2- 172.21.15.2:0/1317138964 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbb4806c0e0 0x7fbb4813d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.169+0000 7fbb4f200640 1 -- 172.21.15.2:0/1317138964 >> 172.21.15.2:0/1317138964 conn(0x7fbb480678e0 msgr2=0x7fbb480a9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:33.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.169+0000 7fbb4f200640 1 -- 172.21.15.2:0/1317138964 shutdown_connections 2024-08-17T02:24:33.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.169+0000 7fbb4f200640 1 -- 172.21.15.2:0/1317138964 wait complete. 2024-08-17T02:24:33.185 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:24:33.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.339+0000 7f35cb400640 1 Processor -- start 2024-08-17T02:24:33.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.339+0000 7f35cb400640 1 -- start start 2024-08-17T02:24:33.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.340+0000 7f35cb400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f35c41590b0 0x7f35c40b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.340+0000 7f35cb400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c40c92b0 con 0x7f35c40afca0 2024-08-17T02:24:33.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.340+0000 7f35cb400640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c40ad480 con 0x7f35c40acf10 2024-08-17T02:24:33.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.340+0000 7f35cb400640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c40b0980 con 0x7f35c41590b0 2024-08-17T02:24:33.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.341+0000 7f35c8a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f35c40afca0 0x7f35c41589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54466/0 (socket says 172.21.15.2:54466) 2024-08-17T02:24:33.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.341+0000 7f35c8a00640 1 -- 172.21.15.2:0/3190395162 learned_addr learned my addr 172.21.15.2:0/3190395162 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:33.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.341+0000 7f35c3e00640 1 --2- 172.21.15.2:0/3190395162 >> v2:172.21.15.145:3300/0 conn(0x7f35c41590b0 0x7f35c40b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.341+0000 7f35c3400640 1 -- 172.21.15.2:0/3190395162 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 12164541 0 0) 0x7f35c40c92b0 con 0x7f35c40afca0 2024-08-17T02:24:33.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.341+0000 7f35c3400640 1 -- 172.21.15.2:0/3190395162 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35ac0034e0 con 0x7f35c40afca0 2024-08-17T02:24:33.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.341+0000 7f35c3400640 1 -- 172.21.15.2:0/3190395162 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751572719 0 0) 0x7f35c40ad480 con 0x7f35c40acf10 2024-08-17T02:24:33.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.341+0000 7f35c3400640 1 -- 172.21.15.2:0/3190395162 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35c40c92b0 con 0x7f35c40acf10 2024-08-17T02:24:33.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.341+0000 7f35c3e00640 1 -- 172.21.15.2:0/3190395162 >> v1:172.21.15.145:6789/0 conn(0x7f35c40acf10 legacy=0x7f35c40c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.341+0000 7f35c3e00640 1 -- 172.21.15.2:0/3190395162 >> v1:172.21.15.2:6789/0 conn(0x7f35c40afca0 legacy=0x7f35c41589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.341+0000 7f35c3e00640 1 -- 172.21.15.2:0/3190395162 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c40ad760 con 0x7f35c41590b0 2024-08-17T02:24:33.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.342+0000 7f35c3e00640 1 --2- 172.21.15.2:0/3190395162 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35c41590b0 0x7f35c40b0070 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f35b0009850 tx=0x7f35b00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d50119f722a1653 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:33.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.343+0000 7f35c3400640 1 -- 172.21.15.2:0/3190395162 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b002ae20 con 0x7f35c41590b0 2024-08-17T02:24:33.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.343+0000 7f35c3400640 1 -- 172.21.15.2:0/3190395162 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b0032440 con 0x7f35c41590b0 2024-08-17T02:24:33.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.343+0000 7f35c3400640 1 -- 172.21.15.2:0/3190395162 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b00327c0 con 0x7f35c41590b0 2024-08-17T02:24:33.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.343+0000 7f35cb400640 1 -- 172.21.15.2:0/3190395162 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35c41590b0 msgr2=0x7f35c40b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.343+0000 7f35cb400640 1 --2- 172.21.15.2:0/3190395162 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35c41590b0 0x7f35c40b0070 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f35b0009850 tx=0x7f35b00090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.343+0000 7f35cb400640 1 -- 172.21.15.2:0/3190395162 shutdown_connections 2024-08-17T02:24:33.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.343+0000 7f35cb400640 1 --2- 172.21.15.2:0/3190395162 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35c41590b0 0x7f35c40b0070 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.343+0000 7f35cb400640 1 -- 172.21.15.2:0/3190395162 >> 172.21.15.2:0/3190395162 conn(0x7f35c4066e60 msgr2=0x7f35c4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:33.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.343+0000 7f35cb400640 1 -- 172.21.15.2:0/3190395162 shutdown_connections 2024-08-17T02:24:33.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.343+0000 7f35cb400640 1 -- 172.21.15.2:0/3190395162 wait complete. 2024-08-17T02:24:33.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.345+0000 7f35cb400640 1 Processor -- start 2024-08-17T02:24:33.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.345+0000 7f35cb400640 1 -- start start 2024-08-17T02:24:33.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.346+0000 7f35cb400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35c40acf10 0x7f35c40c6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.346+0000 7f35cb400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c40afca0 0x7f35c40c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.346+0000 7f35cb400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35c41590b0 0x7f35c40c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.346+0000 7f35cb400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c40c7520 con 0x7f35c40afca0 2024-08-17T02:24:33.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.346+0000 7f35cb400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c40c4dd0 con 0x7f35c40acf10 2024-08-17T02:24:33.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.346+0000 7f35cb400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c40c5070 con 0x7f35c41590b0 2024-08-17T02:24:33.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.346+0000 7f35c3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c40afca0 0x7f35c40c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.346+0000 7f35c3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c40afca0 0x7f35c40c4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36396/0 (socket says 172.21.15.2:36396) 2024-08-17T02:24:33.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.346+0000 7f35c3e00640 1 -- 172.21.15.2:0/3723759667 learned_addr learned my addr 172.21.15.2:0/3723759667 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:33.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.346+0000 7f35c8a00640 1 --2- 172.21.15.2:0/3723759667 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35c40acf10 0x7f35c40c6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.346+0000 7f35c9400640 1 --2- 172.21.15.2:0/3723759667 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35c41590b0 0x7f35c40c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.347+0000 7f35c8a00640 1 -- 172.21.15.2:0/3723759667 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35c41590b0 msgr2=0x7f35c40c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.347+0000 7f35c8a00640 1 --2- 172.21.15.2:0/3723759667 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35c41590b0 0x7f35c40c6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.347+0000 7f35c8a00640 1 -- 172.21.15.2:0/3723759667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c40afca0 msgr2=0x7f35c40c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.347+0000 7f35c8a00640 1 --2- 172.21.15.2:0/3723759667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c40afca0 0x7f35c40c4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.347+0000 7f35c8a00640 1 -- 172.21.15.2:0/3723759667 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b0009390 con 0x7f35c40acf10 2024-08-17T02:24:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.347+0000 7f35c3e00640 1 --2- 172.21.15.2:0/3723759667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c40afca0 0x7f35c40c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.347+0000 7f35c8a00640 1 --2- 172.21.15.2:0/3723759667 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35c40acf10 0x7f35c40c6fe0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f35b800c560 tx=0x7f35b8007d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.347+0000 7f35b7e00640 1 -- 172.21.15.2:0/3723759667 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b8005aa0 con 0x7f35c40acf10 2024-08-17T02:24:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.347+0000 7f35b7e00640 1 -- 172.21.15.2:0/3723759667 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b8005c00 con 0x7f35c40acf10 2024-08-17T02:24:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.347+0000 7f35b7e00640 1 -- 172.21.15.2:0/3723759667 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b80070d0 con 0x7f35c40acf10 2024-08-17T02:24:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.347+0000 7f35cb400640 1 -- 172.21.15.2:0/3723759667 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c40c5350 con 0x7f35c40acf10 2024-08-17T02:24:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.348+0000 7f35cb400640 1 -- 172.21.15.2:0/3723759667 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c40c5910 con 0x7f35c40acf10 2024-08-17T02:24:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.348+0000 7f35cb400640 1 -- 172.21.15.2:0/3723759667 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c4063fb0 con 0x7f35c40acf10 2024-08-17T02:24:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.349+0000 7f35b7e00640 1 -- 172.21.15.2:0/3723759667 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f35b80074e0 con 0x7f35c40acf10 2024-08-17T02:24:33.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.350+0000 7f35b7e00640 1 --2- 172.21.15.2:0/3723759667 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f35a4065150 0x7f35a4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.350+0000 7f35b7e00640 1 -- 172.21.15.2:0/3723759667 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f35b8081930 con 0x7f35c40acf10 2024-08-17T02:24:33.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.351+0000 7f35c3e00640 1 --2- 172.21.15.2:0/3723759667 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f35a4065150 0x7f35a4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.351+0000 7f35c3e00640 1 --2- 172.21.15.2:0/3723759667 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f35a4065150 0x7f35a4067600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f35c40c6950 tx=0x7f35b0032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:33.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.355+0000 7f35b7e00640 1 -- 172.21.15.2:0/3723759667 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f35b804fa00 con 0x7f35c40acf10 2024-08-17T02:24:33.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.537+0000 7f35cb400640 1 -- 172.21.15.2:0/3723759667 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f35c4067b70 con 0x7f35c40acf10 2024-08-17T02:24:33.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.538+0000 7f35b7e00640 1 -- 172.21.15.2:0/3723759667 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f35b8053020 con 0x7f35c40acf10 2024-08-17T02:24:33.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.540+0000 7f35cb400640 1 -- 172.21.15.2:0/3723759667 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f35a4065150 msgr2=0x7f35a4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.540+0000 7f35cb400640 1 --2- 172.21.15.2:0/3723759667 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f35a4065150 0x7f35a4067600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f35c40c6950 tx=0x7f35b0032000 comp rx=0 tx=0).stop 2024-08-17T02:24:33.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.540+0000 7f35cb400640 1 -- 172.21.15.2:0/3723759667 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35c40acf10 msgr2=0x7f35c40c6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.540+0000 7f35cb400640 1 --2- 172.21.15.2:0/3723759667 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35c40acf10 0x7f35c40c6fe0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f35b800c560 tx=0x7f35b8007d00 comp rx=0 tx=0).stop 2024-08-17T02:24:33.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.540+0000 7f35cb400640 1 -- 172.21.15.2:0/3723759667 shutdown_connections 2024-08-17T02:24:33.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.540+0000 7f35cb400640 1 --2- 172.21.15.2:0/3723759667 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f35a4065150 0x7f35a4067600 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.540+0000 7f35cb400640 1 --2- 172.21.15.2:0/3723759667 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35c41590b0 0x7f35c40c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.540+0000 7f35cb400640 1 --2- 172.21.15.2:0/3723759667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c40afca0 0x7f35c40c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.540+0000 7f35cb400640 1 --2- 172.21.15.2:0/3723759667 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35c40acf10 0x7f35c40c6fe0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.540+0000 7f35cb400640 1 -- 172.21.15.2:0/3723759667 >> 172.21.15.2:0/3723759667 conn(0x7f35c4066e60 msgr2=0x7f35c40c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:33.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.540+0000 7f35cb400640 1 -- 172.21.15.2:0/3723759667 shutdown_connections 2024-08-17T02:24:33.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.540+0000 7f35cb400640 1 -- 172.21.15.2:0/3723759667 wait complete. 2024-08-17T02:24:33.557 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000001044477 2024-08-17T02:24:33.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.709+0000 7fab7b800640 1 Processor -- start 2024-08-17T02:24:33.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.709+0000 7fab7b800640 1 -- start start 2024-08-17T02:24:33.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.710+0000 7fab7b800640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fab74156e40 0x7fab74066e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.710+0000 7fab7b800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fab740b1c00 0x7fab740b2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.710+0000 7fab7b800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab74067800 con 0x7fab740673a0 2024-08-17T02:24:33.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.710+0000 7fab7b800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab740acb20 con 0x7fab740b1c00 2024-08-17T02:24:33.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.710+0000 7fab7b800640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab740b26e0 con 0x7fab74156e40 2024-08-17T02:24:33.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.710+0000 7fab79800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fab740b1c00 0x7fab740b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.710+0000 7fab73e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fab740673a0 0x7fab740acfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54478/0 (socket says 172.21.15.2:54478) 2024-08-17T02:24:33.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.710+0000 7fab73e00640 1 -- 172.21.15.2:0/2216618165 learned_addr learned my addr 172.21.15.2:0/2216618165 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:33.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.710+0000 7fab78e00640 1 --2- 172.21.15.2:0/2216618165 >> v2:172.21.15.145:3300/0 conn(0x7fab74156e40 0x7fab74066e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.711+0000 7fab79800640 1 -- 172.21.15.2:0/2216618165 >> v2:172.21.15.145:3300/0 conn(0x7fab74156e40 msgr2=0x7fab74066e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:33.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.711+0000 7fab79800640 1 --2- 172.21.15.2:0/2216618165 >> v2:172.21.15.145:3300/0 conn(0x7fab74156e40 0x7fab74066e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.711+0000 7fab79800640 1 -- 172.21.15.2:0/2216618165 >> v1:172.21.15.2:6789/0 conn(0x7fab740673a0 legacy=0x7fab740acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.711+0000 7fab79800640 1 -- 172.21.15.2:0/2216618165 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab740ac1f0 con 0x7fab740b1c00 2024-08-17T02:24:33.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.712+0000 7fab79800640 1 --2- 172.21.15.2:0/2216618165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab740b1c00 0x7fab740b2010 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fab7406f640 tx=0x7fab6c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162580cd97c0bc45 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:33.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.712+0000 7fab73400640 1 -- 172.21.15.2:0/2216618165 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c007550 con 0x7fab740b1c00 2024-08-17T02:24:33.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.712+0000 7fab73400640 1 -- 172.21.15.2:0/2216618165 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6c02d050 con 0x7fab740b1c00 2024-08-17T02:24:33.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.712+0000 7fab73400640 1 -- 172.21.15.2:0/2216618165 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c007920 con 0x7fab740b1c00 2024-08-17T02:24:33.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.713+0000 7fab7b800640 1 -- 172.21.15.2:0/2216618165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab740b1c00 msgr2=0x7fab740b2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.713+0000 7fab7b800640 1 --2- 172.21.15.2:0/2216618165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab740b1c00 0x7fab740b2010 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fab7406f640 tx=0x7fab6c009780 comp rx=0 tx=0).stop 2024-08-17T02:24:33.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.713+0000 7fab7b800640 1 -- 172.21.15.2:0/2216618165 shutdown_connections 2024-08-17T02:24:33.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.713+0000 7fab7b800640 1 --2- 172.21.15.2:0/2216618165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab740b1c00 0x7fab740b2010 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.713+0000 7fab7b800640 1 --2- 172.21.15.2:0/2216618165 >> v2:172.21.15.145:3300/0 conn(0x7fab74156e40 0x7fab74066e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.713+0000 7fab7b800640 1 -- 172.21.15.2:0/2216618165 >> 172.21.15.2:0/2216618165 conn(0x7fab74095a70 msgr2=0x7fab74095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:33.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.713+0000 7fab7b800640 1 -- 172.21.15.2:0/2216618165 shutdown_connections 2024-08-17T02:24:33.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.713+0000 7fab7b800640 1 -- 172.21.15.2:0/2216618165 wait complete. 2024-08-17T02:24:33.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.714+0000 7fab7b800640 1 Processor -- start 2024-08-17T02:24:33.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.714+0000 7fab7b800640 1 -- start start 2024-08-17T02:24:33.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.715+0000 7fab7b800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab740673a0 0x7fab741523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.715+0000 7fab7b800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab740b1c00 0x7fab741517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.715+0000 7fab7b800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab74156e40 0x7fab7413d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.715+0000 7fab7b800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab74152ae0 con 0x7fab74156e40 2024-08-17T02:24:33.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.715+0000 7fab7b800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab74152dc0 con 0x7fab740673a0 2024-08-17T02:24:33.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.715+0000 7fab7b800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab741530a0 con 0x7fab740b1c00 2024-08-17T02:24:33.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.715+0000 7fab79800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab74156e40 0x7fab7413d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.716+0000 7fab79800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab74156e40 0x7fab7413d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36410/0 (socket says 172.21.15.2:36410) 2024-08-17T02:24:33.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.716+0000 7fab79800640 1 -- 172.21.15.2:0/985589918 learned_addr learned my addr 172.21.15.2:0/985589918 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:33.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.716+0000 7fab73e00640 1 --2- 172.21.15.2:0/985589918 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab740b1c00 0x7fab741517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.716+0000 7fab78e00640 1 --2- 172.21.15.2:0/985589918 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab740673a0 0x7fab741523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.716+0000 7fab79800640 1 -- 172.21.15.2:0/985589918 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab740b1c00 msgr2=0x7fab741517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.716+0000 7fab79800640 1 --2- 172.21.15.2:0/985589918 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab740b1c00 0x7fab741517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.716+0000 7fab79800640 1 -- 172.21.15.2:0/985589918 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab740673a0 msgr2=0x7fab741523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.716+0000 7fab79800640 1 --2- 172.21.15.2:0/985589918 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab740673a0 0x7fab741523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.716+0000 7fab79800640 1 -- 172.21.15.2:0/985589918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c009a20 con 0x7fab74156e40 2024-08-17T02:24:33.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.716+0000 7fab78e00640 1 --2- 172.21.15.2:0/985589918 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab740673a0 0x7fab741523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:33.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.716+0000 7fab79800640 1 --2- 172.21.15.2:0/985589918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab74156e40 0x7fab7413d270 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fab6c009e90 tx=0x7fab6c037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:33.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.717+0000 7fab67e00640 1 -- 172.21.15.2:0/985589918 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c031960 con 0x7fab74156e40 2024-08-17T02:24:33.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.717+0000 7fab67e00640 1 -- 172.21.15.2:0/985589918 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6c040070 con 0x7fab74156e40 2024-08-17T02:24:33.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.717+0000 7fab67e00640 1 -- 172.21.15.2:0/985589918 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c031cf0 con 0x7fab74156e40 2024-08-17T02:24:33.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.717+0000 7fab7b800640 1 -- 172.21.15.2:0/985589918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab74153380 con 0x7fab74156e40 2024-08-17T02:24:33.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.717+0000 7fab7b800640 1 -- 172.21.15.2:0/985589918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7413d7b0 con 0x7fab74156e40 2024-08-17T02:24:33.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.718+0000 7fab7b800640 1 -- 172.21.15.2:0/985589918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab74063fb0 con 0x7fab74156e40 2024-08-17T02:24:33.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.719+0000 7fab67e00640 1 -- 172.21.15.2:0/985589918 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fab6c042030 con 0x7fab74156e40 2024-08-17T02:24:33.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.719+0000 7fab67e00640 1 --2- 172.21.15.2:0/985589918 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fab54065150 0x7fab54067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.719+0000 7fab67e00640 1 -- 172.21.15.2:0/985589918 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fab6c0a3ed0 con 0x7fab74156e40 2024-08-17T02:24:33.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.720+0000 7fab78e00640 1 --2- 172.21.15.2:0/985589918 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fab54065150 0x7fab54067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.721+0000 7fab78e00640 1 --2- 172.21.15.2:0/985589918 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fab54065150 0x7fab54067600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fab68009c50 tx=0x7fab68008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:33.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.724+0000 7fab67e00640 1 -- 172.21.15.2:0/985589918 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fab6c071fb0 con 0x7fab74156e40 2024-08-17T02:24:33.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:33.933+0000 7fab7b800640 1 -- 172.21.15.2:0/985589918 --> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000001044477", "target": ["mon-mgr", ""]}) v1 -- 0x7fab74154850 con 0x7fab54065150 2024-08-17T02:24:36.645 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:36.650 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:36.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.811+0000 7fab67e00640 1 -- 172.21.15.2:0/985589918 <== mgr.4108 v2:172.21.15.145:6832/36841 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7fab74154850 con 0x7fab54065150 2024-08-17T02:24:36.812 INFO:teuthology.orchestra.run.smithi002.stderr:Volume created successfully (no MDS daemons created) 2024-08-17T02:24:36.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.816+0000 7fab7b800640 1 -- 172.21.15.2:0/985589918 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fab54065150 msgr2=0x7fab54067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.816+0000 7fab7b800640 1 --2- 172.21.15.2:0/985589918 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fab54065150 0x7fab54067600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fab68009c50 tx=0x7fab68008040 comp rx=0 tx=0).stop 2024-08-17T02:24:36.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.816+0000 7fab7b800640 1 -- 172.21.15.2:0/985589918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab74156e40 msgr2=0x7fab7413d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.816+0000 7fab7b800640 1 --2- 172.21.15.2:0/985589918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab74156e40 0x7fab7413d270 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fab6c009e90 tx=0x7fab6c037000 comp rx=0 tx=0).stop 2024-08-17T02:24:36.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.816+0000 7fab7b800640 1 -- 172.21.15.2:0/985589918 shutdown_connections 2024-08-17T02:24:36.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.816+0000 7fab7b800640 1 --2- 172.21.15.2:0/985589918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab74156e40 0x7fab7413d270 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.816+0000 7fab7b800640 1 --2- 172.21.15.2:0/985589918 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fab54065150 0x7fab54067600 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.816+0000 7fab7b800640 1 --2- 172.21.15.2:0/985589918 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab740b1c00 0x7fab741517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.816+0000 7fab7b800640 1 --2- 172.21.15.2:0/985589918 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab740673a0 0x7fab741523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.816+0000 7fab7b800640 1 -- 172.21.15.2:0/985589918 >> 172.21.15.2:0/985589918 conn(0x7fab74095a70 msgr2=0x7fab74154d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:36.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.816+0000 7fab7b800640 1 -- 172.21.15.2:0/985589918 shutdown_connections 2024-08-17T02:24:36.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.816+0000 7fab7b800640 1 -- 172.21.15.2:0/985589918 wait complete. 2024-08-17T02:24:36.840 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:24:36.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.994+0000 7f3ec1a00640 1 Processor -- start 2024-08-17T02:24:36.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.994+0000 7f3ec1a00640 1 -- start start 2024-08-17T02:24:36.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.995+0000 7f3ec1a00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3ebc161730 0x7f3ebc163b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:36.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.995+0000 7f3ec1a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ebc0aab10 con 0x7f3ebc0ae540 2024-08-17T02:24:36.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.995+0000 7f3ec1a00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ebc0abfb0 con 0x7f3ebc0ae910 2024-08-17T02:24:36.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.995+0000 7f3ec1a00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ebc0ac250 con 0x7f3ebc161730 2024-08-17T02:24:36.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.995+0000 7f3ebbe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3ebc0ae540 0x7f3ebc068950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35350/0 (socket says 172.21.15.2:35350) 2024-08-17T02:24:36.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.995+0000 7f3ebbe00640 1 -- 172.21.15.2:0/2994624328 learned_addr learned my addr 172.21.15.2:0/2994624328 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:36.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.995+0000 7f3ec1000640 1 --2- 172.21.15.2:0/2994624328 >> v2:172.21.15.145:3300/0 conn(0x7f3ebc161730 0x7f3ebc163b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:36.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.996+0000 7f3ebb400640 1 -- 172.21.15.2:0/2994624328 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4249823342 0 0) 0x7f3ebc0aab10 con 0x7f3ebc0ae540 2024-08-17T02:24:36.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.996+0000 7f3ebb400640 1 -- 172.21.15.2:0/2994624328 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ea00034e0 con 0x7f3ebc0ae540 2024-08-17T02:24:36.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.996+0000 7f3ec1000640 1 -- 172.21.15.2:0/2994624328 >> v1:172.21.15.145:6789/0 conn(0x7f3ebc0ae910 legacy=0x7f3ebc0aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.996+0000 7f3ec1000640 1 -- 172.21.15.2:0/2994624328 >> v1:172.21.15.2:6789/0 conn(0x7f3ebc0ae540 legacy=0x7f3ebc068950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.996+0000 7f3ec1000640 1 -- 172.21.15.2:0/2994624328 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc0693e0 con 0x7f3ebc161730 2024-08-17T02:24:36.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.997+0000 7f3ec1000640 1 --2- 172.21.15.2:0/2994624328 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ebc161730 0x7f3ebc163b10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009e60 tx=0x7f3eb4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d35542fdb809e24 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:36.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.997+0000 7f3ebb400640 1 -- 172.21.15.2:0/2994624328 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4007550 con 0x7f3ebc161730 2024-08-17T02:24:36.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.997+0000 7f3ebb400640 1 -- 172.21.15.2:0/2994624328 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb402d050 con 0x7f3ebc161730 2024-08-17T02:24:36.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.997+0000 7f3ebb400640 1 -- 172.21.15.2:0/2994624328 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb40078e0 con 0x7f3ebc161730 2024-08-17T02:24:36.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.998+0000 7f3ec1a00640 1 -- 172.21.15.2:0/2994624328 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ebc161730 msgr2=0x7f3ebc163b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.998+0000 7f3ec1a00640 1 --2- 172.21.15.2:0/2994624328 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ebc161730 0x7f3ebc163b10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009e60 tx=0x7f3eb4009780 comp rx=0 tx=0).stop 2024-08-17T02:24:36.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.998+0000 7f3ec1a00640 1 -- 172.21.15.2:0/2994624328 shutdown_connections 2024-08-17T02:24:36.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.998+0000 7f3ec1a00640 1 --2- 172.21.15.2:0/2994624328 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ebc161730 0x7f3ebc163b10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.998+0000 7f3ec1a00640 1 -- 172.21.15.2:0/2994624328 >> 172.21.15.2:0/2994624328 conn(0x7f3ebc0ce400 msgr2=0x7f3ebc095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:37.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.998+0000 7f3ec1a00640 1 -- 172.21.15.2:0/2994624328 shutdown_connections 2024-08-17T02:24:37.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.998+0000 7f3ec1a00640 1 -- 172.21.15.2:0/2994624328 wait complete. 2024-08-17T02:24:37.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:36.999+0000 7f3ec1a00640 1 Processor -- start 2024-08-17T02:24:37.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.000+0000 7f3ec1a00640 1 -- start start 2024-08-17T02:24:37.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.000+0000 7f3ec1a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ebc0ae540 0x7f3ebc097720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.000+0000 7f3ec1a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc0ae910 0x7f3ebc1567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.000+0000 7f3ec1a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ebc161730 0x7f3ebc16b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.000+0000 7f3ec1a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc0b1e10 con 0x7f3ebc0ae910 2024-08-17T02:24:37.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.000+0000 7f3ec1a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc156d30 con 0x7f3ebc0ae540 2024-08-17T02:24:37.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.000+0000 7f3ec1a00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc0b1200 con 0x7f3ebc161730 2024-08-17T02:24:37.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.001+0000 7f3eb3400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc0ae910 0x7f3ebc1567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.001+0000 7f3eb3400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc0ae910 0x7f3ebc1567f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60652/0 (socket says 172.21.15.2:60652) 2024-08-17T02:24:37.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.001+0000 7f3eb3400640 1 -- 172.21.15.2:0/2409132442 learned_addr learned my addr 172.21.15.2:0/2409132442 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:37.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.001+0000 7f3ebbe00640 1 --2- 172.21.15.2:0/2409132442 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ebc0ae540 0x7f3ebc097720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.001+0000 7f3ec1000640 1 --2- 172.21.15.2:0/2409132442 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ebc161730 0x7f3ebc16b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.001+0000 7f3eb3400640 1 -- 172.21.15.2:0/2409132442 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ebc161730 msgr2=0x7f3ebc16b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.001+0000 7f3eb3400640 1 --2- 172.21.15.2:0/2409132442 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ebc161730 0x7f3ebc16b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.001+0000 7f3eb3400640 1 -- 172.21.15.2:0/2409132442 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ebc0ae540 msgr2=0x7f3ebc097720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.001+0000 7f3eb3400640 1 --2- 172.21.15.2:0/2409132442 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ebc0ae540 0x7f3ebc097720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.001+0000 7f3eb3400640 1 -- 172.21.15.2:0/2409132442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb4009a20 con 0x7f3ebc0ae910 2024-08-17T02:24:37.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.001+0000 7f3eb3400640 1 --2- 172.21.15.2:0/2409132442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc0ae910 0x7f3ebc1567f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400c590 tx=0x7f3ea4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.002+0000 7f3eb3e00640 1 -- 172.21.15.2:0/2409132442 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4012630 con 0x7f3ebc0ae910 2024-08-17T02:24:37.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.002+0000 7f3eb3e00640 1 -- 172.21.15.2:0/2409132442 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea40127b0 con 0x7f3ebc0ae910 2024-08-17T02:24:37.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.002+0000 7f3eb3e00640 1 -- 172.21.15.2:0/2409132442 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4012b70 con 0x7f3ebc0ae910 2024-08-17T02:24:37.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.002+0000 7f3ec1a00640 1 -- 172.21.15.2:0/2409132442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ebc0b14e0 con 0x7f3ebc0ae910 2024-08-17T02:24:37.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.002+0000 7f3ec1a00640 1 -- 172.21.15.2:0/2409132442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ebc0b1aa0 con 0x7f3ebc0ae910 2024-08-17T02:24:37.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.003+0000 7f3ec1a00640 1 -- 172.21.15.2:0/2409132442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ebc0b1fc0 con 0x7f3ebc0ae910 2024-08-17T02:24:37.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.004+0000 7f3eb3e00640 1 -- 172.21.15.2:0/2409132442 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3ea401b400 con 0x7f3ebc0ae910 2024-08-17T02:24:37.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.005+0000 7f3eb3e00640 1 --2- 172.21.15.2:0/2409132442 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3e98065150 0x7f3e98067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.005+0000 7f3eb3e00640 1 -- 172.21.15.2:0/2409132442 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f3ea4082370 con 0x7f3ebc0ae910 2024-08-17T02:24:37.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.005+0000 7f3ebbe00640 1 --2- 172.21.15.2:0/2409132442 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3e98065150 0x7f3e98067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.006+0000 7f3ebbe00640 1 --2- 172.21.15.2:0/2409132442 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3e98065150 0x7f3e98067600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3eac005840 tx=0x7f3eac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.009+0000 7f3eb3e00640 1 -- 172.21.15.2:0/2409132442 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3ebc0b1fc0 con 0x7f3ebc0ae910 2024-08-17T02:24:37.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.217+0000 7f3ec1a00640 1 -- 172.21.15.2:0/2409132442 --> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ebc0b1fc0 con 0x7f3e98065150 2024-08-17T02:24:37.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.219+0000 7f3eb3e00640 1 -- 172.21.15.2:0/2409132442 <== mgr.4108 v2:172.21.15.145:6832/36841 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7f3ebc0b1fc0 con 0x7f3e98065150 2024-08-17T02:24:37.220 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2024-08-17T02:24:37.220 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:37.220 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephfs" 2024-08-17T02:24:37.220 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:24:37.220 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:24:37.221 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volume_0000000001044477" 2024-08-17T02:24:37.221 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:24:37.221 INFO:teuthology.orchestra.run.smithi002.stdout:] 2024-08-17T02:24:37.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.221+0000 7f3ec1a00640 1 -- 172.21.15.2:0/2409132442 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3e98065150 msgr2=0x7f3e98067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.221+0000 7f3ec1a00640 1 --2- 172.21.15.2:0/2409132442 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3e98065150 0x7f3e98067600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3eac005840 tx=0x7f3eac009040 comp rx=0 tx=0).stop 2024-08-17T02:24:37.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.221+0000 7f3ec1a00640 1 -- 172.21.15.2:0/2409132442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc0ae910 msgr2=0x7f3ebc1567f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.221+0000 7f3ec1a00640 1 --2- 172.21.15.2:0/2409132442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc0ae910 0x7f3ebc1567f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400c590 tx=0x7f3ea4007ef0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.221+0000 7f3ec1a00640 1 -- 172.21.15.2:0/2409132442 shutdown_connections 2024-08-17T02:24:37.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.221+0000 7f3ec1a00640 1 --2- 172.21.15.2:0/2409132442 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3e98065150 0x7f3e98067600 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.221+0000 7f3ec1a00640 1 --2- 172.21.15.2:0/2409132442 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ebc161730 0x7f3ebc16b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.221+0000 7f3ec1a00640 1 --2- 172.21.15.2:0/2409132442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc0ae910 0x7f3ebc1567f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.221+0000 7f3ec1a00640 1 --2- 172.21.15.2:0/2409132442 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ebc0ae540 0x7f3ebc097720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.221+0000 7f3ec1a00640 1 -- 172.21.15.2:0/2409132442 >> 172.21.15.2:0/2409132442 conn(0x7f3ebc0ce400 msgr2=0x7f3ebc06ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:37.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.221+0000 7f3ec1a00640 1 -- 172.21.15.2:0/2409132442 shutdown_connections 2024-08-17T02:24:37.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.221+0000 7f3ec1a00640 1 -- 172.21.15.2:0/2409132442 wait complete. 2024-08-17T02:24:37.238 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2024-08-17T02:24:37.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.391+0000 7fb4d2000640 1 Processor -- start 2024-08-17T02:24:37.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.391+0000 7fb4d2000640 1 -- start start 2024-08-17T02:24:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.392+0000 7fb4d2000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb4cc158a20 0x7fb4cc0a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.392+0000 7fb4d2000640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb4cc0ae860 0x7fb4cc06d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.392+0000 7fb4d2000640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4cc0aed90 con 0x7fb4cc158df0 2024-08-17T02:24:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.392+0000 7fb4d2000640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4cc0af070 con 0x7fb4cc0ae860 2024-08-17T02:24:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.392+0000 7fb4d2000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc0af350 con 0x7fb4cc158a20 2024-08-17T02:24:37.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.393+0000 7fb4cb400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb4cc158a20 0x7fb4cc0a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.393+0000 7fb4caa00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb4cc0ae860 0x7fb4cc06d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.393+0000 7fb4cbe00640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fb4cc158df0 0x7fb4cc15c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:60038/0 (socket says 172.21.15.2:60038) 2024-08-17T02:24:37.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.393+0000 7fb4cb400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb4cc158a20 0x7fb4cc0a89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:53498/0 (socket says 172.21.15.2:53498) 2024-08-17T02:24:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.393+0000 7fb4cbe00640 1 -- 172.21.15.2:0/2164182711 learned_addr learned my addr 172.21.15.2:0/2164182711 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:24:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.393+0000 7fb4ca000640 1 -- 172.21.15.2:0/2164182711 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2904163471 0 0) 0x7fb4cc0aed90 con 0x7fb4cc158df0 2024-08-17T02:24:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.393+0000 7fb4caa00640 1 -- 172.21.15.2:0/2164182711 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb4cc158a20 msgr2=0x7fb4cc0a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.393+0000 7fb4caa00640 1 --2- 172.21.15.2:0/2164182711 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb4cc158a20 0x7fb4cc0a89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.393+0000 7fb4caa00640 1 -- 172.21.15.2:0/2164182711 >> v1:172.21.15.145:6789/0 conn(0x7fb4cc158df0 legacy=0x7fb4cc15c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.393+0000 7fb4caa00640 1 -- 172.21.15.2:0/2164182711 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4cc0af630 con 0x7fb4cc0ae860 2024-08-17T02:24:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.394+0000 7fb4caa00640 1 --2- 172.21.15.2:0/2164182711 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4cc0ae860 0x7fb4cc06d7d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8009850 tx=0x7fb4b80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c207fd8dad120aeb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.395+0000 7fb4ca000640 1 -- 172.21.15.2:0/2164182711 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b802ad90 con 0x7fb4cc0ae860 2024-08-17T02:24:37.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.395+0000 7fb4ca000640 1 -- 172.21.15.2:0/2164182711 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b8032440 con 0x7fb4cc0ae860 2024-08-17T02:24:37.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.395+0000 7fb4ca000640 1 -- 172.21.15.2:0/2164182711 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b80327e0 con 0x7fb4cc0ae860 2024-08-17T02:24:37.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.395+0000 7fb4d2000640 1 -- 172.21.15.2:0/2164182711 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4cc0ae860 msgr2=0x7fb4cc06d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.395+0000 7fb4d2000640 1 --2- 172.21.15.2:0/2164182711 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4cc0ae860 0x7fb4cc06d7d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8009850 tx=0x7fb4b80090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.395+0000 7fb4d2000640 1 -- 172.21.15.2:0/2164182711 shutdown_connections 2024-08-17T02:24:37.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.395+0000 7fb4d2000640 1 --2- 172.21.15.2:0/2164182711 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4cc0ae860 0x7fb4cc06d7d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.395+0000 7fb4d2000640 1 --2- 172.21.15.2:0/2164182711 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb4cc158a20 0x7fb4cc0a89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.395+0000 7fb4d2000640 1 -- 172.21.15.2:0/2164182711 >> 172.21.15.2:0/2164182711 conn(0x7fb4cc066e60 msgr2=0x7fb4cc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:37.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.395+0000 7fb4d2000640 1 -- 172.21.15.2:0/2164182711 shutdown_connections 2024-08-17T02:24:37.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.395+0000 7fb4d2000640 1 -- 172.21.15.2:0/2164182711 wait complete. 2024-08-17T02:24:37.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.397+0000 7fb4d2000640 1 Processor -- start 2024-08-17T02:24:37.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.397+0000 7fb4d2000640 1 -- start start 2024-08-17T02:24:37.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.398+0000 7fb4d2000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb4cc0ae860 0x7fb4cc159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.398+0000 7fb4d2000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4cc158a20 0x7fb4cc152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.398+0000 7fb4d2000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4cc158df0 0x7fb4cc15b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.398+0000 7fb4d2000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc159770 con 0x7fb4cc158df0 2024-08-17T02:24:37.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.398+0000 7fb4d2000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc0ca750 con 0x7fb4cc158a20 2024-08-17T02:24:37.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.398+0000 7fb4d2000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc1529c0 con 0x7fb4cc0ae860 2024-08-17T02:24:37.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.398+0000 7fb4cbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4cc158df0 0x7fb4cc15b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.398+0000 7fb4cbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4cc158df0 0x7fb4cc15b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60658/0 (socket says 172.21.15.2:60658) 2024-08-17T02:24:37.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.398+0000 7fb4cbe00640 1 -- 172.21.15.2:0/215700876 learned_addr learned my addr 172.21.15.2:0/215700876 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:37.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.398+0000 7fb4cb400640 1 --2- 172.21.15.2:0/215700876 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb4cc0ae860 0x7fb4cc159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.398+0000 7fb4caa00640 1 --2- 172.21.15.2:0/215700876 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4cc158a20 0x7fb4cc152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.399+0000 7fb4cbe00640 1 -- 172.21.15.2:0/215700876 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb4cc0ae860 msgr2=0x7fb4cc159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.399+0000 7fb4cbe00640 1 --2- 172.21.15.2:0/215700876 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb4cc0ae860 0x7fb4cc159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.399+0000 7fb4cbe00640 1 -- 172.21.15.2:0/215700876 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4cc158a20 msgr2=0x7fb4cc152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.399+0000 7fb4cbe00640 1 --2- 172.21.15.2:0/215700876 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4cc158a20 0x7fb4cc152480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.399+0000 7fb4cbe00640 1 -- 172.21.15.2:0/215700876 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b8009390 con 0x7fb4cc158df0 2024-08-17T02:24:37.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.399+0000 7fb4cbe00640 1 --2- 172.21.15.2:0/215700876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4cc158df0 0x7fb4cc15b6c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb4c400cc10 tx=0x7fb4c4001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.399+0000 7fb4c2a00640 1 -- 172.21.15.2:0/215700876 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c400ce30 con 0x7fb4cc158df0 2024-08-17T02:24:37.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.399+0000 7fb4c2a00640 1 -- 172.21.15.2:0/215700876 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c400a7f0 con 0x7fb4cc158df0 2024-08-17T02:24:37.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.399+0000 7fb4d2000640 1 -- 172.21.15.2:0/215700876 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4cc155fe0 con 0x7fb4cc158df0 2024-08-17T02:24:37.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.399+0000 7fb4c2a00640 1 -- 172.21.15.2:0/215700876 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c400abf0 con 0x7fb4cc158df0 2024-08-17T02:24:37.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.399+0000 7fb4d2000640 1 -- 172.21.15.2:0/215700876 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4cc1562a0 con 0x7fb4cc158df0 2024-08-17T02:24:37.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.401+0000 7fb4d2000640 1 -- 172.21.15.2:0/215700876 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4cc063fb0 con 0x7fb4cc158df0 2024-08-17T02:24:37.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.401+0000 7fb4c2a00640 1 -- 172.21.15.2:0/215700876 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb4c400ad50 con 0x7fb4cc158df0 2024-08-17T02:24:37.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.402+0000 7fb4c2a00640 1 --2- 172.21.15.2:0/215700876 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb4ac065220 0x7fb4ac0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.402+0000 7fb4c2a00640 1 -- 172.21.15.2:0/215700876 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fb4c4082810 con 0x7fb4cc158df0 2024-08-17T02:24:37.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.402+0000 7fb4cb400640 1 --2- 172.21.15.2:0/215700876 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb4ac065220 0x7fb4ac0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.403+0000 7fb4cb400640 1 --2- 172.21.15.2:0/215700876 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb4ac065220 0x7fb4ac0676d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009d20 tx=0x7fb4bc0090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.406+0000 7fb4c2a00640 1 -- 172.21.15.2:0/215700876 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb4c4050690 con 0x7fb4cc158df0 2024-08-17T02:24:37.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.587+0000 7fb4d2000640 1 -- 172.21.15.2:0/215700876 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7fb4cc06e4c0 con 0x7fb4cc158df0 2024-08-17T02:24:37.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.588+0000 7fb4c2a00640 1 -- 172.21.15.2:0/215700876 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v35) v1 ==== 97+0+8050 (secure 0 0 0) 0x7fb4c4053cb0 con 0x7fb4cc158df0 2024-08-17T02:24:37.589 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:24:37.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.590+0000 7fb4d2000640 1 -- 172.21.15.2:0/215700876 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb4ac065220 msgr2=0x7fb4ac0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.590+0000 7fb4d2000640 1 --2- 172.21.15.2:0/215700876 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb4ac065220 0x7fb4ac0676d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009d20 tx=0x7fb4bc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.590+0000 7fb4d2000640 1 -- 172.21.15.2:0/215700876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4cc158df0 msgr2=0x7fb4cc15b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.590+0000 7fb4d2000640 1 --2- 172.21.15.2:0/215700876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4cc158df0 0x7fb4cc15b6c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb4c400cc10 tx=0x7fb4c4001970 comp rx=0 tx=0).stop 2024-08-17T02:24:37.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.590+0000 7fb4d2000640 1 -- 172.21.15.2:0/215700876 shutdown_connections 2024-08-17T02:24:37.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.590+0000 7fb4d2000640 1 --2- 172.21.15.2:0/215700876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4cc158df0 0x7fb4cc15b6c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.590+0000 7fb4d2000640 1 --2- 172.21.15.2:0/215700876 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4cc158a20 0x7fb4cc152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.590+0000 7fb4d2000640 1 --2- 172.21.15.2:0/215700876 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb4ac065220 0x7fb4ac0676d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.590+0000 7fb4d2000640 1 --2- 172.21.15.2:0/215700876 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb4cc0ae860 0x7fb4cc159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.590+0000 7fb4d2000640 1 -- 172.21.15.2:0/215700876 >> 172.21.15.2:0/215700876 conn(0x7fb4cc066e60 msgr2=0x7fb4cc0699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:37.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.590+0000 7fb4d2000640 1 -- 172.21.15.2:0/215700876 shutdown_connections 2024-08-17T02:24:37.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.590+0000 7fb4d2000640 1 -- 172.21.15.2:0/215700876 wait complete. 2024-08-17T02:24:37.606 INFO:teuthology.orchestra.run.smithi002.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:21.215146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:22.134466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000001044477.meta","create_time":"2024-08-17T02:24:33.976587+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001044477"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000001044477.data","create_time":"2024-08-17T02:24:34.827029+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001044477"}}}] 2024-08-17T02:24:37.606 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000001044477 --format=json 2024-08-17T02:24:37.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.759+0000 7fb1ff200640 1 Processor -- start 2024-08-17T02:24:37.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.759+0000 7fb1ff200640 1 -- start start 2024-08-17T02:24:37.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.760+0000 7fb1ff200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb2000ae910 0x7fb2000aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.760+0000 7fb1ff200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb200160720 0x7fb200162b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.760+0000 7fb1ff200640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2000aab10 con 0x7fb2000ae540 2024-08-17T02:24:37.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.760+0000 7fb1ff200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2000abfb0 con 0x7fb200160720 2024-08-17T02:24:37.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.760+0000 7fb1ff200640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2000ac250 con 0x7fb2000ae910 2024-08-17T02:24:37.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.760+0000 7fb1fe800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb200160720 0x7fb200162b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.760+0000 7fb1fe800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb200160720 0x7fb200162b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60668/0 (socket says 172.21.15.2:60668) 2024-08-17T02:24:37.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.760+0000 7fb1fe800640 1 -- 172.21.15.2:0/3929899006 learned_addr learned my addr 172.21.15.2:0/3929899006 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:37.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.760+0000 7fb1f7e00640 1 --2- 172.21.15.2:0/3929899006 >> v2:172.21.15.145:3300/0 conn(0x7fb2000ae910 0x7fb2000aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.761+0000 7fb1fe800640 1 -- 172.21.15.2:0/3929899006 >> v2:172.21.15.145:3300/0 conn(0x7fb2000ae910 msgr2=0x7fb2000aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:37.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.761+0000 7fb1fe800640 1 --2- 172.21.15.2:0/3929899006 >> v2:172.21.15.145:3300/0 conn(0x7fb2000ae910 0x7fb2000aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.761+0000 7fb1fe800640 1 -- 172.21.15.2:0/3929899006 >> v1:172.21.15.145:6789/0 conn(0x7fb2000ae540 legacy=0x7fb200068950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.761+0000 7fb1fe800640 1 -- 172.21.15.2:0/3929899006 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2000693e0 con 0x7fb200160720 2024-08-17T02:24:37.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.762+0000 7fb1fe800640 1 --2- 172.21.15.2:0/3929899006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb200160720 0x7fb200162b00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb20006f4a0 tx=0x7fb1f8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f775ca06cf1295 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.762+0000 7fb1fd400640 1 -- 172.21.15.2:0/3929899006 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8031400 con 0x7fb200160720 2024-08-17T02:24:37.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.762+0000 7fb1fd400640 1 -- 172.21.15.2:0/3929899006 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f802d050 con 0x7fb200160720 2024-08-17T02:24:37.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.762+0000 7fb1fd400640 1 -- 172.21.15.2:0/3929899006 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f80317d0 con 0x7fb200160720 2024-08-17T02:24:37.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.762+0000 7fb1ff200640 1 -- 172.21.15.2:0/3929899006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb200160720 msgr2=0x7fb200162b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.762+0000 7fb1ff200640 1 --2- 172.21.15.2:0/3929899006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb200160720 0x7fb200162b00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb20006f4a0 tx=0x7fb1f8009840 comp rx=0 tx=0).stop 2024-08-17T02:24:37.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.763+0000 7fb1ff200640 1 -- 172.21.15.2:0/3929899006 shutdown_connections 2024-08-17T02:24:37.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.763+0000 7fb1ff200640 1 --2- 172.21.15.2:0/3929899006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb200160720 0x7fb200162b00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.763+0000 7fb1ff200640 1 --2- 172.21.15.2:0/3929899006 >> v2:172.21.15.145:3300/0 conn(0x7fb2000ae910 0x7fb2000aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.763+0000 7fb1ff200640 1 -- 172.21.15.2:0/3929899006 >> 172.21.15.2:0/3929899006 conn(0x7fb2000ce400 msgr2=0x7fb200095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:37.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.763+0000 7fb1ff200640 1 -- 172.21.15.2:0/3929899006 shutdown_connections 2024-08-17T02:24:37.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.763+0000 7fb1ff200640 1 -- 172.21.15.2:0/3929899006 wait complete. 2024-08-17T02:24:37.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.764+0000 7fb1ff200640 1 Processor -- start 2024-08-17T02:24:37.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.764+0000 7fb1ff200640 1 -- start start 2024-08-17T02:24:37.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.765+0000 7fb1ff200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2000ae540 0x7fb20015c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.765+0000 7fb1ff200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2000ae910 0x7fb200155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.765+0000 7fb1ff200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb200160720 0x7fb200147470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.765+0000 7fb1ff200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb200156290 con 0x7fb200160720 2024-08-17T02:24:37.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.765+0000 7fb1ff200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb200146fe0 con 0x7fb2000ae910 2024-08-17T02:24:37.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.765+0000 7fb1ff200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20015ce70 con 0x7fb2000ae540 2024-08-17T02:24:37.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.765+0000 7fb1fe800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb200160720 0x7fb200147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.765+0000 7fb1fe800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb200160720 0x7fb200147470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60674/0 (socket says 172.21.15.2:60674) 2024-08-17T02:24:37.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.765+0000 7fb1fe800640 1 -- 172.21.15.2:0/1016429649 learned_addr learned my addr 172.21.15.2:0/1016429649 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:37.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.765+0000 7fb1f7e00640 1 --2- 172.21.15.2:0/1016429649 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2000ae910 0x7fb200155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.765+0000 7fb1fde00640 1 --2- 172.21.15.2:0/1016429649 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2000ae540 0x7fb20015c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.766+0000 7fb1fe800640 1 -- 172.21.15.2:0/1016429649 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2000ae540 msgr2=0x7fb20015c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.766+0000 7fb1fe800640 1 --2- 172.21.15.2:0/1016429649 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2000ae540 0x7fb20015c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.766+0000 7fb1fe800640 1 -- 172.21.15.2:0/1016429649 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2000ae910 msgr2=0x7fb200155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.766+0000 7fb1fe800640 1 --2- 172.21.15.2:0/1016429649 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2000ae910 0x7fb200155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.766+0000 7fb1fe800640 1 -- 172.21.15.2:0/1016429649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f8009ae0 con 0x7fb200160720 2024-08-17T02:24:37.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.766+0000 7fb1fe800640 1 --2- 172.21.15.2:0/1016429649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb200160720 0x7fb200147470 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8009f50 tx=0x7fb1f8034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.766+0000 7fb1f5600640 1 -- 172.21.15.2:0/1016429649 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8008e50 con 0x7fb200160720 2024-08-17T02:24:37.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.766+0000 7fb1f5600640 1 -- 172.21.15.2:0/1016429649 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f803b410 con 0x7fb200160720 2024-08-17T02:24:37.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.767+0000 7fb1f5600640 1 -- 172.21.15.2:0/1016429649 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f803b7d0 con 0x7fb200160720 2024-08-17T02:24:37.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.767+0000 7fb1ff200640 1 -- 172.21.15.2:0/1016429649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb20015cbb0 con 0x7fb200160720 2024-08-17T02:24:37.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.767+0000 7fb1ff200640 1 -- 172.21.15.2:0/1016429649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2001466b0 con 0x7fb200160720 2024-08-17T02:24:37.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.768+0000 7fb1ff200640 1 -- 172.21.15.2:0/1016429649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb200147150 con 0x7fb200160720 2024-08-17T02:24:37.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.768+0000 7fb1f5600640 1 -- 172.21.15.2:0/1016429649 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb1f8038050 con 0x7fb200160720 2024-08-17T02:24:37.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.769+0000 7fb1f5600640 1 --2- 172.21.15.2:0/1016429649 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb1dc065150 0x7fb1dc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.769+0000 7fb1f5600640 1 -- 172.21.15.2:0/1016429649 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fb1f80a3830 con 0x7fb200160720 2024-08-17T02:24:37.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.770+0000 7fb1fde00640 1 --2- 172.21.15.2:0/1016429649 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb1dc065150 0x7fb1dc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.770+0000 7fb1fde00640 1 --2- 172.21.15.2:0/1016429649 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb1dc065150 0x7fb1dc067600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0007fd0 tx=0x7fb1f0007e30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:37.773+0000 7fb1f5600640 1 -- 172.21.15.2:0/1016429649 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb1f8071580 con 0x7fb200160720 2024-08-17T02:24:38.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.003+0000 7fb1ff200640 1 -- 172.21.15.2:0/1016429649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000001044477", "format": "json"} v 0) v1 -- 0x7fb200070720 con 0x7fb200160720 2024-08-17T02:24:38.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.003+0000 7fb1f5600640 1 -- 172.21.15.2:0/1016429649 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000001044477", "format": "json"}]=0 v21) v1 ==== 110+0+1847 (secure 0 0 0) 0x7fb1f8036750 con 0x7fb200160720 2024-08-17T02:24:38.004 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:24:38.005 INFO:teuthology.orchestra.run.smithi002.stdout:{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:35.805568+0000","modified":"2024-08-17T02:24:37.800310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4903":{"gid":4903,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.145:6837/1729489536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":1729489536},{"type":"v1","addr":"172.21.15.145:6837","nonce":1729489536}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001044477","balancer":"","standby_count_wanted":1},"id":3} 2024-08-17T02:24:38.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.005+0000 7fb1ff200640 1 -- 172.21.15.2:0/1016429649 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb1dc065150 msgr2=0x7fb1dc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.005+0000 7fb1ff200640 1 --2- 172.21.15.2:0/1016429649 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb1dc065150 0x7fb1dc067600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0007fd0 tx=0x7fb1f0007e30 comp rx=0 tx=0).stop 2024-08-17T02:24:38.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.005+0000 7fb1ff200640 1 -- 172.21.15.2:0/1016429649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb200160720 msgr2=0x7fb200147470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.005+0000 7fb1ff200640 1 --2- 172.21.15.2:0/1016429649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb200160720 0x7fb200147470 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8009f50 tx=0x7fb1f8034000 comp rx=0 tx=0).stop 2024-08-17T02:24:38.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.005+0000 7fb1ff200640 1 -- 172.21.15.2:0/1016429649 shutdown_connections 2024-08-17T02:24:38.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.005+0000 7fb1ff200640 1 --2- 172.21.15.2:0/1016429649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb200160720 0x7fb200147470 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.005+0000 7fb1ff200640 1 --2- 172.21.15.2:0/1016429649 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2000ae910 0x7fb200155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.005+0000 7fb1ff200640 1 --2- 172.21.15.2:0/1016429649 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb1dc065150 0x7fb1dc067600 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.005+0000 7fb1ff200640 1 --2- 172.21.15.2:0/1016429649 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2000ae540 0x7fb20015c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.006+0000 7fb1ff200640 1 -- 172.21.15.2:0/1016429649 >> 172.21.15.2:0/1016429649 conn(0x7fb2000ce400 msgr2=0x7fb2000b2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.006+0000 7fb1ff200640 1 -- 172.21.15.2:0/1016429649 shutdown_connections 2024-08-17T02:24:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.006+0000 7fb1ff200640 1 -- 172.21.15.2:0/1016429649 wait complete. 2024-08-17T02:24:38.022 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000001044477 --yes-i-really-mean-it 2024-08-17T02:24:38.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.177+0000 7f82c8400640 1 Processor -- start 2024-08-17T02:24:38.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.177+0000 7f82c8400640 1 -- start start 2024-08-17T02:24:38.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.178+0000 7f82c8400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f82c0158d50 0x7f82c00ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.178+0000 7f82c8400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f82c0159120 0x7f82c00ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.178+0000 7f82c8400640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c00a96c0 con 0x7f82c00ac9e0 2024-08-17T02:24:38.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.178+0000 7f82c8400640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c00acf00 con 0x7f82c0158d50 2024-08-17T02:24:38.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.178+0000 7f82c8400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c00af7d0 con 0x7f82c0159120 2024-08-17T02:24:38.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.179+0000 7f82c5000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f82c0159120 0x7f82c00ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.179+0000 7f82c5a00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f82c0158d50 0x7f82c00ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.179+0000 7f82c5000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f82c0159120 0x7f82c00ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:53514/0 (socket says 172.21.15.2:53514) 2024-08-17T02:24:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.179+0000 7f82c5000640 1 -- 172.21.15.2:0/1558679295 learned_addr learned my addr 172.21.15.2:0/1558679295 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.179+0000 7f82c5000640 1 -- 172.21.15.2:0/1558679295 >> v2:172.21.15.145:3300/0 conn(0x7f82c0158d50 msgr2=0x7f82c00ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.179+0000 7f82c5000640 1 --2- 172.21.15.2:0/1558679295 >> v2:172.21.15.145:3300/0 conn(0x7f82c0158d50 0x7f82c00ac4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.179+0000 7f82c5000640 1 -- 172.21.15.2:0/1558679295 >> v1:172.21.15.145:6789/0 conn(0x7f82c00ac9e0 legacy=0x7f82c0066e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.179+0000 7f82c5000640 1 -- 172.21.15.2:0/1558679295 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c00a98f0 con 0x7f82c0159120 2024-08-17T02:24:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.179+0000 7f82c5a00640 1 --2- 172.21.15.2:0/1558679295 >> v2:172.21.15.145:3300/0 conn(0x7f82c0158d50 0x7f82c00ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.180+0000 7f82c5000640 1 --2- 172.21.15.2:0/1558679295 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f82c0159120 0x7f82c00ab8f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009910 tx=0x7f82ac0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba7ed4abcf804a35 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.181+0000 7f82bfe00640 1 -- 172.21.15.2:0/1558679295 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac02adb0 con 0x7f82c0159120 2024-08-17T02:24:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.181+0000 7f82bfe00640 1 -- 172.21.15.2:0/1558679295 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ac032440 con 0x7f82c0159120 2024-08-17T02:24:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.181+0000 7f82bfe00640 1 -- 172.21.15.2:0/1558679295 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac032820 con 0x7f82c0159120 2024-08-17T02:24:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.181+0000 7f82c8400640 1 -- 172.21.15.2:0/1558679295 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f82c0159120 msgr2=0x7f82c00ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.181+0000 7f82c8400640 1 --2- 172.21.15.2:0/1558679295 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f82c0159120 0x7f82c00ab8f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009910 tx=0x7f82ac0091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.181+0000 7f82c8400640 1 -- 172.21.15.2:0/1558679295 shutdown_connections 2024-08-17T02:24:38.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.181+0000 7f82c8400640 1 --2- 172.21.15.2:0/1558679295 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f82c0159120 0x7f82c00ab8f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.181+0000 7f82c8400640 1 --2- 172.21.15.2:0/1558679295 >> v2:172.21.15.145:3300/0 conn(0x7f82c0158d50 0x7f82c00ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.181+0000 7f82c8400640 1 -- 172.21.15.2:0/1558679295 >> 172.21.15.2:0/1558679295 conn(0x7f82c0095a70 msgr2=0x7f82c0095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:38.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.181+0000 7f82c8400640 1 -- 172.21.15.2:0/1558679295 shutdown_connections 2024-08-17T02:24:38.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.181+0000 7f82c8400640 1 -- 172.21.15.2:0/1558679295 wait complete. 2024-08-17T02:24:38.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.183+0000 7f82c8400640 1 Processor -- start 2024-08-17T02:24:38.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.183+0000 7f82c8400640 1 -- start start 2024-08-17T02:24:38.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.184+0000 7f82c8400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f82c00ac9e0 0x7f82c0156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.184+0000 7f82c8400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82c0158d50 0x7f82c015d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.184+0000 7f82c8400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f82c0159120 0x7f82c01442c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.184+0000 7f82c8400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c015e940 con 0x7f82c0158d50 2024-08-17T02:24:38.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.184+0000 7f82c8400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c015dd30 con 0x7f82c0159120 2024-08-17T02:24:38.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.184+0000 7f82c8400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c015e010 con 0x7f82c00ac9e0 2024-08-17T02:24:38.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.184+0000 7f82c5000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82c0158d50 0x7f82c015d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.184+0000 7f82c5000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82c0158d50 0x7f82c015d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60684/0 (socket says 172.21.15.2:60684) 2024-08-17T02:24:38.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.184+0000 7f82c5000640 1 -- 172.21.15.2:0/3356779821 learned_addr learned my addr 172.21.15.2:0/3356779821 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:24:38.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.184+0000 7f82c5a00640 1 --2- 172.21.15.2:0/3356779821 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f82c00ac9e0 0x7f82c0156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.184+0000 7f82c6400640 1 --2- 172.21.15.2:0/3356779821 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f82c0159120 0x7f82c01442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.184+0000 7f82c5000640 1 -- 172.21.15.2:0/3356779821 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f82c00ac9e0 msgr2=0x7f82c0156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.184+0000 7f82c5000640 1 --2- 172.21.15.2:0/3356779821 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f82c00ac9e0 0x7f82c0156600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.184+0000 7f82c5000640 1 -- 172.21.15.2:0/3356779821 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f82c0159120 msgr2=0x7f82c01442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.184+0000 7f82c5000640 1 --2- 172.21.15.2:0/3356779821 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f82c0159120 0x7f82c01442c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.184+0000 7f82c5000640 1 -- 172.21.15.2:0/3356779821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b4009390 con 0x7f82c0158d50 2024-08-17T02:24:38.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.185+0000 7f82c5000640 1 --2- 172.21.15.2:0/3356779821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82c0158d50 0x7f82c015d4c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f82ac035040 tx=0x7f82ac032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:38.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.185+0000 7f82bcc00640 1 -- 172.21.15.2:0/3356779821 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac031bb0 con 0x7f82c0158d50 2024-08-17T02:24:38.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.185+0000 7f82bcc00640 1 -- 172.21.15.2:0/3356779821 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ac031d70 con 0x7f82c0158d50 2024-08-17T02:24:38.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.185+0000 7f82bcc00640 1 -- 172.21.15.2:0/3356779821 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac03d670 con 0x7f82c0158d50 2024-08-17T02:24:38.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.185+0000 7f82c8400640 1 -- 172.21.15.2:0/3356779821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82ac009450 con 0x7f82c0158d50 2024-08-17T02:24:38.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.185+0000 7f82c8400640 1 -- 172.21.15.2:0/3356779821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c015e5d0 con 0x7f82c0158d50 2024-08-17T02:24:38.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.186+0000 7f82c8400640 1 -- 172.21.15.2:0/3356779821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c015eaf0 con 0x7f82c0158d50 2024-08-17T02:24:38.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.187+0000 7f82bcc00640 1 -- 172.21.15.2:0/3356779821 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f82ac039040 con 0x7f82c0158d50 2024-08-17T02:24:38.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.188+0000 7f82bcc00640 1 --2- 172.21.15.2:0/3356779821 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f82a0065150 0x7f82a0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.188+0000 7f82bcc00640 1 -- 172.21.15.2:0/3356779821 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f82ac0a25c0 con 0x7f82c0158d50 2024-08-17T02:24:38.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.188+0000 7f82c5a00640 1 --2- 172.21.15.2:0/3356779821 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f82a0065150 0x7f82a0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.189+0000 7f82c5a00640 1 --2- 172.21.15.2:0/3356779821 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f82a0065150 0x7f82a0067600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009eb0 tx=0x7f82b40090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:38.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.192+0000 7f82bcc00640 1 -- 172.21.15.2:0/3356779821 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f82c015eaf0 con 0x7f82c0158d50 2024-08-17T02:24:38.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:24:38.402+0000 7f82c8400640 1 -- 172.21.15.2:0/3356779821 --> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000001044477", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f82c0063fb0 con 0x7f82a0065150 2024-08-17T02:24:41.615 INFO:tasks.ceph.mds.d.smithi145.stderr:2024-08-17T02:24:41.614+0000 7f9368400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:25:06.747 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:06.754 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:36.859 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:36.865 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:06.963 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:06.968 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:37.061 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:37.066 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:38.093 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-08-17T02:26:38.094 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:26:38.094 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:26:38.199 DEBUG:teuthology.orchestra.run.smithi145:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:26:38.281 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:26:38.282 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:26:38.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:38.282 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:38.352 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:26:38.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:38.353 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:26:38.389 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:26:38.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:38.390 DEBUG:teuthology.orchestra.run.smithi145:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:38.456 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi145.front.sepia.ceph.com 2024-08-17T02:26:38.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:38.457 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:26:38.493 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:38.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.644+0000 7f4829800640 1 Processor -- start 2024-08-17T02:26:38.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.644+0000 7f4829800640 1 -- start start 2024-08-17T02:26:38.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.646+0000 7f4829800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f48240afca0 0x7f48240b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.646+0000 7f4829800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f48240acf10 0x7f4824159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.646+0000 7f4829800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482415a4e0 con 0x7f48241589a0 2024-08-17T02:26:38.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.646+0000 7f4829800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48240b0980 con 0x7f48240acf10 2024-08-17T02:26:38.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.646+0000 7f4829800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48240c92b0 con 0x7f48240afca0 2024-08-17T02:26:38.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.646+0000 7f481be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f48240acf10 0x7f4824159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.646+0000 7f4823400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f48241589a0 0x7f482406d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55446/0 (socket says 172.21.15.2:55446) 2024-08-17T02:26:38.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.646+0000 7f4823400640 1 -- 172.21.15.2:0/2553992040 learned_addr learned my addr 172.21.15.2:0/2553992040 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:26:38.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.646+0000 7f481be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f48240acf10 0x7f4824159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48292/0 (socket says 172.21.15.2:48292) 2024-08-17T02:26:38.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.646+0000 7f4822a00640 1 --2- 172.21.15.2:0/2553992040 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f48240afca0 0x7f48240b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.646+0000 7f481be00640 1 -- 172.21.15.2:0/2553992040 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f48240afca0 msgr2=0x7f48240b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.647+0000 7f481be00640 1 --2- 172.21.15.2:0/2553992040 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f48240afca0 0x7f48240b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.647+0000 7f481be00640 1 -- 172.21.15.2:0/2553992040 >> v1:172.21.15.2:6789/0 conn(0x7f48241589a0 legacy=0x7f482406d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.647+0000 7f481be00640 1 -- 172.21.15.2:0/2553992040 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48240ad480 con 0x7f48240acf10 2024-08-17T02:26:38.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.647+0000 7f4822a00640 1 --2- 172.21.15.2:0/2553992040 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f48240afca0 0x7f48240b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:38.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.647+0000 7f4822000640 1 -- 172.21.15.2:0/2553992040 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702133647 0 0) 0x7f481c001490 con 0x7f48241589a0 2024-08-17T02:26:38.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.648+0000 7f481be00640 1 --2- 172.21.15.2:0/2553992040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48240acf10 0x7f4824159fa0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f480c009880 tx=0x7f480c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ce21137284dff5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.648+0000 7f4822000640 1 -- 172.21.15.2:0/2553992040 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c02ad70 con 0x7f48240acf10 2024-08-17T02:26:38.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.648+0000 7f4822000640 1 -- 172.21.15.2:0/2553992040 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480c032440 con 0x7f48240acf10 2024-08-17T02:26:38.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.648+0000 7f4822000640 1 -- 172.21.15.2:0/2553992040 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c0327e0 con 0x7f48240acf10 2024-08-17T02:26:38.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.648+0000 7f4829800640 1 -- 172.21.15.2:0/2553992040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48240acf10 msgr2=0x7f4824159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.648+0000 7f4829800640 1 --2- 172.21.15.2:0/2553992040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48240acf10 0x7f4824159fa0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f480c009880 tx=0x7f480c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.648+0000 7f4829800640 1 -- 172.21.15.2:0/2553992040 shutdown_connections 2024-08-17T02:26:38.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.648+0000 7f4829800640 1 --2- 172.21.15.2:0/2553992040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48240acf10 0x7f4824159fa0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.648+0000 7f4829800640 1 --2- 172.21.15.2:0/2553992040 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f48240afca0 0x7f48240b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.648+0000 7f4829800640 1 -- 172.21.15.2:0/2553992040 >> 172.21.15.2:0/2553992040 conn(0x7f4824066e60 msgr2=0x7f4824067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.649+0000 7f4829800640 1 -- 172.21.15.2:0/2553992040 shutdown_connections 2024-08-17T02:26:38.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.649+0000 7f4829800640 1 -- 172.21.15.2:0/2553992040 wait complete. 2024-08-17T02:26:38.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.650+0000 7f4829800640 1 Processor -- start 2024-08-17T02:26:38.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.650+0000 7f4829800640 1 -- start start 2024-08-17T02:26:38.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.651+0000 7f4829800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f48240acf10 0x7f4824149d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.651+0000 7f4829800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48240afca0 0x7f482414d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.651+0000 7f4829800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f48241589a0 0x7f482415b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.651+0000 7f4829800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4824147b10 con 0x7f48240afca0 2024-08-17T02:26:38.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.651+0000 7f4829800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48241471e0 con 0x7f48240acf10 2024-08-17T02:26:38.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.651+0000 7f4829800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48241474c0 con 0x7f48241589a0 2024-08-17T02:26:38.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.651+0000 7f481be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48240afca0 0x7f482414d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.651+0000 7f481be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48240afca0 0x7f482414d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48294/0 (socket says 172.21.15.2:48294) 2024-08-17T02:26:38.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.651+0000 7f481be00640 1 -- 172.21.15.2:0/2578024763 learned_addr learned my addr 172.21.15.2:0/2578024763 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:38.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.651+0000 7f4822a00640 1 --2- 172.21.15.2:0/2578024763 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f48240acf10 0x7f4824149d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.651+0000 7f4823400640 1 --2- 172.21.15.2:0/2578024763 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f48241589a0 0x7f482415b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.652+0000 7f481be00640 1 -- 172.21.15.2:0/2578024763 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f48241589a0 msgr2=0x7f482415b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.652+0000 7f481be00640 1 --2- 172.21.15.2:0/2578024763 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f48241589a0 0x7f482415b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.652+0000 7f481be00640 1 -- 172.21.15.2:0/2578024763 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f48240acf10 msgr2=0x7f4824149d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.652+0000 7f481be00640 1 --2- 172.21.15.2:0/2578024763 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f48240acf10 0x7f4824149d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.652+0000 7f481be00640 1 -- 172.21.15.2:0/2578024763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480c009390 con 0x7f48240afca0 2024-08-17T02:26:38.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.652+0000 7f4823400640 1 --2- 172.21.15.2:0/2578024763 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f48241589a0 0x7f482415b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:38.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.652+0000 7f4822a00640 1 --2- 172.21.15.2:0/2578024763 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f48240acf10 0x7f4824149d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:38.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.652+0000 7f481be00640 1 --2- 172.21.15.2:0/2578024763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48240afca0 0x7f482414d760 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f480c009880 tx=0x7f480c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.652+0000 7f481a000640 1 -- 172.21.15.2:0/2578024763 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c000d10 con 0x7f48240afca0 2024-08-17T02:26:38.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.652+0000 7f481a000640 1 -- 172.21.15.2:0/2578024763 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480c031a60 con 0x7f48240afca0 2024-08-17T02:26:38.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.652+0000 7f481a000640 1 -- 172.21.15.2:0/2578024763 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c031e60 con 0x7f48240afca0 2024-08-17T02:26:38.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.652+0000 7f4829800640 1 -- 172.21.15.2:0/2578024763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48241477a0 con 0x7f48240afca0 2024-08-17T02:26:38.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.652+0000 7f4829800640 1 -- 172.21.15.2:0/2578024763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f482414dca0 con 0x7f48240afca0 2024-08-17T02:26:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.654+0000 7f4829800640 1 -- 172.21.15.2:0/2578024763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4824147cc0 con 0x7f48240afca0 2024-08-17T02:26:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.654+0000 7f481a000640 1 -- 172.21.15.2:0/2578024763 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f480c03c400 con 0x7f48240afca0 2024-08-17T02:26:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.655+0000 7f481a000640 1 --2- 172.21.15.2:0/2578024763 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4800065220 0x7f48000676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.655+0000 7f481a000640 1 -- 172.21.15.2:0/2578024763 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f480c0a2c50 con 0x7f48240afca0 2024-08-17T02:26:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.656+0000 7f4822a00640 1 --2- 172.21.15.2:0/2578024763 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4800065220 0x7f48000676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.656+0000 7f4822a00640 1 --2- 172.21.15.2:0/2578024763 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4800065220 0x7f48000676d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4814006e70 tx=0x7f4814008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.660+0000 7f481a000640 1 -- 172.21.15.2:0/2578024763 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4824147cc0 con 0x7f48240afca0 2024-08-17T02:26:38.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.881+0000 7f4829800640 1 -- 172.21.15.2:0/2578024763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4824063fb0 con 0x7f48240afca0 2024-08-17T02:26:38.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.881+0000 7f481a000640 1 -- 172.21.15.2:0/2578024763 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5684 (secure 0 0 0) 0x7f480c037090 con 0x7f48240afca0 2024-08-17T02:26:38.882 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:26:38.882 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1347318932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1347318932},{"type":"v1","addr":"172.21.15.2:6834","nonce":1347318932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6836/4156967978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":4156967978},{"type":"v1","addr":"172.21.15.145:6836","nonce":4156967978}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:23.151218+0000","modified":"2024-08-17T02:24:26.741121+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4950},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4950":{"gid":4950,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/3013258535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3013258535},{"type":"v1","addr":"172.21.15.2:6835","nonce":3013258535}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:35.805568+0000","modified":"2024-08-17T02:24:37.800310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4903":{"gid":4903,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.145:6837/1729489536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":1729489536},{"type":"v1","addr":"172.21.15.145:6837","nonce":1729489536}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001044477","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:26:38.882 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 21 2024-08-17T02:26:38.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.884+0000 7f4829800640 1 -- 172.21.15.2:0/2578024763 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4800065220 msgr2=0x7f48000676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.884+0000 7f4829800640 1 --2- 172.21.15.2:0/2578024763 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4800065220 0x7f48000676d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4814006e70 tx=0x7f4814008040 comp rx=0 tx=0).stop 2024-08-17T02:26:38.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.884+0000 7f4829800640 1 -- 172.21.15.2:0/2578024763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48240afca0 msgr2=0x7f482414d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.884+0000 7f4829800640 1 --2- 172.21.15.2:0/2578024763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48240afca0 0x7f482414d760 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f480c009880 tx=0x7f480c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:38.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.884+0000 7f4829800640 1 -- 172.21.15.2:0/2578024763 shutdown_connections 2024-08-17T02:26:38.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.884+0000 7f4829800640 1 --2- 172.21.15.2:0/2578024763 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4800065220 0x7f48000676d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.884+0000 7f4829800640 1 --2- 172.21.15.2:0/2578024763 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f48241589a0 0x7f482415b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.884+0000 7f4829800640 1 --2- 172.21.15.2:0/2578024763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48240afca0 0x7f482414d760 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.884+0000 7f4829800640 1 --2- 172.21.15.2:0/2578024763 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f48240acf10 0x7f4824149d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.884+0000 7f4829800640 1 -- 172.21.15.2:0/2578024763 >> 172.21.15.2:0/2578024763 conn(0x7f4824066e60 msgr2=0x7f482406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.884+0000 7f4829800640 1 -- 172.21.15.2:0/2578024763 shutdown_connections 2024-08-17T02:26:38.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:38.884+0000 7f4829800640 1 -- 172.21.15.2:0/2578024763 wait complete. 2024-08-17T02:26:38.899 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:39.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.051+0000 7f9297000640 1 Processor -- start 2024-08-17T02:26:39.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.051+0000 7f9297000640 1 -- start start 2024-08-17T02:26:39.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.052+0000 7f9297000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92900ad960 0x7f929015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.052+0000 7f9297000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f92900ca050 0x7f9290156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.052+0000 7f9297000640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929015b5e0 con 0x7f92900add30 2024-08-17T02:26:39.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.052+0000 7f9297000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92900cb160 con 0x7f92900ca050 2024-08-17T02:26:39.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.052+0000 7f9297000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92900b0d10 con 0x7f92900ad960 2024-08-17T02:26:39.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.052+0000 7f928f400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f92900ca050 0x7f9290156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.053+0000 7f928f400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f92900ca050 0x7f9290156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48298/0 (socket says 172.21.15.2:48298) 2024-08-17T02:26:39.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.053+0000 7f928f400640 1 -- 172.21.15.2:0/609402006 learned_addr learned my addr 172.21.15.2:0/609402006 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:39.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.053+0000 7f928fe00640 1 --2- 172.21.15.2:0/609402006 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92900ad960 0x7f929015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.053+0000 7f928f400640 1 -- 172.21.15.2:0/609402006 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92900ad960 msgr2=0x7f929015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:39.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.053+0000 7f928f400640 1 --2- 172.21.15.2:0/609402006 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92900ad960 0x7f929015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.053+0000 7f928f400640 1 -- 172.21.15.2:0/609402006 >> v1:172.21.15.145:6789/0 conn(0x7f92900add30 legacy=0x7f9290156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.053+0000 7f928f400640 1 -- 172.21.15.2:0/609402006 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92900ca550 con 0x7f92900ca050 2024-08-17T02:26:39.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.054+0000 7f928f400640 1 --2- 172.21.15.2:0/609402006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92900ca050 0x7f9290156420 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f927c009910 tx=0x7f927c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad97deeee5314a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.054+0000 7f928ea00640 1 -- 172.21.15.2:0/609402006 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c032440 con 0x7f92900ca050 2024-08-17T02:26:39.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.054+0000 7f928ea00640 1 -- 172.21.15.2:0/609402006 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927c0325a0 con 0x7f92900ca050 2024-08-17T02:26:39.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.054+0000 7f928ea00640 1 -- 172.21.15.2:0/609402006 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c032980 con 0x7f92900ca050 2024-08-17T02:26:39.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.055+0000 7f9297000640 1 -- 172.21.15.2:0/609402006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92900ca050 msgr2=0x7f9290156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.055+0000 7f9297000640 1 --2- 172.21.15.2:0/609402006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92900ca050 0x7f9290156420 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f927c009910 tx=0x7f927c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.055+0000 7f9297000640 1 -- 172.21.15.2:0/609402006 shutdown_connections 2024-08-17T02:26:39.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.055+0000 7f9297000640 1 --2- 172.21.15.2:0/609402006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92900ca050 0x7f9290156420 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.055+0000 7f9297000640 1 --2- 172.21.15.2:0/609402006 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92900ad960 0x7f929015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.055+0000 7f9297000640 1 -- 172.21.15.2:0/609402006 >> 172.21.15.2:0/609402006 conn(0x7f9290066e60 msgr2=0x7f9290067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.055+0000 7f9297000640 1 -- 172.21.15.2:0/609402006 shutdown_connections 2024-08-17T02:26:39.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.055+0000 7f9297000640 1 -- 172.21.15.2:0/609402006 wait complete. 2024-08-17T02:26:39.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.056+0000 7f9297000640 1 Processor -- start 2024-08-17T02:26:39.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.057+0000 7f9297000640 1 -- start start 2024-08-17T02:26:39.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.057+0000 7f9297000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92900ad960 0x7f929006df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.057+0000 7f9297000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92900add30 0x7f92900ac5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.058+0000 7f9297000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92900ca050 0x7f92901531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.058+0000 7f9297000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92900abcb0 con 0x7f92900ca050 2024-08-17T02:26:39.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.058+0000 7f9297000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92900acee0 con 0x7f92900add30 2024-08-17T02:26:39.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.058+0000 7f9297000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92900ab660 con 0x7f92900ad960 2024-08-17T02:26:39.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.058+0000 7f9295000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92900ca050 0x7f92901531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.058+0000 7f9295000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92900ca050 0x7f92901531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48314/0 (socket says 172.21.15.2:48314) 2024-08-17T02:26:39.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.058+0000 7f9295000640 1 -- 172.21.15.2:0/621657167 learned_addr learned my addr 172.21.15.2:0/621657167 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:39.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.058+0000 7f928fe00640 1 --2- 172.21.15.2:0/621657167 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92900ad960 0x7f929006df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.058+0000 7f928f400640 1 --2- 172.21.15.2:0/621657167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92900add30 0x7f92900ac5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.058+0000 7f9295000640 1 -- 172.21.15.2:0/621657167 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92900ad960 msgr2=0x7f929006df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.058+0000 7f9295000640 1 --2- 172.21.15.2:0/621657167 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92900ad960 0x7f929006df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.058+0000 7f9295000640 1 -- 172.21.15.2:0/621657167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92900add30 msgr2=0x7f92900ac5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.058+0000 7f9295000640 1 --2- 172.21.15.2:0/621657167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92900add30 0x7f92900ac5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.058+0000 7f9295000640 1 -- 172.21.15.2:0/621657167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c009450 con 0x7f92900ca050 2024-08-17T02:26:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.059+0000 7f9295000640 1 --2- 172.21.15.2:0/621657167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92900ca050 0x7f92901531d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f928800c860 tx=0x7f9288001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.059+0000 7f9287400640 1 -- 172.21.15.2:0/621657167 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928800ce50 con 0x7f92900ca050 2024-08-17T02:26:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.059+0000 7f9287400640 1 -- 172.21.15.2:0/621657167 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928800a850 con 0x7f92900ca050 2024-08-17T02:26:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.059+0000 7f9297000640 1 -- 172.21.15.2:0/621657167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92900ab940 con 0x7f92900ca050 2024-08-17T02:26:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.059+0000 7f9287400640 1 -- 172.21.15.2:0/621657167 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928800ac10 con 0x7f92900ca050 2024-08-17T02:26:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.059+0000 7f9297000640 1 -- 172.21.15.2:0/621657167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92900ac140 con 0x7f92900ca050 2024-08-17T02:26:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.060+0000 7f9297000640 1 -- 172.21.15.2:0/621657167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92900ac3c0 con 0x7f92900ca050 2024-08-17T02:26:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.061+0000 7f9287400640 1 -- 172.21.15.2:0/621657167 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9288012630 con 0x7f92900ca050 2024-08-17T02:26:39.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.062+0000 7f9287400640 1 --2- 172.21.15.2:0/621657167 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9270065150 0x7f9270067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.062+0000 7f9287400640 1 -- 172.21.15.2:0/621657167 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f9288082800 con 0x7f92900ca050 2024-08-17T02:26:39.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.062+0000 7f928fe00640 1 --2- 172.21.15.2:0/621657167 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9270065150 0x7f9270067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.063+0000 7f928fe00640 1 --2- 172.21.15.2:0/621657167 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9270065150 0x7f9270067600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f92900aaee0 tx=0x7f9280008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.066+0000 7f9287400640 1 -- 172.21.15.2:0/621657167 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f92900ac3c0 con 0x7f92900ca050 2024-08-17T02:26:39.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.248+0000 7f9297000640 1 -- 172.21.15.2:0/621657167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92900ab4c0 con 0x7f92900ca050 2024-08-17T02:26:39.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.249+0000 7f9287400640 1 -- 172.21.15.2:0/621657167 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18551 (secure 0 0 0) 0x7f92900ab4c0 con 0x7f92900ca050 2024-08-17T02:26:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:26:39.250 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":36,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:24:37.793272+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:21.215146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:22.134466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000001044477.meta","create_time":"2024-08-17T02:24:33.976587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001044477"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001044477.data","create_time":"2024-08-17T02:24:34.827029+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001044477"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.251+0000 7f9297000640 1 -- 172.21.15.2:0/621657167 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9270065150 msgr2=0x7f9270067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.251+0000 7f9297000640 1 --2- 172.21.15.2:0/621657167 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9270065150 0x7f9270067600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f92900aaee0 tx=0x7f9280008040 comp rx=0 tx=0).stop 2024-08-17T02:26:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.251+0000 7f9297000640 1 -- 172.21.15.2:0/621657167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92900ca050 msgr2=0x7f92901531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.251+0000 7f9297000640 1 --2- 172.21.15.2:0/621657167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92900ca050 0x7f92901531d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f928800c860 tx=0x7f9288001690 comp rx=0 tx=0).stop 2024-08-17T02:26:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.251+0000 7f9297000640 1 -- 172.21.15.2:0/621657167 shutdown_connections 2024-08-17T02:26:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.251+0000 7f9297000640 1 --2- 172.21.15.2:0/621657167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92900ca050 0x7f92901531d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.251+0000 7f9297000640 1 --2- 172.21.15.2:0/621657167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92900add30 0x7f92900ac5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.251+0000 7f9297000640 1 --2- 172.21.15.2:0/621657167 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9270065150 0x7f9270067600 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.251+0000 7f9297000640 1 --2- 172.21.15.2:0/621657167 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92900ad960 0x7f929006df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.251+0000 7f9297000640 1 -- 172.21.15.2:0/621657167 >> 172.21.15.2:0/621657167 conn(0x7f9290066e60 msgr2=0x7f92901561f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.251+0000 7f9297000640 1 -- 172.21.15.2:0/621657167 shutdown_connections 2024-08-17T02:26:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.252+0000 7f9297000640 1 -- 172.21.15.2:0/621657167 wait complete. 2024-08-17T02:26:39.267 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:23:26.107978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:24:21.215146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:24:22.134466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000001044477.meta', 'create_time': '2024-08-17T02:24:33.976587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000001044477'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000001044477.data', 'create_time': '2024-08-17T02:24:34.827029+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000001044477'}}}] 2024-08-17T02:26:39.267 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:39.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.421+0000 7fd73a000640 1 Processor -- start 2024-08-17T02:26:39.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.422+0000 7fd73a000640 1 -- start start 2024-08-17T02:26:39.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.423+0000 7fd73a000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd73415c2e0 0x7fd7340ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.423+0000 7fd73a000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7340cdc60 con 0x7fd7340cc7e0 2024-08-17T02:26:39.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.423+0000 7fd73a000640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7340cdf40 con 0x7fd7340cd780 2024-08-17T02:26:39.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.423+0000 7fd73a000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7340ce220 con 0x7fd73415c2e0 2024-08-17T02:26:39.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.423+0000 7fd738c00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd7340cc7e0 0x7fd7340cab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55460/0 (socket says 172.21.15.2:55460) 2024-08-17T02:26:39.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.423+0000 7fd738c00640 1 -- 172.21.15.2:0/2860868992 learned_addr learned my addr 172.21.15.2:0/2860868992 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:26:39.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.423+0000 7fd739600640 1 --2- 172.21.15.2:0/2860868992 >> v2:172.21.15.2:3300/0 conn(0x7fd73415c2e0 0x7fd7340ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.423+0000 7fd739600640 1 -- 172.21.15.2:0/2860868992 >> v1:172.21.15.145:6789/0 conn(0x7fd7340cd780 legacy=0x7fd73415bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.424+0000 7fd739600640 1 -- 172.21.15.2:0/2860868992 >> v1:172.21.15.2:6789/0 conn(0x7fd7340cc7e0 legacy=0x7fd7340cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.424+0000 7fd739600640 1 -- 172.21.15.2:0/2860868992 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7340ce500 con 0x7fd73415c2e0 2024-08-17T02:26:39.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.424+0000 7fd733400640 1 -- 172.21.15.2:0/2860868992 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1626189227 0 0) 0x7fd7340cdc60 con 0x7fd7340cc7e0 2024-08-17T02:26:39.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.425+0000 7fd739600640 1 --2- 172.21.15.2:0/2860868992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd73415c2e0 0x7fd7340ccbb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009e60 tx=0x7fd72c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5391a805b14d5d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.425+0000 7fd733400640 1 -- 172.21.15.2:0/2860868992 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c007550 con 0x7fd73415c2e0 2024-08-17T02:26:39.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.425+0000 7fd733400640 1 -- 172.21.15.2:0/2860868992 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72c02d050 con 0x7fd73415c2e0 2024-08-17T02:26:39.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.425+0000 7fd733400640 1 -- 172.21.15.2:0/2860868992 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c007900 con 0x7fd73415c2e0 2024-08-17T02:26:39.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.425+0000 7fd73a000640 1 -- 172.21.15.2:0/2860868992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd73415c2e0 msgr2=0x7fd7340ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.425+0000 7fd73a000640 1 --2- 172.21.15.2:0/2860868992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd73415c2e0 0x7fd7340ccbb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009e60 tx=0x7fd72c009780 comp rx=0 tx=0).stop 2024-08-17T02:26:39.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.426+0000 7fd73a000640 1 -- 172.21.15.2:0/2860868992 shutdown_connections 2024-08-17T02:26:39.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.426+0000 7fd73a000640 1 --2- 172.21.15.2:0/2860868992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd73415c2e0 0x7fd7340ccbb0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.426+0000 7fd73a000640 1 -- 172.21.15.2:0/2860868992 >> 172.21.15.2:0/2860868992 conn(0x7fd734087a80 msgr2=0x7fd73406e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.426+0000 7fd73a000640 1 -- 172.21.15.2:0/2860868992 shutdown_connections 2024-08-17T02:26:39.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.426+0000 7fd73a000640 1 -- 172.21.15.2:0/2860868992 wait complete. 2024-08-17T02:26:39.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.427+0000 7fd73a000640 1 Processor -- start 2024-08-17T02:26:39.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.427+0000 7fd73a000640 1 -- start start 2024-08-17T02:26:39.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.428+0000 7fd73a000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7340cc7e0 0x7fd73415f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.428+0000 7fd73a000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7340cd780 0x7fd734152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.428+0000 7fd73a000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd73415c2e0 0x7fd7340b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.428+0000 7fd73a000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd734152d40 con 0x7fd7340cd780 2024-08-17T02:26:39.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.428+0000 7fd73a000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd734158520 con 0x7fd73415c2e0 2024-08-17T02:26:39.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.428+0000 7fd73a000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd734158090 con 0x7fd7340cc7e0 2024-08-17T02:26:39.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.428+0000 7fd733e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7340cd780 0x7fd734152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.428+0000 7fd733e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7340cd780 0x7fd734152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48338/0 (socket says 172.21.15.2:48338) 2024-08-17T02:26:39.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.428+0000 7fd733e00640 1 -- 172.21.15.2:0/790821127 learned_addr learned my addr 172.21.15.2:0/790821127 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:39.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.429+0000 7fd738c00640 1 --2- 172.21.15.2:0/790821127 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7340cc7e0 0x7fd73415f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.429+0000 7fd739600640 1 --2- 172.21.15.2:0/790821127 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd73415c2e0 0x7fd7340b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.429+0000 7fd733e00640 1 -- 172.21.15.2:0/790821127 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7340cc7e0 msgr2=0x7fd73415f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.429+0000 7fd733e00640 1 --2- 172.21.15.2:0/790821127 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7340cc7e0 0x7fd73415f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.429+0000 7fd733e00640 1 -- 172.21.15.2:0/790821127 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd73415c2e0 msgr2=0x7fd7340b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.429+0000 7fd733e00640 1 --2- 172.21.15.2:0/790821127 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd73415c2e0 0x7fd7340b05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.429+0000 7fd733e00640 1 -- 172.21.15.2:0/790821127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c009a20 con 0x7fd7340cd780 2024-08-17T02:26:39.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.429+0000 7fd739600640 1 --2- 172.21.15.2:0/790821127 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd73415c2e0 0x7fd7340b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:39.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.429+0000 7fd733e00640 1 --2- 172.21.15.2:0/790821127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7340cd780 0x7fd734152800 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd72000c5c0 tx=0x7fd720007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.429+0000 7fd727e00640 1 -- 172.21.15.2:0/790821127 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd720012630 con 0x7fd7340cd780 2024-08-17T02:26:39.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.429+0000 7fd727e00640 1 -- 172.21.15.2:0/790821127 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7200127b0 con 0x7fd7340cd780 2024-08-17T02:26:39.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.429+0000 7fd727e00640 1 -- 172.21.15.2:0/790821127 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd720012b70 con 0x7fd7340cd780 2024-08-17T02:26:39.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.429+0000 7fd73a000640 1 -- 172.21.15.2:0/790821127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd734157480 con 0x7fd7340cd780 2024-08-17T02:26:39.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.430+0000 7fd73a000640 1 -- 172.21.15.2:0/790821127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd734157a40 con 0x7fd7340cd780 2024-08-17T02:26:39.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.431+0000 7fd73a000640 1 -- 172.21.15.2:0/790821127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd734070720 con 0x7fd7340cd780 2024-08-17T02:26:39.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.431+0000 7fd727e00640 1 -- 172.21.15.2:0/790821127 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd72001b400 con 0x7fd7340cd780 2024-08-17T02:26:39.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.432+0000 7fd727e00640 1 --2- 172.21.15.2:0/790821127 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd714065150 0x7fd714067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.432+0000 7fd727e00640 1 -- 172.21.15.2:0/790821127 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fd720082360 con 0x7fd7340cd780 2024-08-17T02:26:39.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.433+0000 7fd738c00640 1 --2- 172.21.15.2:0/790821127 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd714065150 0x7fd714067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.433+0000 7fd738c00640 1 --2- 172.21.15.2:0/790821127 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd714065150 0x7fd714067600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd7280011e0 tx=0x7fd728007c80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.436+0000 7fd727e00640 1 -- 172.21.15.2:0/790821127 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd720050000 con 0x7fd7340cd780 2024-08-17T02:26:39.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.619+0000 7fd73a000640 1 -- 172.21.15.2:0/790821127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd73415b980 con 0x7fd7340cd780 2024-08-17T02:26:39.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.619+0000 7fd727e00640 1 -- 172.21.15.2:0/790821127 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd720053620 con 0x7fd7340cd780 2024-08-17T02:26:39.620 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-17T02:26:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.621+0000 7fd73a000640 1 -- 172.21.15.2:0/790821127 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd714065150 msgr2=0x7fd714067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.621+0000 7fd73a000640 1 --2- 172.21.15.2:0/790821127 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd714065150 0x7fd714067600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd7280011e0 tx=0x7fd728007c80 comp rx=0 tx=0).stop 2024-08-17T02:26:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.621+0000 7fd73a000640 1 -- 172.21.15.2:0/790821127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7340cd780 msgr2=0x7fd734152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.621+0000 7fd73a000640 1 --2- 172.21.15.2:0/790821127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7340cd780 0x7fd734152800 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd72000c5c0 tx=0x7fd720007ef0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.621+0000 7fd73a000640 1 -- 172.21.15.2:0/790821127 shutdown_connections 2024-08-17T02:26:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.621+0000 7fd73a000640 1 --2- 172.21.15.2:0/790821127 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd73415c2e0 0x7fd7340b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.621+0000 7fd73a000640 1 --2- 172.21.15.2:0/790821127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7340cd780 0x7fd734152800 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.621+0000 7fd73a000640 1 --2- 172.21.15.2:0/790821127 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd714065150 0x7fd714067600 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.621+0000 7fd73a000640 1 --2- 172.21.15.2:0/790821127 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7340cc7e0 0x7fd73415f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.621+0000 7fd73a000640 1 -- 172.21.15.2:0/790821127 >> 172.21.15.2:0/790821127 conn(0x7fd734087a80 msgr2=0x7fd7340cf580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.622+0000 7fd73a000640 1 -- 172.21.15.2:0/790821127 shutdown_connections 2024-08-17T02:26:39.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.622+0000 7fd73a000640 1 -- 172.21.15.2:0/790821127 wait complete. 2024-08-17T02:26:39.637 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:39.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.793+0000 7fb6bd600640 1 Processor -- start 2024-08-17T02:26:39.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.793+0000 7fb6bd600640 1 -- start start 2024-08-17T02:26:39.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.795+0000 7fb6bd600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb6b80b1850 0x7fb6b80b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.795+0000 7fb6bd600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb6b80d0650 0x7fb6b80ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.795+0000 7fb6bd600640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6b80ce9b0 con 0x7fb6b81585a0 2024-08-17T02:26:39.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.795+0000 7fb6bd600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6b80cec90 con 0x7fb6b80d0650 2024-08-17T02:26:39.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.795+0000 7fb6bd600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b80cef70 con 0x7fb6b80b1850 2024-08-17T02:26:39.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.795+0000 7fb6b7400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb6b80d0650 0x7fb6b80ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.795+0000 7fb6b7400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb6b80d0650 0x7fb6b80ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48342/0 (socket says 172.21.15.2:48342) 2024-08-17T02:26:39.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.795+0000 7fb6b7400640 1 -- 172.21.15.2:0/182795706 learned_addr learned my addr 172.21.15.2:0/182795706 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:39.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.795+0000 7fb6b7e00640 1 --2- 172.21.15.2:0/182795706 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb6b80b1850 0x7fb6b80b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.796+0000 7fb6b7400640 1 -- 172.21.15.2:0/182795706 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb6b80b1850 msgr2=0x7fb6b80b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:39.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.796+0000 7fb6b7400640 1 --2- 172.21.15.2:0/182795706 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb6b80b1850 0x7fb6b80b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.796+0000 7fb6b7400640 1 -- 172.21.15.2:0/182795706 >> v1:172.21.15.145:6789/0 conn(0x7fb6b81585a0 legacy=0x7fb6b8158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.796+0000 7fb6b7400640 1 -- 172.21.15.2:0/182795706 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b80cf250 con 0x7fb6b80d0650 2024-08-17T02:26:39.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.797+0000 7fb6b7400640 1 --2- 172.21.15.2:0/182795706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6b80d0650 0x7fb6b80ce060 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4009910 tx=0x7fb6a40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8e1ddc64603d0c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.797+0000 7fb6b6a00640 1 -- 172.21.15.2:0/182795706 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a402ae40 con 0x7fb6b80d0650 2024-08-17T02:26:39.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.797+0000 7fb6b6a00640 1 -- 172.21.15.2:0/182795706 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a4032440 con 0x7fb6b80d0650 2024-08-17T02:26:39.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.797+0000 7fb6b6a00640 1 -- 172.21.15.2:0/182795706 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a4032820 con 0x7fb6b80d0650 2024-08-17T02:26:39.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.797+0000 7fb6bd600640 1 -- 172.21.15.2:0/182795706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6b80d0650 msgr2=0x7fb6b80ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.797+0000 7fb6bd600640 1 --2- 172.21.15.2:0/182795706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6b80d0650 0x7fb6b80ce060 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4009910 tx=0x7fb6a40091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.798+0000 7fb6bd600640 1 -- 172.21.15.2:0/182795706 shutdown_connections 2024-08-17T02:26:39.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.798+0000 7fb6bd600640 1 --2- 172.21.15.2:0/182795706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6b80d0650 0x7fb6b80ce060 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.798+0000 7fb6bd600640 1 --2- 172.21.15.2:0/182795706 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb6b80b1850 0x7fb6b80b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.798+0000 7fb6bd600640 1 -- 172.21.15.2:0/182795706 >> 172.21.15.2:0/182795706 conn(0x7fb6b806e590 msgr2=0x7fb6b806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.798+0000 7fb6bd600640 1 -- 172.21.15.2:0/182795706 shutdown_connections 2024-08-17T02:26:39.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.798+0000 7fb6bd600640 1 -- 172.21.15.2:0/182795706 wait complete. 2024-08-17T02:26:39.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.799+0000 7fb6bd600640 1 Processor -- start 2024-08-17T02:26:39.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.799+0000 7fb6bd600640 1 -- start start 2024-08-17T02:26:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.800+0000 7fb6bd600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb6b80b1850 0x7fb6b8141660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.800+0000 7fb6bd600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6b80d0650 0x7fb6b80c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.800+0000 7fb6bd600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6b81585a0 0x7fb6b80c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.800+0000 7fb6bd600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b8152e90 con 0x7fb6b81585a0 2024-08-17T02:26:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.800+0000 7fb6bd600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b80c4b70 con 0x7fb6b80d0650 2024-08-17T02:26:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.800+0000 7fb6bd600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b8141ba0 con 0x7fb6b80b1850 2024-08-17T02:26:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.800+0000 7fb6bcc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6b81585a0 0x7fb6b80c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.800+0000 7fb6b7e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb6b80b1850 0x7fb6b8141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.800+0000 7fb6bcc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6b81585a0 0x7fb6b80c5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48356/0 (socket says 172.21.15.2:48356) 2024-08-17T02:26:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.800+0000 7fb6bcc00640 1 -- 172.21.15.2:0/1705889361 learned_addr learned my addr 172.21.15.2:0/1705889361 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.801+0000 7fb6b7400640 1 --2- 172.21.15.2:0/1705889361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6b80d0650 0x7fb6b80c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.801+0000 7fb6bcc00640 1 -- 172.21.15.2:0/1705889361 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb6b80b1850 msgr2=0x7fb6b8141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.801+0000 7fb6bcc00640 1 --2- 172.21.15.2:0/1705889361 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb6b80b1850 0x7fb6b8141660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.801+0000 7fb6bcc00640 1 -- 172.21.15.2:0/1705889361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6b80d0650 msgr2=0x7fb6b80c4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.801+0000 7fb6bcc00640 1 --2- 172.21.15.2:0/1705889361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6b80d0650 0x7fb6b80c4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.801+0000 7fb6bcc00640 1 -- 172.21.15.2:0/1705889361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a4009450 con 0x7fb6b81585a0 2024-08-17T02:26:39.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.801+0000 7fb6bcc00640 1 --2- 172.21.15.2:0/1705889361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6b81585a0 0x7fb6b80c5360 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000c7c0 tx=0x7fb6b00015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.801+0000 7fb6af400640 1 -- 172.21.15.2:0/1705889361 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b000a640 con 0x7fb6b81585a0 2024-08-17T02:26:39.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.801+0000 7fb6af400640 1 -- 172.21.15.2:0/1705889361 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b000a7c0 con 0x7fb6b81585a0 2024-08-17T02:26:39.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.801+0000 7fb6af400640 1 -- 172.21.15.2:0/1705889361 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b000ab80 con 0x7fb6b81585a0 2024-08-17T02:26:39.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.801+0000 7fb6bd600640 1 -- 172.21.15.2:0/1705889361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b80c7170 con 0x7fb6b81585a0 2024-08-17T02:26:39.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.802+0000 7fb6bd600640 1 -- 172.21.15.2:0/1705889361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b8152b20 con 0x7fb6b81585a0 2024-08-17T02:26:39.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.803+0000 7fb6bd600640 1 -- 172.21.15.2:0/1705889361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6b8153000 con 0x7fb6b81585a0 2024-08-17T02:26:39.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.803+0000 7fb6af400640 1 -- 172.21.15.2:0/1705889361 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb6b0003030 con 0x7fb6b81585a0 2024-08-17T02:26:39.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.804+0000 7fb6af400640 1 --2- 172.21.15.2:0/1705889361 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb698065150 0x7fb698067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.804+0000 7fb6af400640 1 -- 172.21.15.2:0/1705889361 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fb6b0082600 con 0x7fb6b81585a0 2024-08-17T02:26:39.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.805+0000 7fb6b7e00640 1 --2- 172.21.15.2:0/1705889361 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb698065150 0x7fb698067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.806+0000 7fb6b7e00640 1 --2- 172.21.15.2:0/1705889361 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb698065150 0x7fb698067600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8007ba0 tx=0x7fb6a8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.808+0000 7fb6af400640 1 -- 172.21.15.2:0/1705889361 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb6b00503d0 con 0x7fb6b81585a0 2024-08-17T02:26:39.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.989+0000 7fb6bd600640 1 -- 172.21.15.2:0/1705889361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb6b8070720 con 0x7fb6b81585a0 2024-08-17T02:26:39.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.989+0000 7fb6af400640 1 -- 172.21.15.2:0/1705889361 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb6b00539f0 con 0x7fb6b81585a0 2024-08-17T02:26:39.989 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:26:39.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.991+0000 7fb6bd600640 1 -- 172.21.15.2:0/1705889361 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb698065150 msgr2=0x7fb698067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.991+0000 7fb6bd600640 1 --2- 172.21.15.2:0/1705889361 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb698065150 0x7fb698067600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8007ba0 tx=0x7fb6a8008040 comp rx=0 tx=0).stop 2024-08-17T02:26:39.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.991+0000 7fb6bd600640 1 -- 172.21.15.2:0/1705889361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6b81585a0 msgr2=0x7fb6b80c5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.991+0000 7fb6bd600640 1 --2- 172.21.15.2:0/1705889361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6b81585a0 0x7fb6b80c5360 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000c7c0 tx=0x7fb6b00015f0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.991+0000 7fb6bd600640 1 -- 172.21.15.2:0/1705889361 shutdown_connections 2024-08-17T02:26:39.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.991+0000 7fb6bd600640 1 --2- 172.21.15.2:0/1705889361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6b81585a0 0x7fb6b80c5360 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.991+0000 7fb6bd600640 1 --2- 172.21.15.2:0/1705889361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6b80d0650 0x7fb6b80c4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.991+0000 7fb6bd600640 1 --2- 172.21.15.2:0/1705889361 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb698065150 0x7fb698067600 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.991+0000 7fb6bd600640 1 --2- 172.21.15.2:0/1705889361 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb6b80b1850 0x7fb6b8141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.991+0000 7fb6bd600640 1 -- 172.21.15.2:0/1705889361 >> 172.21.15.2:0/1705889361 conn(0x7fb6b806e590 msgr2=0x7fb6b80b0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.992+0000 7fb6bd600640 1 -- 172.21.15.2:0/1705889361 shutdown_connections 2024-08-17T02:26:39.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:39.992+0000 7fb6bd600640 1 -- 172.21.15.2:0/1705889361 wait complete. 2024-08-17T02:26:40.007 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:40.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.162+0000 7f1c09a00640 1 Processor -- start 2024-08-17T02:26:40.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.162+0000 7f1c09a00640 1 -- start start 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.163+0000 7f1c09a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1c040ad960 0x7f1c0415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.163+0000 7f1c09a00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1c040ca050 0x7f1c04156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.163+0000 7f1c09a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1c040add30 0x7f1c04156960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.163+0000 7f1c09a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c0415b5e0 con 0x7f1c040ad960 2024-08-17T02:26:40.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.163+0000 7f1c09a00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c040cb160 con 0x7f1c040ca050 2024-08-17T02:26:40.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.163+0000 7f1c09a00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c040b0d10 con 0x7f1c040add30 2024-08-17T02:26:40.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.163+0000 7f1c02a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1c040ad960 0x7f1c0415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.163+0000 7f1c02a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1c040ad960 0x7f1c0415b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48368/0 (socket says 172.21.15.2:48368) 2024-08-17T02:26:40.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.163+0000 7f1c02a00640 1 -- 172.21.15.2:0/267758127 learned_addr learned my addr 172.21.15.2:0/267758127 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:40.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.164+0000 7f1c03400640 1 --2- 172.21.15.2:0/267758127 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1c040add30 0x7f1c04156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.164+0000 7f1c02000640 1 --2- 172.21.15.2:0/267758127 >> v2:172.21.15.145:3300/0 conn(0x7f1c040ca050 0x7f1c04156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.164+0000 7f1c02a00640 1 -- 172.21.15.2:0/267758127 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1c040add30 msgr2=0x7f1c04156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:40.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.164+0000 7f1c02a00640 1 --2- 172.21.15.2:0/267758127 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1c040add30 0x7f1c04156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.164+0000 7f1c02a00640 1 -- 172.21.15.2:0/267758127 >> v2:172.21.15.145:3300/0 conn(0x7f1c040ca050 msgr2=0x7f1c04156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:40.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.164+0000 7f1c02a00640 1 --2- 172.21.15.2:0/267758127 >> v2:172.21.15.145:3300/0 conn(0x7f1c040ca050 0x7f1c04156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.164+0000 7f1c02a00640 1 -- 172.21.15.2:0/267758127 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c040ca550 con 0x7f1c040ad960 2024-08-17T02:26:40.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.165+0000 7f1c02a00640 1 --2- 172.21.15.2:0/267758127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c040ad960 0x7f1c0415b0a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1c04063600 tx=0x7f1bf40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e8f10772ad2de1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.165+0000 7f1c01600640 1 -- 172.21.15.2:0/267758127 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf402ae60 con 0x7f1c040ad960 2024-08-17T02:26:40.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.165+0000 7f1c01600640 1 -- 172.21.15.2:0/267758127 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf4032440 con 0x7f1c040ad960 2024-08-17T02:26:40.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.165+0000 7f1c01600640 1 -- 172.21.15.2:0/267758127 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf40327e0 con 0x7f1c040ad960 2024-08-17T02:26:40.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.166+0000 7f1c09a00640 1 -- 172.21.15.2:0/267758127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c040ad960 msgr2=0x7f1c0415b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.166+0000 7f1c09a00640 1 --2- 172.21.15.2:0/267758127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c040ad960 0x7f1c0415b0a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1c04063600 tx=0x7f1bf40091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.166+0000 7f1c09a00640 1 -- 172.21.15.2:0/267758127 shutdown_connections 2024-08-17T02:26:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.166+0000 7f1c09a00640 1 --2- 172.21.15.2:0/267758127 >> v2:172.21.15.145:3300/0 conn(0x7f1c040ca050 0x7f1c04156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.166+0000 7f1c09a00640 1 --2- 172.21.15.2:0/267758127 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1c040add30 0x7f1c04156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.166+0000 7f1c09a00640 1 --2- 172.21.15.2:0/267758127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c040ad960 0x7f1c0415b0a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.166+0000 7f1c09a00640 1 -- 172.21.15.2:0/267758127 >> 172.21.15.2:0/267758127 conn(0x7f1c04066e60 msgr2=0x7f1c04067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.166+0000 7f1c09a00640 1 -- 172.21.15.2:0/267758127 shutdown_connections 2024-08-17T02:26:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.166+0000 7f1c09a00640 1 -- 172.21.15.2:0/267758127 wait complete. 2024-08-17T02:26:40.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.167+0000 7f1c09a00640 1 Processor -- start 2024-08-17T02:26:40.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.167+0000 7f1c09a00640 1 -- start start 2024-08-17T02:26:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.168+0000 7f1c09a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1c040ad960 0x7f1c0415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.168+0000 7f1c09a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c040add30 0x7f1c0415e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.168+0000 7f1c09a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1c040ca050 0x7f1c040a5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.168+0000 7f1c09a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0415dba0 con 0x7f1c040add30 2024-08-17T02:26:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.168+0000 7f1c09a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c040a5bd0 con 0x7f1c040ca050 2024-08-17T02:26:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.168+0000 7f1c09a00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0415cf90 con 0x7f1c040ad960 2024-08-17T02:26:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.168+0000 7f1c02000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c040add30 0x7f1c0415e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.169+0000 7f1c02000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c040add30 0x7f1c0415e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48380/0 (socket says 172.21.15.2:48380) 2024-08-17T02:26:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.169+0000 7f1c02000640 1 -- 172.21.15.2:0/2290437993 learned_addr learned my addr 172.21.15.2:0/2290437993 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.169+0000 7f1c02a00640 1 --2- 172.21.15.2:0/2290437993 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1c040ad960 0x7f1c0415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.169+0000 7f1c03400640 1 --2- 172.21.15.2:0/2290437993 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1c040ca050 0x7f1c040a5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.169+0000 7f1c02000640 1 -- 172.21.15.2:0/2290437993 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1c040ad960 msgr2=0x7f1c0415c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.169+0000 7f1c02000640 1 --2- 172.21.15.2:0/2290437993 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1c040ad960 0x7f1c0415c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.169+0000 7f1c02000640 1 -- 172.21.15.2:0/2290437993 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1c040ca050 msgr2=0x7f1c040a5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.169+0000 7f1c02000640 1 --2- 172.21.15.2:0/2290437993 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1c040ca050 0x7f1c040a5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.169+0000 7f1c02000640 1 -- 172.21.15.2:0/2290437993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf4009450 con 0x7f1c040add30 2024-08-17T02:26:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.169+0000 7f1c02000640 1 --2- 172.21.15.2:0/2290437993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c040add30 0x7f1c0415e030 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000d8c0 tx=0x7f1bf0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.169+0000 7f1bfa000640 1 -- 172.21.15.2:0/2290437993 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf000de50 con 0x7f1c040add30 2024-08-17T02:26:40.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.170+0000 7f1bfa000640 1 -- 172.21.15.2:0/2290437993 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf000b8d0 con 0x7f1c040add30 2024-08-17T02:26:40.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.170+0000 7f1bfa000640 1 -- 172.21.15.2:0/2290437993 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf000bc70 con 0x7f1c040add30 2024-08-17T02:26:40.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.170+0000 7f1c09a00640 1 -- 172.21.15.2:0/2290437993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c0415d270 con 0x7f1c040add30 2024-08-17T02:26:40.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.170+0000 7f1c09a00640 1 -- 172.21.15.2:0/2290437993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0415d830 con 0x7f1c040add30 2024-08-17T02:26:40.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.171+0000 7f1c09a00640 1 -- 172.21.15.2:0/2290437993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c0415dd50 con 0x7f1c040add30 2024-08-17T02:26:40.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.171+0000 7f1bfa000640 1 -- 172.21.15.2:0/2290437993 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1bf0014640 con 0x7f1c040add30 2024-08-17T02:26:40.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.172+0000 7f1bfa000640 1 --2- 172.21.15.2:0/2290437993 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1be4065150 0x7f1be4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.172+0000 7f1bfa000640 1 -- 172.21.15.2:0/2290437993 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f1bf0082d40 con 0x7f1c040add30 2024-08-17T02:26:40.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.173+0000 7f1c02a00640 1 --2- 172.21.15.2:0/2290437993 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1be4065150 0x7f1be4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.174+0000 7f1c02a00640 1 --2- 172.21.15.2:0/2290437993 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1be4065150 0x7f1be4067600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4034000 tx=0x7f1bf4032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.176+0000 7f1bfa000640 1 -- 172.21.15.2:0/2290437993 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1c0415dd50 con 0x7f1c040add30 2024-08-17T02:26:40.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.361+0000 7f1c09a00640 1 -- 172.21.15.2:0/2290437993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1c0415dd50 con 0x7f1c040add30 2024-08-17T02:26:40.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.361+0000 7f1bfa000640 1 -- 172.21.15.2:0/2290437993 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1c0415dd50 con 0x7f1c040add30 2024-08-17T02:26:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-08-17T02:26:40.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.363+0000 7f1c09a00640 1 -- 172.21.15.2:0/2290437993 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1be4065150 msgr2=0x7f1be4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.363+0000 7f1c09a00640 1 --2- 172.21.15.2:0/2290437993 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1be4065150 0x7f1be4067600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4034000 tx=0x7f1bf4032000 comp rx=0 tx=0).stop 2024-08-17T02:26:40.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.363+0000 7f1c09a00640 1 -- 172.21.15.2:0/2290437993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c040add30 msgr2=0x7f1c0415e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.363+0000 7f1c09a00640 1 --2- 172.21.15.2:0/2290437993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c040add30 0x7f1c0415e030 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000d8c0 tx=0x7f1bf0008040 comp rx=0 tx=0).stop 2024-08-17T02:26:40.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.364+0000 7f1c09a00640 1 -- 172.21.15.2:0/2290437993 shutdown_connections 2024-08-17T02:26:40.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.364+0000 7f1c09a00640 1 --2- 172.21.15.2:0/2290437993 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1c040ca050 0x7f1c040a5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.364+0000 7f1c09a00640 1 --2- 172.21.15.2:0/2290437993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c040add30 0x7f1c0415e030 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.364+0000 7f1c09a00640 1 --2- 172.21.15.2:0/2290437993 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1be4065150 0x7f1be4067600 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.364+0000 7f1c09a00640 1 --2- 172.21.15.2:0/2290437993 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1c040ad960 0x7f1c0415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.364+0000 7f1c09a00640 1 -- 172.21.15.2:0/2290437993 >> 172.21.15.2:0/2290437993 conn(0x7f1c04066e60 msgr2=0x7f1c041557d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.364+0000 7f1c09a00640 1 -- 172.21.15.2:0/2290437993 shutdown_connections 2024-08-17T02:26:40.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.364+0000 7f1c09a00640 1 -- 172.21.15.2:0/2290437993 wait complete. 2024-08-17T02:26:40.379 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000001044477.meta pg_num 2024-08-17T02:26:40.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.532+0000 7fe2bf200640 1 Processor -- start 2024-08-17T02:26:40.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.533+0000 7fe2bf200640 1 -- start start 2024-08-17T02:26:40.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.534+0000 7fe2bf200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe2c0158a40 0x7fe2c00abe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.534+0000 7fe2bf200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2c00af9b0 0x7fe2c0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.534+0000 7fe2bf200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c00686f0 con 0x7fe2c00ac380 2024-08-17T02:26:40.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.534+0000 7fe2bf200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c00ac800 con 0x7fe2c0158a40 2024-08-17T02:26:40.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.534+0000 7fe2bf200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c00b0270 con 0x7fe2c00af9b0 2024-08-17T02:26:40.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.534+0000 7fe2bde00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe2c0158a40 0x7fe2c00abe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.534+0000 7fe2b7e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe2c00ac380 0x7fe2c00af2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55470/0 (socket says 172.21.15.2:55470) 2024-08-17T02:26:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.534+0000 7fe2bde00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe2c0158a40 0x7fe2c00abe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48392/0 (socket says 172.21.15.2:48392) 2024-08-17T02:26:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.534+0000 7fe2b7e00640 1 -- 172.21.15.2:0/1922651141 learned_addr learned my addr 172.21.15.2:0/1922651141 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:26:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.535+0000 7fe2be800640 1 --2- 172.21.15.2:0/1922651141 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2c00af9b0 0x7fe2c0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.535+0000 7fe2bde00640 1 -- 172.21.15.2:0/1922651141 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2c00af9b0 msgr2=0x7fe2c0068b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.535+0000 7fe2bde00640 1 --2- 172.21.15.2:0/1922651141 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2c00af9b0 0x7fe2c0068b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.535+0000 7fe2bde00640 1 -- 172.21.15.2:0/1922651141 >> v1:172.21.15.2:6789/0 conn(0x7fe2c00ac380 legacy=0x7fe2c00af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.535+0000 7fe2bde00640 1 -- 172.21.15.2:0/1922651141 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c00aff90 con 0x7fe2c0158a40 2024-08-17T02:26:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.535+0000 7fe2be800640 1 --2- 172.21.15.2:0/1922651141 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2c00af9b0 0x7fe2c0068b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.535+0000 7fe2bd400640 1 -- 172.21.15.2:0/1922651141 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290763406 0 0) 0x7fe2c00686f0 con 0x7fe2c00ac380 2024-08-17T02:26:40.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.536+0000 7fe2bde00640 1 --2- 172.21.15.2:0/1922651141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2c0158a40 0x7fe2c00abe40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0009850 tx=0x7fe2b00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a19ddb627ef49a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.536+0000 7fe2bd400640 1 -- 172.21.15.2:0/1922651141 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b002ad00 con 0x7fe2c0158a40 2024-08-17T02:26:40.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.536+0000 7fe2bd400640 1 -- 172.21.15.2:0/1922651141 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b002ae60 con 0x7fe2c0158a40 2024-08-17T02:26:40.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.536+0000 7fe2bd400640 1 -- 172.21.15.2:0/1922651141 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0032670 con 0x7fe2c0158a40 2024-08-17T02:26:40.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.537+0000 7fe2bf200640 1 -- 172.21.15.2:0/1922651141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2c0158a40 msgr2=0x7fe2c00abe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.537+0000 7fe2bf200640 1 --2- 172.21.15.2:0/1922651141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2c0158a40 0x7fe2c00abe40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0009850 tx=0x7fe2b00090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.537+0000 7fe2bf200640 1 -- 172.21.15.2:0/1922651141 shutdown_connections 2024-08-17T02:26:40.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.537+0000 7fe2bf200640 1 --2- 172.21.15.2:0/1922651141 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2c00af9b0 0x7fe2c0068b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.537+0000 7fe2bf200640 1 --2- 172.21.15.2:0/1922651141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2c0158a40 0x7fe2c00abe40 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.537+0000 7fe2bf200640 1 -- 172.21.15.2:0/1922651141 >> 172.21.15.2:0/1922651141 conn(0x7fe2c00ce400 msgr2=0x7fe2c0095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.537+0000 7fe2bf200640 1 -- 172.21.15.2:0/1922651141 shutdown_connections 2024-08-17T02:26:40.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.537+0000 7fe2bf200640 1 -- 172.21.15.2:0/1922651141 wait complete. 2024-08-17T02:26:40.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.538+0000 7fe2bf200640 1 Processor -- start 2024-08-17T02:26:40.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.538+0000 7fe2bf200640 1 -- start start 2024-08-17T02:26:40.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.539+0000 7fe2bf200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2c00ac380 0x7fe2c014a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.539+0000 7fe2bf200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2c00af9b0 0x7fe2c015cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.539+0000 7fe2bf200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2c0158a40 0x7fe2c015d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.539+0000 7fe2bf200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c016c6e0 con 0x7fe2c0158a40 2024-08-17T02:26:40.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.539+0000 7fe2bf200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c016be20 con 0x7fe2c00af9b0 2024-08-17T02:26:40.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.539+0000 7fe2bf200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c016c090 con 0x7fe2c00ac380 2024-08-17T02:26:40.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.539+0000 7fe2be800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2c0158a40 0x7fe2c015d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.540+0000 7fe2be800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2c0158a40 0x7fe2c015d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48398/0 (socket says 172.21.15.2:48398) 2024-08-17T02:26:40.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.540+0000 7fe2be800640 1 -- 172.21.15.2:0/2760544596 learned_addr learned my addr 172.21.15.2:0/2760544596 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:40.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.540+0000 7fe2b7e00640 1 --2- 172.21.15.2:0/2760544596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2c00af9b0 0x7fe2c015cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.540+0000 7fe2bde00640 1 --2- 172.21.15.2:0/2760544596 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2c00ac380 0x7fe2c014a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.540+0000 7fe2be800640 1 -- 172.21.15.2:0/2760544596 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2c00ac380 msgr2=0x7fe2c014a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.540+0000 7fe2be800640 1 --2- 172.21.15.2:0/2760544596 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2c00ac380 0x7fe2c014a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.540+0000 7fe2be800640 1 -- 172.21.15.2:0/2760544596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2c00af9b0 msgr2=0x7fe2c015cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.540+0000 7fe2be800640 1 --2- 172.21.15.2:0/2760544596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2c00af9b0 0x7fe2c015cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.540+0000 7fe2be800640 1 -- 172.21.15.2:0/2760544596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b0009390 con 0x7fe2c0158a40 2024-08-17T02:26:40.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.540+0000 7fe2be800640 1 --2- 172.21.15.2:0/2760544596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2c0158a40 0x7fe2c015d1d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800a380 tx=0x7fe2b8007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.540+0000 7fe2b5600640 1 -- 172.21.15.2:0/2760544596 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b800d650 con 0x7fe2c0158a40 2024-08-17T02:26:40.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.541+0000 7fe2b5600640 1 -- 172.21.15.2:0/2760544596 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b800d7b0 con 0x7fe2c0158a40 2024-08-17T02:26:40.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.541+0000 7fe2b5600640 1 -- 172.21.15.2:0/2760544596 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b800db70 con 0x7fe2c0158a40 2024-08-17T02:26:40.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.541+0000 7fe2bf200640 1 -- 172.21.15.2:0/2760544596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c016c370 con 0x7fe2c0158a40 2024-08-17T02:26:40.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.541+0000 7fe2bf200640 1 -- 172.21.15.2:0/2760544596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c015d7c0 con 0x7fe2c0158a40 2024-08-17T02:26:40.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.542+0000 7fe2bf200640 1 -- 172.21.15.2:0/2760544596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c0070720 con 0x7fe2c0158a40 2024-08-17T02:26:40.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.543+0000 7fe2b5600640 1 -- 172.21.15.2:0/2760544596 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe2b801e3b0 con 0x7fe2c0158a40 2024-08-17T02:26:40.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.543+0000 7fe2b5600640 1 --2- 172.21.15.2:0/2760544596 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe29c065150 0x7fe29c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.544+0000 7fe2b5600640 1 -- 172.21.15.2:0/2760544596 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fe2b8083320 con 0x7fe2c0158a40 2024-08-17T02:26:40.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.544+0000 7fe2bde00640 1 --2- 172.21.15.2:0/2760544596 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe29c065150 0x7fe29c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.545+0000 7fe2bde00640 1 --2- 172.21.15.2:0/2760544596 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe29c065150 0x7fe29c067600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0034000 tx=0x7fe2b0032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.547+0000 7fe2b5600640 1 -- 172.21.15.2:0/2760544596 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe2b8050fc0 con 0x7fe2c0158a40 2024-08-17T02:26:40.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.727+0000 7fe2bf200640 1 -- 172.21.15.2:0/2760544596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000001044477.meta", "var": "pg_num"} v 0) v1 -- 0x7fe2c006ffc0 con 0x7fe2c0158a40 2024-08-17T02:26:40.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.728+0000 7fe2b5600640 1 -- 172.21.15.2:0/2760544596 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000001044477.meta", "var": "pg_num"}]=0 v36) v1 ==== 124+0+11 (secure 0 0 0) 0x7fe2b80545e0 con 0x7fe2c0158a40 2024-08-17T02:26:40.728 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:26:40.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.730+0000 7fe2bf200640 1 -- 172.21.15.2:0/2760544596 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe29c065150 msgr2=0x7fe29c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.730+0000 7fe2bf200640 1 --2- 172.21.15.2:0/2760544596 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe29c065150 0x7fe29c067600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0034000 tx=0x7fe2b0032000 comp rx=0 tx=0).stop 2024-08-17T02:26:40.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.730+0000 7fe2bf200640 1 -- 172.21.15.2:0/2760544596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2c0158a40 msgr2=0x7fe2c015d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.730+0000 7fe2bf200640 1 --2- 172.21.15.2:0/2760544596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2c0158a40 0x7fe2c015d1d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800a380 tx=0x7fe2b8007900 comp rx=0 tx=0).stop 2024-08-17T02:26:40.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.730+0000 7fe2bf200640 1 -- 172.21.15.2:0/2760544596 shutdown_connections 2024-08-17T02:26:40.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.730+0000 7fe2bf200640 1 --2- 172.21.15.2:0/2760544596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2c0158a40 0x7fe2c015d1d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.730+0000 7fe2bf200640 1 --2- 172.21.15.2:0/2760544596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2c00af9b0 0x7fe2c015cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.730+0000 7fe2bf200640 1 --2- 172.21.15.2:0/2760544596 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe29c065150 0x7fe29c067600 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.730+0000 7fe2bf200640 1 --2- 172.21.15.2:0/2760544596 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2c00ac380 0x7fe2c014a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.730+0000 7fe2bf200640 1 -- 172.21.15.2:0/2760544596 >> 172.21.15.2:0/2760544596 conn(0x7fe2c00ce400 msgr2=0x7fe2c0157310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.730+0000 7fe2bf200640 1 -- 172.21.15.2:0/2760544596 shutdown_connections 2024-08-17T02:26:40.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.730+0000 7fe2bf200640 1 -- 172.21.15.2:0/2760544596 wait complete. 2024-08-17T02:26:40.744 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000001044477.data pg_num 2024-08-17T02:26:40.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.899+0000 7fa8b7400640 1 Processor -- start 2024-08-17T02:26:40.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.899+0000 7fa8b7400640 1 -- start start 2024-08-17T02:26:40.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.900+0000 7fa8b7400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8b00afca0 0x7fa8b00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.900+0000 7fa8b7400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa8b00acf10 0x7fa8b0159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.900+0000 7fa8b7400640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b015a4e0 con 0x7fa8b01589a0 2024-08-17T02:26:40.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.900+0000 7fa8b7400640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b00b0980 con 0x7fa8b00acf10 2024-08-17T02:26:40.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.900+0000 7fa8b7400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00c92b0 con 0x7fa8b00afca0 2024-08-17T02:26:40.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.901+0000 7fa8b4a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8b00afca0 0x7fa8b00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.901+0000 7fa8b4a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8b00afca0 0x7fa8b00b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:57128/0 (socket says 172.21.15.2:57128) 2024-08-17T02:26:40.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.901+0000 7fa8b4a00640 1 -- 172.21.15.2:0/4065125599 learned_addr learned my addr 172.21.15.2:0/4065125599 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:40.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.901+0000 7fa8afe00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa8b00acf10 0x7fa8b0159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.901+0000 7fa8b4a00640 1 -- 172.21.15.2:0/4065125599 >> v2:172.21.15.145:3300/0 conn(0x7fa8b00acf10 msgr2=0x7fa8b0159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:40.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.901+0000 7fa8b4a00640 1 --2- 172.21.15.2:0/4065125599 >> v2:172.21.15.145:3300/0 conn(0x7fa8b00acf10 0x7fa8b0159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.901+0000 7fa8b4a00640 1 -- 172.21.15.2:0/4065125599 >> v1:172.21.15.145:6789/0 conn(0x7fa8b01589a0 legacy=0x7fa8b006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.901+0000 7fa8b4a00640 1 -- 172.21.15.2:0/4065125599 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b00ad480 con 0x7fa8b00afca0 2024-08-17T02:26:40.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.901+0000 7fa8af400640 1 -- 172.21.15.2:0/4065125599 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139406753 0 0) 0x7fa8a8001490 con 0x7fa8b01589a0 2024-08-17T02:26:40.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.901+0000 7fa8afe00640 1 --2- 172.21.15.2:0/4065125599 >> v2:172.21.15.145:3300/0 conn(0x7fa8b00acf10 0x7fa8b0159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:40.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.902+0000 7fa8b4a00640 1 --2- 172.21.15.2:0/4065125599 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8b00afca0 0x7fa8b00b0070 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa8a400bbf0 tx=0x7fa8a400b460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a1ecc744f8920cf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.903+0000 7fa8af400640 1 -- 172.21.15.2:0/4065125599 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4031610 con 0x7fa8b00afca0 2024-08-17T02:26:40.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.903+0000 7fa8af400640 1 -- 172.21.15.2:0/4065125599 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a4031770 con 0x7fa8b00afca0 2024-08-17T02:26:40.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.903+0000 7fa8af400640 1 -- 172.21.15.2:0/4065125599 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4031b10 con 0x7fa8b00afca0 2024-08-17T02:26:40.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.903+0000 7fa8b7400640 1 -- 172.21.15.2:0/4065125599 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8b00afca0 msgr2=0x7fa8b00b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.903+0000 7fa8b7400640 1 --2- 172.21.15.2:0/4065125599 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8b00afca0 0x7fa8b00b0070 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa8a400bbf0 tx=0x7fa8a400b460 comp rx=0 tx=0).stop 2024-08-17T02:26:40.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.903+0000 7fa8b7400640 1 -- 172.21.15.2:0/4065125599 shutdown_connections 2024-08-17T02:26:40.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.903+0000 7fa8b7400640 1 --2- 172.21.15.2:0/4065125599 >> v2:172.21.15.145:3300/0 conn(0x7fa8b00acf10 0x7fa8b0159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.903+0000 7fa8b7400640 1 --2- 172.21.15.2:0/4065125599 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8b00afca0 0x7fa8b00b0070 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.903+0000 7fa8b7400640 1 -- 172.21.15.2:0/4065125599 >> 172.21.15.2:0/4065125599 conn(0x7fa8b0066e60 msgr2=0x7fa8b0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.903+0000 7fa8b7400640 1 -- 172.21.15.2:0/4065125599 shutdown_connections 2024-08-17T02:26:40.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.903+0000 7fa8b7400640 1 -- 172.21.15.2:0/4065125599 wait complete. 2024-08-17T02:26:40.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.905+0000 7fa8b7400640 1 Processor -- start 2024-08-17T02:26:40.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.905+0000 7fa8b7400640 1 -- start start 2024-08-17T02:26:40.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.906+0000 7fa8b7400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8b00acf10 0x7fa8b0153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.906+0000 7fa8b7400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8b00afca0 0x7fa8b016c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.906+0000 7fa8b7400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8b01589a0 0x7fa8b0155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.906+0000 7fa8b7400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b016d130 con 0x7fa8b00afca0 2024-08-17T02:26:40.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.906+0000 7fa8b7400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b016d410 con 0x7fa8b01589a0 2024-08-17T02:26:40.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.906+0000 7fa8b7400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b0155170 con 0x7fa8b00acf10 2024-08-17T02:26:40.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.906+0000 7fa8afe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8b00afca0 0x7fa8b016c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.906+0000 7fa8afe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8b00afca0 0x7fa8b016c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48414/0 (socket says 172.21.15.2:48414) 2024-08-17T02:26:40.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.906+0000 7fa8afe00640 1 -- 172.21.15.2:0/4141225898 learned_addr learned my addr 172.21.15.2:0/4141225898 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:40.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.906+0000 7fa8b4a00640 1 --2- 172.21.15.2:0/4141225898 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8b00acf10 0x7fa8b0153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.906+0000 7fa8b5400640 1 --2- 172.21.15.2:0/4141225898 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8b01589a0 0x7fa8b0155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.907+0000 7fa8afe00640 1 -- 172.21.15.2:0/4141225898 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8b00acf10 msgr2=0x7fa8b0153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.907+0000 7fa8afe00640 1 --2- 172.21.15.2:0/4141225898 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8b00acf10 0x7fa8b0153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.907+0000 7fa8afe00640 1 -- 172.21.15.2:0/4141225898 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8b01589a0 msgr2=0x7fa8b0155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.907+0000 7fa8afe00640 1 --2- 172.21.15.2:0/4141225898 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8b01589a0 0x7fa8b0155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.907+0000 7fa8afe00640 1 -- 172.21.15.2:0/4141225898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c009390 con 0x7fa8b00afca0 2024-08-17T02:26:40.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.907+0000 7fa8b4a00640 1 --2- 172.21.15.2:0/4141225898 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8b00acf10 0x7fa8b0153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:40.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.907+0000 7fa8b5400640 1 --2- 172.21.15.2:0/4141225898 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8b01589a0 0x7fa8b0155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:40.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.907+0000 7fa8afe00640 1 --2- 172.21.15.2:0/4141225898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8b00afca0 0x7fa8b016c7e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00ec80 tx=0x7fa89c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.907+0000 7fa8a3e00640 1 -- 172.21.15.2:0/4141225898 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c00eec0 con 0x7fa8b00afca0 2024-08-17T02:26:40.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.907+0000 7fa8a3e00640 1 -- 172.21.15.2:0/4141225898 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89c00cbc0 con 0x7fa8b00afca0 2024-08-17T02:26:40.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.907+0000 7fa8b7400640 1 -- 172.21.15.2:0/4141225898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a400b700 con 0x7fa8b00afca0 2024-08-17T02:26:40.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.907+0000 7fa8a3e00640 1 -- 172.21.15.2:0/4141225898 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c013470 con 0x7fa8b00afca0 2024-08-17T02:26:40.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.907+0000 7fa8b7400640 1 -- 172.21.15.2:0/4141225898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b016cd20 con 0x7fa8b00afca0 2024-08-17T02:26:40.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.908+0000 7fa8b7400640 1 -- 172.21.15.2:0/4141225898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b0063fb0 con 0x7fa8b00afca0 2024-08-17T02:26:40.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.909+0000 7fa8a3e00640 1 -- 172.21.15.2:0/4141225898 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa89c0137e0 con 0x7fa8b00afca0 2024-08-17T02:26:40.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.910+0000 7fa8a3e00640 1 --2- 172.21.15.2:0/4141225898 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa890065150 0x7fa890067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.910+0000 7fa8a3e00640 1 -- 172.21.15.2:0/4141225898 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fa89c082bf0 con 0x7fa8b00afca0 2024-08-17T02:26:40.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.910+0000 7fa8b4a00640 1 --2- 172.21.15.2:0/4141225898 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa890065150 0x7fa890067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.911+0000 7fa8b4a00640 1 --2- 172.21.15.2:0/4141225898 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa890065150 0x7fa890067600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4037000 tx=0x7fa8a403a000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:40.914+0000 7fa8a3e00640 1 -- 172.21.15.2:0/4141225898 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa89c050890 con 0x7fa8b00afca0 2024-08-17T02:26:41.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.093+0000 7fa8b7400640 1 -- 172.21.15.2:0/4141225898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000001044477.data", "var": "pg_num"} v 0) v1 -- 0x7fa8b0155330 con 0x7fa8b00afca0 2024-08-17T02:26:41.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.094+0000 7fa8a3e00640 1 -- 172.21.15.2:0/4141225898 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000001044477.data", "var": "pg_num"}]=0 v36) v1 ==== 124+0+11 (secure 0 0 0) 0x7fa89c053eb0 con 0x7fa8b00afca0 2024-08-17T02:26:41.094 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:26:41.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.096+0000 7fa8b7400640 1 -- 172.21.15.2:0/4141225898 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa890065150 msgr2=0x7fa890067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.096+0000 7fa8b7400640 1 --2- 172.21.15.2:0/4141225898 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa890065150 0x7fa890067600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4037000 tx=0x7fa8a403a000 comp rx=0 tx=0).stop 2024-08-17T02:26:41.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.096+0000 7fa8b7400640 1 -- 172.21.15.2:0/4141225898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8b00afca0 msgr2=0x7fa8b016c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.096+0000 7fa8b7400640 1 --2- 172.21.15.2:0/4141225898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8b00afca0 0x7fa8b016c7e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00ec80 tx=0x7fa89c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.096+0000 7fa8b7400640 1 -- 172.21.15.2:0/4141225898 shutdown_connections 2024-08-17T02:26:41.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.096+0000 7fa8b7400640 1 --2- 172.21.15.2:0/4141225898 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8b01589a0 0x7fa8b0155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.096+0000 7fa8b7400640 1 --2- 172.21.15.2:0/4141225898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8b00afca0 0x7fa8b016c7e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.096+0000 7fa8b7400640 1 --2- 172.21.15.2:0/4141225898 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa890065150 0x7fa890067600 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.096+0000 7fa8b7400640 1 --2- 172.21.15.2:0/4141225898 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8b00acf10 0x7fa8b0153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.096+0000 7fa8b7400640 1 -- 172.21.15.2:0/4141225898 >> 172.21.15.2:0/4141225898 conn(0x7fa8b0066e60 msgr2=0x7fa8b00ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.096+0000 7fa8b7400640 1 -- 172.21.15.2:0/4141225898 shutdown_connections 2024-08-17T02:26:41.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.096+0000 7fa8b7400640 1 -- 172.21.15.2:0/4141225898 wait complete. 2024-08-17T02:26:41.111 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:41.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.262+0000 7f674d000640 1 Processor -- start 2024-08-17T02:26:41.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.263+0000 7f674d000640 1 -- start start 2024-08-17T02:26:41.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.264+0000 7f674d000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6748158c30 0x7f674815d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.264+0000 7f674d000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67480abe60 con 0x7f674806c6a0 2024-08-17T02:26:41.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.264+0000 7f674d000640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67480ac0c0 con 0x7f67480aef90 2024-08-17T02:26:41.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.264+0000 7f674d000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67480ac3a0 con 0x7f6748158c30 2024-08-17T02:26:41.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.264+0000 7f6747e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f674806c6a0 0x7f674806a890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55476/0 (socket says 172.21.15.2:55476) 2024-08-17T02:26:41.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.264+0000 7f6747e00640 1 -- 172.21.15.2:0/2090459709 learned_addr learned my addr 172.21.15.2:0/2090459709 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:26:41.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.264+0000 7f6747400640 1 --2- 172.21.15.2:0/2090459709 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6748158c30 0x7f674815d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.265+0000 7f6746000640 1 -- 172.21.15.2:0/2090459709 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1891482410 0 0) 0x7f67480abe60 con 0x7f674806c6a0 2024-08-17T02:26:41.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.265+0000 7f6746000640 1 -- 172.21.15.2:0/2090459709 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f672c0034e0 con 0x7f674806c6a0 2024-08-17T02:26:41.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.265+0000 7f6746000640 1 -- 172.21.15.2:0/2090459709 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555262687 0 0) 0x7f67480ac0c0 con 0x7f67480aef90 2024-08-17T02:26:41.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.265+0000 7f6747400640 1 -- 172.21.15.2:0/2090459709 >> v1:172.21.15.145:6789/0 conn(0x7f67480aef90 legacy=0x7f67480ab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.265+0000 7f6747400640 1 -- 172.21.15.2:0/2090459709 >> v1:172.21.15.2:6789/0 conn(0x7f674806c6a0 legacy=0x7f674806a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.265+0000 7f6747400640 1 -- 172.21.15.2:0/2090459709 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674815c7f0 con 0x7f6748158c30 2024-08-17T02:26:41.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.266+0000 7f6747400640 1 --2- 172.21.15.2:0/2090459709 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6748158c30 0x7f674815d2d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6738009880 tx=0x7f67380090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbd2d341ed0f490d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.266+0000 7f6746000640 1 -- 172.21.15.2:0/2090459709 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673802ad80 con 0x7f6748158c30 2024-08-17T02:26:41.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.266+0000 7f6746000640 1 -- 172.21.15.2:0/2090459709 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6738032440 con 0x7f6748158c30 2024-08-17T02:26:41.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.266+0000 7f6746000640 1 -- 172.21.15.2:0/2090459709 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67380327e0 con 0x7f6748158c30 2024-08-17T02:26:41.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.267+0000 7f674d000640 1 -- 172.21.15.2:0/2090459709 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6748158c30 msgr2=0x7f674815d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.267+0000 7f674d000640 1 --2- 172.21.15.2:0/2090459709 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6748158c30 0x7f674815d2d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6738009880 tx=0x7f67380090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.267+0000 7f674d000640 1 -- 172.21.15.2:0/2090459709 shutdown_connections 2024-08-17T02:26:41.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.267+0000 7f674d000640 1 --2- 172.21.15.2:0/2090459709 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6748158c30 0x7f674815d2d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.267+0000 7f674d000640 1 -- 172.21.15.2:0/2090459709 >> 172.21.15.2:0/2090459709 conn(0x7f674806e8d0 msgr2=0x7f674806ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.267+0000 7f674d000640 1 -- 172.21.15.2:0/2090459709 shutdown_connections 2024-08-17T02:26:41.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.267+0000 7f674d000640 1 -- 172.21.15.2:0/2090459709 wait complete. 2024-08-17T02:26:41.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.268+0000 7f674d000640 1 Processor -- start 2024-08-17T02:26:41.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.269+0000 7f674d000640 1 -- start start 2024-08-17T02:26:41.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.269+0000 7f674d000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f674806c6a0 0x7f67480c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.269+0000 7f674d000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f67480aef90 0x7f67481517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.269+0000 7f674d000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6748158c30 0x7f6748151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.269+0000 7f674d000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6748152250 con 0x7f674806c6a0 2024-08-17T02:26:41.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.269+0000 7f674d000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6748152720 con 0x7f67480aef90 2024-08-17T02:26:41.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.269+0000 7f674d000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67480c9170 con 0x7f6748158c30 2024-08-17T02:26:41.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.270+0000 7f6747400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f674806c6a0 0x7f67480c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.270+0000 7f6747400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f674806c6a0 0x7f67480c7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48422/0 (socket says 172.21.15.2:48422) 2024-08-17T02:26:41.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.270+0000 7f6747400640 1 -- 172.21.15.2:0/3003528998 learned_addr learned my addr 172.21.15.2:0/3003528998 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:41.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.270+0000 7f6747400640 1 -- 172.21.15.2:0/3003528998 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6748158c30 msgr2=0x7f6748151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.270+0000 7f6747400640 1 --2- 172.21.15.2:0/3003528998 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6748158c30 0x7f6748151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.270+0000 7f6747400640 1 -- 172.21.15.2:0/3003528998 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f67480aef90 msgr2=0x7f67481517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.270+0000 7f6747400640 1 --2- 172.21.15.2:0/3003528998 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f67480aef90 0x7f67481517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.270+0000 7f6747400640 1 -- 172.21.15.2:0/3003528998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6738009390 con 0x7f674806c6a0 2024-08-17T02:26:41.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.270+0000 7f6747400640 1 --2- 172.21.15.2:0/3003528998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f674806c6a0 0x7f67480c7750 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6738009880 tx=0x7f6738032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.271+0000 7f673ea00640 1 -- 172.21.15.2:0/3003528998 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6738000d10 con 0x7f674806c6a0 2024-08-17T02:26:41.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.271+0000 7f673ea00640 1 -- 172.21.15.2:0/3003528998 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6738031a60 con 0x7f674806c6a0 2024-08-17T02:26:41.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.271+0000 7f674d000640 1 -- 172.21.15.2:0/3003528998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67480c9450 con 0x7f674806c6a0 2024-08-17T02:26:41.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.271+0000 7f673ea00640 1 -- 172.21.15.2:0/3003528998 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6738031e40 con 0x7f674806c6a0 2024-08-17T02:26:41.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.271+0000 7f674d000640 1 -- 172.21.15.2:0/3003528998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67480c9a10 con 0x7f674806c6a0 2024-08-17T02:26:41.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.272+0000 7f674d000640 1 -- 172.21.15.2:0/3003528998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6748070720 con 0x7f674806c6a0 2024-08-17T02:26:41.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.273+0000 7f673ea00640 1 -- 172.21.15.2:0/3003528998 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6738039040 con 0x7f674806c6a0 2024-08-17T02:26:41.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.273+0000 7f673ea00640 1 --2- 172.21.15.2:0/3003528998 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6728065150 0x7f6728067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.274+0000 7f673ea00640 1 -- 172.21.15.2:0/3003528998 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f67380a2720 con 0x7f674806c6a0 2024-08-17T02:26:41.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.274+0000 7f6746a00640 1 --2- 172.21.15.2:0/3003528998 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6728065150 0x7f6728067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.275+0000 7f6746a00640 1 --2- 172.21.15.2:0/3003528998 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6728065150 0x7f6728067600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f67480c8b50 tx=0x7f6734007ab0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.277+0000 7f673ea00640 1 -- 172.21.15.2:0/3003528998 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f67380703c0 con 0x7f674806c6a0 2024-08-17T02:26:41.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.499+0000 7f674d000640 1 -- 172.21.15.2:0/3003528998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67480ccda0 con 0x7f674806c6a0 2024-08-17T02:26:41.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.500+0000 7f673ea00640 1 -- 172.21.15.2:0/3003528998 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5684 (secure 0 0 0) 0x7f67380739e0 con 0x7f674806c6a0 2024-08-17T02:26:41.500 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:26:41.500 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1347318932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1347318932},{"type":"v1","addr":"172.21.15.2:6834","nonce":1347318932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6836/4156967978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":4156967978},{"type":"v1","addr":"172.21.15.145:6836","nonce":4156967978}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:23.151218+0000","modified":"2024-08-17T02:24:26.741121+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4950},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4950":{"gid":4950,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/3013258535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3013258535},{"type":"v1","addr":"172.21.15.2:6835","nonce":3013258535}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:35.805568+0000","modified":"2024-08-17T02:24:37.800310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4903":{"gid":4903,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.145:6837/1729489536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":1729489536},{"type":"v1","addr":"172.21.15.145:6837","nonce":1729489536}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001044477","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:26:41.500 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 21 2024-08-17T02:26:41.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.502+0000 7f674d000640 1 -- 172.21.15.2:0/3003528998 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6728065150 msgr2=0x7f6728067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.502+0000 7f674d000640 1 --2- 172.21.15.2:0/3003528998 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6728065150 0x7f6728067600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f67480c8b50 tx=0x7f6734007ab0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.502+0000 7f674d000640 1 -- 172.21.15.2:0/3003528998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f674806c6a0 msgr2=0x7f67480c7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.502+0000 7f674d000640 1 --2- 172.21.15.2:0/3003528998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f674806c6a0 0x7f67480c7750 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6738009880 tx=0x7f6738032000 comp rx=0 tx=0).stop 2024-08-17T02:26:41.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.502+0000 7f674d000640 1 -- 172.21.15.2:0/3003528998 shutdown_connections 2024-08-17T02:26:41.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.502+0000 7f674d000640 1 --2- 172.21.15.2:0/3003528998 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6728065150 0x7f6728067600 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.502+0000 7f674d000640 1 --2- 172.21.15.2:0/3003528998 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6748158c30 0x7f6748151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.502+0000 7f674d000640 1 --2- 172.21.15.2:0/3003528998 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f67480aef90 0x7f67481517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.502+0000 7f674d000640 1 --2- 172.21.15.2:0/3003528998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f674806c6a0 0x7f67480c7750 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.502+0000 7f674d000640 1 -- 172.21.15.2:0/3003528998 >> 172.21.15.2:0/3003528998 conn(0x7f674806e8d0 msgr2=0x7f67481567f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.502+0000 7f674d000640 1 -- 172.21.15.2:0/3003528998 shutdown_connections 2024-08-17T02:26:41.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.502+0000 7f674d000640 1 -- 172.21.15.2:0/3003528998 wait complete. 2024-08-17T02:26:41.517 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:41.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.669+0000 7f3375200640 1 Processor -- start 2024-08-17T02:26:41.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.669+0000 7f3375200640 1 -- start start 2024-08-17T02:26:41.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.670+0000 7f3375200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f337006e060 0x7f337006e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.670+0000 7f3375200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33700af340 0x7f33700af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.670+0000 7f3375200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33700aeeb0 con 0x7f3370155040 2024-08-17T02:26:41.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.670+0000 7f3375200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f337006e9f0 con 0x7f337006e060 2024-08-17T02:26:41.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.670+0000 7f3375200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33700aadd0 con 0x7f33700af340 2024-08-17T02:26:41.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.670+0000 7f336d400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f337006e060 0x7f337006e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.670+0000 7f336d400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f337006e060 0x7f337006e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48436/0 (socket says 172.21.15.2:48436) 2024-08-17T02:26:41.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.670+0000 7f336d400640 1 -- 172.21.15.2:0/2467980730 learned_addr learned my addr 172.21.15.2:0/2467980730 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:41.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.670+0000 7f336de00640 1 --1- 172.21.15.2:0/2467980730 >> v1:172.21.15.2:6789/0 conn(0x7f3370155040 0x7f3370158c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55486/0 (socket says 172.21.15.2:55486) 2024-08-17T02:26:41.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.671+0000 7f336e800640 1 --2- 172.21.15.2:0/2467980730 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33700af340 0x7f33700af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.671+0000 7f336d400640 1 -- 172.21.15.2:0/2467980730 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33700af340 msgr2=0x7f33700af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:41.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.671+0000 7f336d400640 1 --2- 172.21.15.2:0/2467980730 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33700af340 0x7f33700af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.671+0000 7f336d400640 1 -- 172.21.15.2:0/2467980730 >> v1:172.21.15.2:6789/0 conn(0x7f3370155040 legacy=0x7f3370158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.671+0000 7f336d400640 1 -- 172.21.15.2:0/2467980730 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33701597f0 con 0x7f337006e060 2024-08-17T02:26:41.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.672+0000 7f336d400640 1 --2- 172.21.15.2:0/2467980730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f337006e060 0x7f337006e4b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f335c009910 tx=0x7f335c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ccde8e831b6b918 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.672+0000 7f336ca00640 1 -- 172.21.15.2:0/2467980730 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c02add0 con 0x7f337006e060 2024-08-17T02:26:41.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.672+0000 7f336ca00640 1 -- 172.21.15.2:0/2467980730 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335c032440 con 0x7f337006e060 2024-08-17T02:26:41.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.672+0000 7f336ca00640 1 -- 172.21.15.2:0/2467980730 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c032820 con 0x7f337006e060 2024-08-17T02:26:41.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.673+0000 7f3375200640 1 -- 172.21.15.2:0/2467980730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f337006e060 msgr2=0x7f337006e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.673+0000 7f3375200640 1 --2- 172.21.15.2:0/2467980730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f337006e060 0x7f337006e4b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f335c009910 tx=0x7f335c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.673+0000 7f3375200640 1 -- 172.21.15.2:0/2467980730 shutdown_connections 2024-08-17T02:26:41.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.673+0000 7f3375200640 1 --2- 172.21.15.2:0/2467980730 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33700af340 0x7f33700af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.673+0000 7f3375200640 1 --2- 172.21.15.2:0/2467980730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f337006e060 0x7f337006e4b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.673+0000 7f3375200640 1 -- 172.21.15.2:0/2467980730 >> 172.21.15.2:0/2467980730 conn(0x7f3370066e60 msgr2=0x7f3370067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.673+0000 7f3375200640 1 -- 172.21.15.2:0/2467980730 shutdown_connections 2024-08-17T02:26:41.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.673+0000 7f3375200640 1 -- 172.21.15.2:0/2467980730 wait complete. 2024-08-17T02:26:41.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.674+0000 7f3375200640 1 Processor -- start 2024-08-17T02:26:41.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.674+0000 7f3375200640 1 -- start start 2024-08-17T02:26:41.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.675+0000 7f3375200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f337006e060 0x7f3370150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.675+0000 7f3375200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33700af340 0x7f3370155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.675+0000 7f3375200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3370155040 0x7f337014e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.675+0000 7f3375200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3370157830 con 0x7f3370155040 2024-08-17T02:26:41.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.675+0000 7f3375200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3370151460 con 0x7f33700af340 2024-08-17T02:26:41.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.675+0000 7f3375200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337014db90 con 0x7f337006e060 2024-08-17T02:26:41.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.675+0000 7f336e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3370155040 0x7f337014e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.675+0000 7f336e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3370155040 0x7f337014e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48442/0 (socket says 172.21.15.2:48442) 2024-08-17T02:26:41.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.675+0000 7f336e800640 1 -- 172.21.15.2:0/850333388 learned_addr learned my addr 172.21.15.2:0/850333388 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:41.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.676+0000 7f336de00640 1 --2- 172.21.15.2:0/850333388 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f337006e060 0x7f3370150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.676+0000 7f336d400640 1 --2- 172.21.15.2:0/850333388 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33700af340 0x7f3370155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.676+0000 7f336e800640 1 -- 172.21.15.2:0/850333388 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f337006e060 msgr2=0x7f3370150e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.676+0000 7f336e800640 1 --2- 172.21.15.2:0/850333388 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f337006e060 0x7f3370150e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.676+0000 7f336e800640 1 -- 172.21.15.2:0/850333388 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33700af340 msgr2=0x7f3370155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.676+0000 7f336e800640 1 --2- 172.21.15.2:0/850333388 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33700af340 0x7f3370155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.676+0000 7f336e800640 1 -- 172.21.15.2:0/850333388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c009450 con 0x7f3370155040 2024-08-17T02:26:41.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.676+0000 7f336e800640 1 --2- 172.21.15.2:0/850333388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3370155040 0x7f337014e4a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3368009fa0 tx=0x7f3368009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.676+0000 7f3365600640 1 -- 172.21.15.2:0/850333388 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336800ee60 con 0x7f3370155040 2024-08-17T02:26:41.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.676+0000 7f3365600640 1 -- 172.21.15.2:0/850333388 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3368014420 con 0x7f3370155040 2024-08-17T02:26:41.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.676+0000 7f3365600640 1 -- 172.21.15.2:0/850333388 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33680147e0 con 0x7f3370155040 2024-08-17T02:26:41.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.677+0000 7f3375200640 1 -- 172.21.15.2:0/850333388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3370158350 con 0x7f3370155040 2024-08-17T02:26:41.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.677+0000 7f3375200640 1 -- 172.21.15.2:0/850333388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3370157d00 con 0x7f3370155040 2024-08-17T02:26:41.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.678+0000 7f3375200640 1 -- 172.21.15.2:0/850333388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33701584e0 con 0x7f3370155040 2024-08-17T02:26:41.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.678+0000 7f3365600640 1 -- 172.21.15.2:0/850333388 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3368014b50 con 0x7f3370155040 2024-08-17T02:26:41.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.680+0000 7f3365600640 1 --2- 172.21.15.2:0/850333388 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3350065150 0x7f3350067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.680+0000 7f3365600640 1 -- 172.21.15.2:0/850333388 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f3368082f30 con 0x7f3370155040 2024-08-17T02:26:41.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.680+0000 7f336de00640 1 --2- 172.21.15.2:0/850333388 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3350065150 0x7f3350067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.681+0000 7f336de00640 1 --2- 172.21.15.2:0/850333388 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3350065150 0x7f3350067600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f337016c500 tx=0x7f3360007e20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.684+0000 7f3365600640 1 -- 172.21.15.2:0/850333388 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3368050c80 con 0x7f3370155040 2024-08-17T02:26:41.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.866+0000 7f3375200640 1 -- 172.21.15.2:0/850333388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3370063fb0 con 0x7f3370155040 2024-08-17T02:26:41.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.867+0000 7f3365600640 1 -- 172.21.15.2:0/850333388 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18551 (secure 0 0 0) 0x7f33680542a0 con 0x7f3370155040 2024-08-17T02:26:41.867 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:26:41.867 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":36,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:24:37.793272+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:21.215146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:22.134466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000001044477.meta","create_time":"2024-08-17T02:24:33.976587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001044477"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001044477.data","create_time":"2024-08-17T02:24:34.827029+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001044477"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:41.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.869+0000 7f3375200640 1 -- 172.21.15.2:0/850333388 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3350065150 msgr2=0x7f3350067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.869+0000 7f3375200640 1 --2- 172.21.15.2:0/850333388 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3350065150 0x7f3350067600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f337016c500 tx=0x7f3360007e20 comp rx=0 tx=0).stop 2024-08-17T02:26:41.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.869+0000 7f3375200640 1 -- 172.21.15.2:0/850333388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3370155040 msgr2=0x7f337014e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.869+0000 7f3375200640 1 --2- 172.21.15.2:0/850333388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3370155040 0x7f337014e4a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3368009fa0 tx=0x7f3368009900 comp rx=0 tx=0).stop 2024-08-17T02:26:41.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.869+0000 7f3375200640 1 -- 172.21.15.2:0/850333388 shutdown_connections 2024-08-17T02:26:41.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.869+0000 7f3375200640 1 --2- 172.21.15.2:0/850333388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3370155040 0x7f337014e4a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.869+0000 7f3375200640 1 --2- 172.21.15.2:0/850333388 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33700af340 0x7f3370155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.869+0000 7f3375200640 1 --2- 172.21.15.2:0/850333388 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3350065150 0x7f3350067600 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.869+0000 7f3375200640 1 --2- 172.21.15.2:0/850333388 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f337006e060 0x7f3370150e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.869+0000 7f3375200640 1 -- 172.21.15.2:0/850333388 >> 172.21.15.2:0/850333388 conn(0x7f3370066e60 msgr2=0x7f33700ab020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.869+0000 7f3375200640 1 -- 172.21.15.2:0/850333388 shutdown_connections 2024-08-17T02:26:41.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:41.869+0000 7f3375200640 1 -- 172.21.15.2:0/850333388 wait complete. 2024-08-17T02:26:41.884 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:26:41.885 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:42.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.037+0000 7fef59000640 1 Processor -- start 2024-08-17T02:26:42.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.037+0000 7fef59000640 1 -- start start 2024-08-17T02:26:42.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.038+0000 7fef59000640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fef54069840 0x7fef540cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.038+0000 7fef59000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5415c9d0 con 0x7fef540cd550 2024-08-17T02:26:42.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.038+0000 7fef59000640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5415a200 con 0x7fef540cbe10 2024-08-17T02:26:42.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.038+0000 7fef59000640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef540b0830 con 0x7fef54069840 2024-08-17T02:26:42.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.038+0000 7fef4aa00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fef540cd550 0x7fef5415ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55494/0 (socket says 172.21.15.2:55494) 2024-08-17T02:26:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.038+0000 7fef4aa00640 1 -- 172.21.15.2:0/390441484 learned_addr learned my addr 172.21.15.2:0/390441484 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:26:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.039+0000 7fef53400640 1 --2- 172.21.15.2:0/390441484 >> v2:172.21.15.145:3300/0 conn(0x7fef54069840 0x7fef540cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.039+0000 7fef52a00640 1 -- 172.21.15.2:0/390441484 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931117014 0 0) 0x7fef5415c9d0 con 0x7fef540cd550 2024-08-17T02:26:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.039+0000 7fef52a00640 1 -- 172.21.15.2:0/390441484 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef380034e0 con 0x7fef540cd550 2024-08-17T02:26:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.039+0000 7fef52a00640 1 -- 172.21.15.2:0/390441484 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1331892089 0 0) 0x7fef380034e0 con 0x7fef540cd550 2024-08-17T02:26:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.039+0000 7fef52a00640 1 -- 172.21.15.2:0/390441484 >> v2:172.21.15.145:3300/0 conn(0x7fef54069840 msgr2=0x7fef540cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.039+0000 7fef52a00640 1 --2- 172.21.15.2:0/390441484 >> v2:172.21.15.145:3300/0 conn(0x7fef54069840 0x7fef540cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.039+0000 7fef52a00640 1 -- 172.21.15.2:0/390441484 >> v1:172.21.15.145:6789/0 conn(0x7fef540cbe10 legacy=0x7fef540ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.039+0000 7fef52a00640 1 -- 172.21.15.2:0/390441484 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef540b0b10 con 0x7fef540cd550 2024-08-17T02:26:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.039+0000 7fef52a00640 1 -- 172.21.15.2:0/390441484 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7fef3c001470 con 0x7fef540cd550 2024-08-17T02:26:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.039+0000 7fef52a00640 1 -- 172.21.15.2:0/390441484 >> v1:172.21.15.2:6789/0 conn(0x7fef540cd550 legacy=0x7fef5415ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.039+0000 7fef52a00640 1 --2- 172.21.15.2:0/390441484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef38003a90 0x7fef38003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.039+0000 7fef52a00640 1 --2- 172.21.15.2:0/390441484 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef38004780 0x7fef38004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.039+0000 7fef52a00640 1 --2- 172.21.15.2:0/390441484 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef38005250 0x7fef3800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.039+0000 7fef52a00640 1 -- 172.21.15.2:0/390441484 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef540b0830 con 0x7fef38003a90 2024-08-17T02:26:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.039+0000 7fef52a00640 1 -- 172.21.15.2:0/390441484 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3800c100 con 0x7fef38004780 2024-08-17T02:26:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.039+0000 7fef52a00640 1 -- 172.21.15.2:0/390441484 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3800c2c0 con 0x7fef38005250 2024-08-17T02:26:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.039+0000 7fef53400640 1 --2- 172.21.15.2:0/390441484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef38003a90 0x7fef38003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.040+0000 7fef53e00640 1 --2- 172.21.15.2:0/390441484 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef38005250 0x7fef3800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.040+0000 7fef4aa00640 1 --2- 172.21.15.2:0/390441484 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef38004780 0x7fef38004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.040+0000 7fef53400640 1 -- 172.21.15.2:0/390441484 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef38005250 msgr2=0x7fef3800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.040+0000 7fef53400640 1 --2- 172.21.15.2:0/390441484 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef38005250 0x7fef3800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.040+0000 7fef53400640 1 -- 172.21.15.2:0/390441484 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef38004780 msgr2=0x7fef38004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.040+0000 7fef53400640 1 --2- 172.21.15.2:0/390441484 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef38004780 0x7fef38004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.040+0000 7fef53400640 1 -- 172.21.15.2:0/390441484 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef380034e0 con 0x7fef38003a90 2024-08-17T02:26:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.040+0000 7fef53e00640 1 -- 172.21.15.2:0/390441484 reap_dead start 2024-08-17T02:26:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.041+0000 7fef53400640 1 --2- 172.21.15.2:0/390441484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef38003a90 0x7fef38003ea0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fef44006e70 tx=0x7fef440090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd63a330bb84d51 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.041+0000 7fef52a00640 1 -- 172.21.15.2:0/390441484 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44031400 con 0x7fef38003a90 2024-08-17T02:26:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.041+0000 7fef52a00640 1 -- 172.21.15.2:0/390441484 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4402d050 con 0x7fef38003a90 2024-08-17T02:26:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.041+0000 7fef52a00640 1 -- 172.21.15.2:0/390441484 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44031790 con 0x7fef38003a90 2024-08-17T02:26:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.042+0000 7fef59000640 1 -- 172.21.15.2:0/390441484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef38003a90 msgr2=0x7fef38003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.042+0000 7fef59000640 1 --2- 172.21.15.2:0/390441484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef38003a90 0x7fef38003ea0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fef44006e70 tx=0x7fef440090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.042+0000 7fef59000640 1 -- 172.21.15.2:0/390441484 shutdown_connections 2024-08-17T02:26:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.042+0000 7fef59000640 1 --2- 172.21.15.2:0/390441484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef38003a90 0x7fef38003ea0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.042+0000 7fef59000640 1 -- 172.21.15.2:0/390441484 >> 172.21.15.2:0/390441484 conn(0x7fef54066e60 msgr2=0x7fef54067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.042+0000 7fef59000640 1 -- 172.21.15.2:0/390441484 shutdown_connections 2024-08-17T02:26:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.042+0000 7fef59000640 1 -- 172.21.15.2:0/390441484 wait complete. 2024-08-17T02:26:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.043+0000 7fef59000640 1 Processor -- start 2024-08-17T02:26:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.043+0000 7fef59000640 1 -- start start 2024-08-17T02:26:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.044+0000 7fef59000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef38003a90 0x7fef54169c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.044+0000 7fef59000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef540afb70 0x7fef54157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.044+0000 7fef59000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef540aa520 0x7fef540aa990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.044+0000 7fef59000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef54158000 con 0x7fef38003a90 2024-08-17T02:26:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.044+0000 7fef59000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef540aaed0 con 0x7fef540afb70 2024-08-17T02:26:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.044+0000 7fef59000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5416a3b0 con 0x7fef540aa520 2024-08-17T02:26:42.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.044+0000 7fef53400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef38003a90 0x7fef54169c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.045+0000 7fef53400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef38003a90 0x7fef54169c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48464/0 (socket says 172.21.15.2:48464) 2024-08-17T02:26:42.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.045+0000 7fef53400640 1 -- 172.21.15.2:0/3254895900 learned_addr learned my addr 172.21.15.2:0/3254895900 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:42.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.045+0000 7fef4aa00640 1 --2- 172.21.15.2:0/3254895900 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef540afb70 0x7fef54157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.045+0000 7fef53e00640 1 --2- 172.21.15.2:0/3254895900 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef540aa520 0x7fef540aa990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.045+0000 7fef53400640 1 -- 172.21.15.2:0/3254895900 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef540aa520 msgr2=0x7fef540aa990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.045+0000 7fef53400640 1 --2- 172.21.15.2:0/3254895900 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef540aa520 0x7fef540aa990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.045+0000 7fef53400640 1 -- 172.21.15.2:0/3254895900 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef540afb70 msgr2=0x7fef54157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.045+0000 7fef53400640 1 --2- 172.21.15.2:0/3254895900 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef540afb70 0x7fef54157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.045+0000 7fef53400640 1 -- 172.21.15.2:0/3254895900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef540affe0 con 0x7fef38003a90 2024-08-17T02:26:42.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.045+0000 7fef53400640 1 --2- 172.21.15.2:0/3254895900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef38003a90 0x7fef54169c20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fef44009ba0 tx=0x7fef44035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.046+0000 7fef4b400640 1 -- 172.21.15.2:0/3254895900 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44000c40 con 0x7fef38003a90 2024-08-17T02:26:42.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.046+0000 7fef4b400640 1 -- 172.21.15.2:0/3254895900 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef44030a60 con 0x7fef38003a90 2024-08-17T02:26:42.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.046+0000 7fef4b400640 1 -- 172.21.15.2:0/3254895900 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44030e00 con 0x7fef38003a90 2024-08-17T02:26:42.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.046+0000 7fef59000640 1 -- 172.21.15.2:0/3254895900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef54158210 con 0x7fef38003a90 2024-08-17T02:26:42.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.046+0000 7fef59000640 1 -- 172.21.15.2:0/3254895900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef541587d0 con 0x7fef38003a90 2024-08-17T02:26:42.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.047+0000 7fef59000640 1 -- 172.21.15.2:0/3254895900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef54070720 con 0x7fef38003a90 2024-08-17T02:26:42.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.048+0000 7fef4b400640 1 -- 172.21.15.2:0/3254895900 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fef4402ad50 con 0x7fef38003a90 2024-08-17T02:26:42.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.049+0000 7fef4b400640 1 --2- 172.21.15.2:0/3254895900 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fef30065150 0x7fef30067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.049+0000 7fef4b400640 1 -- 172.21.15.2:0/3254895900 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fef440a3580 con 0x7fef38003a90 2024-08-17T02:26:42.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.049+0000 7fef4aa00640 1 --2- 172.21.15.2:0/3254895900 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fef30065150 0x7fef30067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.050+0000 7fef4aa00640 1 --2- 172.21.15.2:0/3254895900 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fef30065150 0x7fef30067600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fef3c000e50 tx=0x7fef3c001d80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.053+0000 7fef4b400640 1 -- 172.21.15.2:0/3254895900 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fef440712d0 con 0x7fef38003a90 2024-08-17T02:26:42.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.275+0000 7fef59000640 1 -- 172.21.15.2:0/3254895900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef540b01d0 con 0x7fef38003a90 2024-08-17T02:26:42.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.275+0000 7fef4b400640 1 -- 172.21.15.2:0/3254895900 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5684 (secure 0 0 0) 0x7fef440748f0 con 0x7fef38003a90 2024-08-17T02:26:42.275 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:26:42.276 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1347318932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1347318932},{"type":"v1","addr":"172.21.15.2:6834","nonce":1347318932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6836/4156967978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":4156967978},{"type":"v1","addr":"172.21.15.145:6836","nonce":4156967978}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:23.151218+0000","modified":"2024-08-17T02:24:26.741121+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4950},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4950":{"gid":4950,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/3013258535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3013258535},{"type":"v1","addr":"172.21.15.2:6835","nonce":3013258535}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:35.805568+0000","modified":"2024-08-17T02:24:37.800310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4903":{"gid":4903,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.145:6837/1729489536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":1729489536},{"type":"v1","addr":"172.21.15.145:6837","nonce":1729489536}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001044477","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:26:42.276 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 21 2024-08-17T02:26:42.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.277+0000 7fef59000640 1 -- 172.21.15.2:0/3254895900 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fef30065150 msgr2=0x7fef30067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.277+0000 7fef59000640 1 --2- 172.21.15.2:0/3254895900 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fef30065150 0x7fef30067600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fef3c000e50 tx=0x7fef3c001d80 comp rx=0 tx=0).stop 2024-08-17T02:26:42.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.277+0000 7fef59000640 1 -- 172.21.15.2:0/3254895900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef38003a90 msgr2=0x7fef54169c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.277+0000 7fef59000640 1 --2- 172.21.15.2:0/3254895900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef38003a90 0x7fef54169c20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fef44009ba0 tx=0x7fef44035000 comp rx=0 tx=0).stop 2024-08-17T02:26:42.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.278+0000 7fef59000640 1 -- 172.21.15.2:0/3254895900 shutdown_connections 2024-08-17T02:26:42.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.278+0000 7fef59000640 1 --2- 172.21.15.2:0/3254895900 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fef30065150 0x7fef30067600 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.278+0000 7fef59000640 1 --2- 172.21.15.2:0/3254895900 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fef540aa520 0x7fef540aa990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.278+0000 7fef59000640 1 --2- 172.21.15.2:0/3254895900 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef540afb70 0x7fef54157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.278+0000 7fef59000640 1 --2- 172.21.15.2:0/3254895900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef38003a90 0x7fef54169c20 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.278+0000 7fef59000640 1 -- 172.21.15.2:0/3254895900 >> 172.21.15.2:0/3254895900 conn(0x7fef54066e60 msgr2=0x7fef54068220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:42.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.278+0000 7fef59000640 1 -- 172.21.15.2:0/3254895900 shutdown_connections 2024-08-17T02:26:42.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.278+0000 7fef59000640 1 -- 172.21.15.2:0/3254895900 wait complete. 2024-08-17T02:26:42.293 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:42.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.445+0000 7f448c600640 1 Processor -- start 2024-08-17T02:26:42.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.445+0000 7f448c600640 1 -- start start 2024-08-17T02:26:42.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.446+0000 7f448c600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f448406dee0 0x7f4484163c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.446+0000 7f448c600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44840aed90 con 0x7f4484158a20 2024-08-17T02:26:42.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.446+0000 7f448c600640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44840af070 con 0x7f44840ae860 2024-08-17T02:26:42.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.446+0000 7f448c600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44840af350 con 0x7f448406dee0 2024-08-17T02:26:42.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.446+0000 7f448a600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f448406dee0 0x7f4484163c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.446+0000 7f4489c00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4484158a20 0x7f44840a89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55506/0 (socket says 172.21.15.2:55506) 2024-08-17T02:26:42.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.446+0000 7f4489c00640 1 -- 172.21.15.2:0/3455367984 learned_addr learned my addr 172.21.15.2:0/3455367984 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:26:42.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.447+0000 7f448a600640 1 -- 172.21.15.2:0/3455367984 >> v1:172.21.15.145:6789/0 conn(0x7f44840ae860 legacy=0x7f448406d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.447+0000 7f448a600640 1 -- 172.21.15.2:0/3455367984 >> v1:172.21.15.2:6789/0 conn(0x7f4484158a20 legacy=0x7f44840a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.447+0000 7f4483e00640 1 -- 172.21.15.2:0/3455367984 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 973236064 0 0) 0x7f44840aed90 con 0x7f4484158a20 2024-08-17T02:26:42.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.447+0000 7f448a600640 1 -- 172.21.15.2:0/3455367984 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44840af630 con 0x7f448406dee0 2024-08-17T02:26:42.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.448+0000 7f448a600640 1 --2- 172.21.15.2:0/3455367984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f448406dee0 0x7f4484163c40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f447c009e60 tx=0x7f447c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c90524ffbf1b52 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.448+0000 7f4483e00640 1 -- 172.21.15.2:0/3455367984 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c007550 con 0x7f448406dee0 2024-08-17T02:26:42.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.448+0000 7f4483e00640 1 -- 172.21.15.2:0/3455367984 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c02d050 con 0x7f448406dee0 2024-08-17T02:26:42.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.448+0000 7f4483e00640 1 -- 172.21.15.2:0/3455367984 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c007900 con 0x7f448406dee0 2024-08-17T02:26:42.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.449+0000 7f448c600640 1 -- 172.21.15.2:0/3455367984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f448406dee0 msgr2=0x7f4484163c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.449+0000 7f448c600640 1 --2- 172.21.15.2:0/3455367984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f448406dee0 0x7f4484163c40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f447c009e60 tx=0x7f447c009780 comp rx=0 tx=0).stop 2024-08-17T02:26:42.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.449+0000 7f448c600640 1 -- 172.21.15.2:0/3455367984 shutdown_connections 2024-08-17T02:26:42.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.449+0000 7f448c600640 1 --2- 172.21.15.2:0/3455367984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f448406dee0 0x7f4484163c40 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.449+0000 7f448c600640 1 -- 172.21.15.2:0/3455367984 >> 172.21.15.2:0/3455367984 conn(0x7f4484066e60 msgr2=0x7f4484067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:42.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.449+0000 7f448c600640 1 -- 172.21.15.2:0/3455367984 shutdown_connections 2024-08-17T02:26:42.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.449+0000 7f448c600640 1 -- 172.21.15.2:0/3455367984 wait complete. 2024-08-17T02:26:42.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.450+0000 7f448c600640 1 Processor -- start 2024-08-17T02:26:42.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.451+0000 7f448c600640 1 -- start start 2024-08-17T02:26:42.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.452+0000 7f448c600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f448406dee0 0x7f44841493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.452+0000 7f448c600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44840ae860 0x7f44840ab310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.452+0000 7f448c600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4484158a20 0x7f44840c2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.452+0000 7f448c600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44840ac900 con 0x7f4484158a20 2024-08-17T02:26:42.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.452+0000 7f448c600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44840abcf0 con 0x7f44840ae860 2024-08-17T02:26:42.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.452+0000 7f448c600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44840abfd0 con 0x7f448406dee0 2024-08-17T02:26:42.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.452+0000 7f448a600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4484158a20 0x7f44840c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.452+0000 7f448a600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4484158a20 0x7f44840c2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48470/0 (socket says 172.21.15.2:48470) 2024-08-17T02:26:42.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.452+0000 7f448a600640 1 -- 172.21.15.2:0/1470875306 learned_addr learned my addr 172.21.15.2:0/1470875306 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:42.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.452+0000 7f4489200640 1 --2- 172.21.15.2:0/1470875306 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44840ae860 0x7f44840ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.452+0000 7f4489c00640 1 --2- 172.21.15.2:0/1470875306 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f448406dee0 0x7f44841493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.452+0000 7f448a600640 1 -- 172.21.15.2:0/1470875306 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f448406dee0 msgr2=0x7f44841493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.452+0000 7f448a600640 1 --2- 172.21.15.2:0/1470875306 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f448406dee0 0x7f44841493e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.452+0000 7f448a600640 1 -- 172.21.15.2:0/1470875306 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44840ae860 msgr2=0x7f44840ab310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.452+0000 7f448a600640 1 --2- 172.21.15.2:0/1470875306 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44840ae860 0x7f44840ab310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.452+0000 7f448a600640 1 -- 172.21.15.2:0/1470875306 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447c009a20 con 0x7f4484158a20 2024-08-17T02:26:42.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.452+0000 7f4489c00640 1 --2- 172.21.15.2:0/1470875306 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f448406dee0 0x7f44841493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:42.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.453+0000 7f448a600640 1 --2- 172.21.15.2:0/1470875306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4484158a20 0x7f44840c2600 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f447c0097c0 tx=0x7f447c037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.453+0000 7f4480c00640 1 -- 172.21.15.2:0/1470875306 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c031cc0 con 0x7f4484158a20 2024-08-17T02:26:42.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.453+0000 7f4480c00640 1 -- 172.21.15.2:0/1470875306 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c031e20 con 0x7f4484158a20 2024-08-17T02:26:42.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.453+0000 7f448c600640 1 -- 172.21.15.2:0/1470875306 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44840ac2b0 con 0x7f4484158a20 2024-08-17T02:26:42.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.453+0000 7f4480c00640 1 -- 172.21.15.2:0/1470875306 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c03d680 con 0x7f4484158a20 2024-08-17T02:26:42.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.453+0000 7f448c600640 1 -- 172.21.15.2:0/1470875306 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4484149920 con 0x7f4484158a20 2024-08-17T02:26:42.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.454+0000 7f448c600640 1 -- 172.21.15.2:0/1470875306 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44840aca70 con 0x7f4484158a20 2024-08-17T02:26:42.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.455+0000 7f4480c00640 1 -- 172.21.15.2:0/1470875306 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f447c003040 con 0x7f4484158a20 2024-08-17T02:26:42.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.456+0000 7f4480c00640 1 --2- 172.21.15.2:0/1470875306 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4464065150 0x7f4464067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.456+0000 7f4480c00640 1 -- 172.21.15.2:0/1470875306 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f447c0a41f0 con 0x7f4484158a20 2024-08-17T02:26:42.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.456+0000 7f4489c00640 1 --2- 172.21.15.2:0/1470875306 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4464065150 0x7f4464067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.457+0000 7f4489c00640 1 --2- 172.21.15.2:0/1470875306 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4464065150 0x7f4464067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4478000c00 tx=0x7f4478009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.460+0000 7f4480c00640 1 -- 172.21.15.2:0/1470875306 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f447c071f30 con 0x7f4484158a20 2024-08-17T02:26:42.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.682+0000 7f448c600640 1 -- 172.21.15.2:0/1470875306 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4484063fb0 con 0x7f4484158a20 2024-08-17T02:26:42.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.683+0000 7f4480c00640 1 -- 172.21.15.2:0/1470875306 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5684 (secure 0 0 0) 0x7f447c075550 con 0x7f4484158a20 2024-08-17T02:26:42.683 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:26:42.683 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1347318932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1347318932},{"type":"v1","addr":"172.21.15.2:6834","nonce":1347318932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6836/4156967978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":4156967978},{"type":"v1","addr":"172.21.15.145:6836","nonce":4156967978}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:23.151218+0000","modified":"2024-08-17T02:24:26.741121+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4950},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4950":{"gid":4950,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/3013258535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3013258535},{"type":"v1","addr":"172.21.15.2:6835","nonce":3013258535}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:35.805568+0000","modified":"2024-08-17T02:24:37.800310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4903":{"gid":4903,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.145:6837/1729489536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":1729489536},{"type":"v1","addr":"172.21.15.145:6837","nonce":1729489536}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001044477","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:26:42.684 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 21 2024-08-17T02:26:42.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.685+0000 7f448c600640 1 -- 172.21.15.2:0/1470875306 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4464065150 msgr2=0x7f4464067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.685+0000 7f448c600640 1 --2- 172.21.15.2:0/1470875306 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4464065150 0x7f4464067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4478000c00 tx=0x7f4478009040 comp rx=0 tx=0).stop 2024-08-17T02:26:42.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.685+0000 7f448c600640 1 -- 172.21.15.2:0/1470875306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4484158a20 msgr2=0x7f44840c2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.685+0000 7f448c600640 1 --2- 172.21.15.2:0/1470875306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4484158a20 0x7f44840c2600 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f447c0097c0 tx=0x7f447c037000 comp rx=0 tx=0).stop 2024-08-17T02:26:42.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.685+0000 7f448c600640 1 -- 172.21.15.2:0/1470875306 shutdown_connections 2024-08-17T02:26:42.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.685+0000 7f448c600640 1 --2- 172.21.15.2:0/1470875306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4484158a20 0x7f44840c2600 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.685+0000 7f448c600640 1 --2- 172.21.15.2:0/1470875306 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44840ae860 0x7f44840ab310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.685+0000 7f448c600640 1 --2- 172.21.15.2:0/1470875306 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f4464065150 0x7f4464067600 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.685+0000 7f448c600640 1 --2- 172.21.15.2:0/1470875306 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f448406dee0 0x7f44841493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.685+0000 7f448c600640 1 -- 172.21.15.2:0/1470875306 >> 172.21.15.2:0/1470875306 conn(0x7f4484066e60 msgr2=0x7f448406b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:42.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.685+0000 7f448c600640 1 -- 172.21.15.2:0/1470875306 shutdown_connections 2024-08-17T02:26:42.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.685+0000 7f448c600640 1 -- 172.21.15.2:0/1470875306 wait complete. 2024-08-17T02:26:42.701 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:42.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.852+0000 7fd94ae00640 1 Processor -- start 2024-08-17T02:26:42.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.852+0000 7fd94ae00640 1 -- start start 2024-08-17T02:26:42.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.853+0000 7fd94ae00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd9440aea20 0x7fd9440aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.853+0000 7fd94ae00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9440af3a0 con 0x7fd944158b90 2024-08-17T02:26:42.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.853+0000 7fd94ae00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9440afd20 con 0x7fd9440ca8e0 2024-08-17T02:26:42.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.853+0000 7fd94ae00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9440affe0 con 0x7fd9440aea20 2024-08-17T02:26:42.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.853+0000 7fd943e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd944158b90 0x7fd9440b1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55516/0 (socket says 172.21.15.2:55516) 2024-08-17T02:26:42.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.853+0000 7fd943e00640 1 -- 172.21.15.2:0/3754379715 learned_addr learned my addr 172.21.15.2:0/3754379715 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:26:42.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.854+0000 7fd943400640 1 --2- 172.21.15.2:0/3754379715 >> v2:172.21.15.145:3300/0 conn(0x7fd9440aea20 0x7fd9440aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.854+0000 7fd942a00640 1 -- 172.21.15.2:0/3754379715 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386916530 0 0) 0x7fd9440af3a0 con 0x7fd944158b90 2024-08-17T02:26:42.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.854+0000 7fd942a00640 1 -- 172.21.15.2:0/3754379715 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9280034e0 con 0x7fd944158b90 2024-08-17T02:26:42.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.854+0000 7fd942a00640 1 -- 172.21.15.2:0/3754379715 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3635373152 0 0) 0x7fd9280034e0 con 0x7fd944158b90 2024-08-17T02:26:42.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.854+0000 7fd942a00640 1 -- 172.21.15.2:0/3754379715 >> v2:172.21.15.145:3300/0 conn(0x7fd9440aea20 msgr2=0x7fd9440aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:42.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.854+0000 7fd942a00640 1 --2- 172.21.15.2:0/3754379715 >> v2:172.21.15.145:3300/0 conn(0x7fd9440aea20 0x7fd9440aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.854+0000 7fd942a00640 1 -- 172.21.15.2:0/3754379715 >> v1:172.21.15.145:6789/0 conn(0x7fd9440ca8e0 legacy=0x7fd9440cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.854+0000 7fd942a00640 1 -- 172.21.15.2:0/3754379715 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9440b02c0 con 0x7fd944158b90 2024-08-17T02:26:42.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.854+0000 7fd942a00640 1 -- 172.21.15.2:0/3754379715 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7fd934001490 con 0x7fd944158b90 2024-08-17T02:26:42.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.854+0000 7fd942a00640 1 -- 172.21.15.2:0/3754379715 >> v1:172.21.15.2:6789/0 conn(0x7fd944158b90 legacy=0x7fd9440b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.854+0000 7fd942a00640 1 --2- 172.21.15.2:0/3754379715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9280039d0 0x7fd928003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.854+0000 7fd942a00640 1 --2- 172.21.15.2:0/3754379715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd928004780 0x7fd928004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.854+0000 7fd942a00640 1 --2- 172.21.15.2:0/3754379715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd928005130 0x7fd92800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.854+0000 7fd942a00640 1 -- 172.21.15.2:0/3754379715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9440affe0 con 0x7fd928004780 2024-08-17T02:26:42.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.854+0000 7fd942a00640 1 -- 172.21.15.2:0/3754379715 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92800c040 con 0x7fd9280039d0 2024-08-17T02:26:42.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.854+0000 7fd942a00640 1 -- 172.21.15.2:0/3754379715 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd92800c200 con 0x7fd928005130 2024-08-17T02:26:42.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.854+0000 7fd943400640 1 --2- 172.21.15.2:0/3754379715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd928004780 0x7fd928004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.855+0000 7fd943e00640 1 --2- 172.21.15.2:0/3754379715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9280039d0 0x7fd928003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.855+0000 7fd948e00640 1 --2- 172.21.15.2:0/3754379715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd928005130 0x7fd92800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.855+0000 7fd943400640 1 -- 172.21.15.2:0/3754379715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd928005130 msgr2=0x7fd92800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:42.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.855+0000 7fd943400640 1 --2- 172.21.15.2:0/3754379715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd928005130 0x7fd92800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.855+0000 7fd943400640 1 -- 172.21.15.2:0/3754379715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9280039d0 msgr2=0x7fd928003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:42.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.855+0000 7fd943400640 1 --2- 172.21.15.2:0/3754379715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9280039d0 0x7fd928003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.855+0000 7fd943400640 1 -- 172.21.15.2:0/3754379715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9280034e0 con 0x7fd928004780 2024-08-17T02:26:42.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.855+0000 7fd948e00640 1 -- 172.21.15.2:0/3754379715 reap_dead start 2024-08-17T02:26:42.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.856+0000 7fd943400640 1 --2- 172.21.15.2:0/3754379715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd928004780 0x7fd928004bf0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd930009b70 tx=0x7fd9300090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c6779fce9682d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.856+0000 7fd942a00640 1 -- 172.21.15.2:0/3754379715 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd930031400 con 0x7fd928004780 2024-08-17T02:26:42.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.856+0000 7fd942a00640 1 -- 172.21.15.2:0/3754379715 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93002d050 con 0x7fd928004780 2024-08-17T02:26:42.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.856+0000 7fd942a00640 1 -- 172.21.15.2:0/3754379715 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd930031790 con 0x7fd928004780 2024-08-17T02:26:42.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.857+0000 7fd94ae00640 1 -- 172.21.15.2:0/3754379715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd928004780 msgr2=0x7fd928004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.857+0000 7fd94ae00640 1 --2- 172.21.15.2:0/3754379715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd928004780 0x7fd928004bf0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd930009b70 tx=0x7fd9300090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.857+0000 7fd94ae00640 1 -- 172.21.15.2:0/3754379715 shutdown_connections 2024-08-17T02:26:42.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.857+0000 7fd94ae00640 1 --2- 172.21.15.2:0/3754379715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd928004780 0x7fd928004bf0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.857+0000 7fd94ae00640 1 -- 172.21.15.2:0/3754379715 >> 172.21.15.2:0/3754379715 conn(0x7fd94406e590 msgr2=0x7fd94406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:42.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.857+0000 7fd94ae00640 1 -- 172.21.15.2:0/3754379715 shutdown_connections 2024-08-17T02:26:42.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.857+0000 7fd94ae00640 1 -- 172.21.15.2:0/3754379715 wait complete. 2024-08-17T02:26:42.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.858+0000 7fd94ae00640 1 Processor -- start 2024-08-17T02:26:42.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.858+0000 7fd94ae00640 1 -- start start 2024-08-17T02:26:42.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.859+0000 7fd94ae00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd928004780 0x7fd9441511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.859+0000 7fd94ae00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd94415aa50 0x7fd94415aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.859+0000 7fd94ae00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd944159200 0x7fd944159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.859+0000 7fd94ae00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94415b400 con 0x7fd94415aa50 2024-08-17T02:26:42.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.859+0000 7fd94ae00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9440c6e50 con 0x7fd928004780 2024-08-17T02:26:42.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.859+0000 7fd94ae00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94415a810 con 0x7fd944159200 2024-08-17T02:26:42.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.860+0000 7fd943400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd94415aa50 0x7fd94415aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.860+0000 7fd943400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd94415aa50 0x7fd94415aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48494/0 (socket says 172.21.15.2:48494) 2024-08-17T02:26:42.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.860+0000 7fd943400640 1 -- 172.21.15.2:0/2073027514 learned_addr learned my addr 172.21.15.2:0/2073027514 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:42.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.860+0000 7fd943e00640 1 --2- 172.21.15.2:0/2073027514 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd928004780 0x7fd9441511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.860+0000 7fd948e00640 1 --2- 172.21.15.2:0/2073027514 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd944159200 0x7fd944159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.860+0000 7fd943e00640 1 -- 172.21.15.2:0/2073027514 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd944159200 msgr2=0x7fd944159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.860+0000 7fd943e00640 1 --2- 172.21.15.2:0/2073027514 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd944159200 0x7fd944159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.860+0000 7fd943e00640 1 -- 172.21.15.2:0/2073027514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd94415aa50 msgr2=0x7fd94415aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.860+0000 7fd943e00640 1 --2- 172.21.15.2:0/2073027514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd94415aa50 0x7fd94415aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.860+0000 7fd943e00640 1 -- 172.21.15.2:0/2073027514 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd944159f70 con 0x7fd928004780 2024-08-17T02:26:42.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.860+0000 7fd943400640 1 --2- 172.21.15.2:0/2073027514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd94415aa50 0x7fd94415aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:42.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.860+0000 7fd943e00640 1 --2- 172.21.15.2:0/2073027514 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd928004780 0x7fd9441511a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd934001ed0 tx=0x7fd9440ca2b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.861+0000 7fd93b400640 1 -- 172.21.15.2:0/2073027514 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd934018030 con 0x7fd928004780 2024-08-17T02:26:42.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.861+0000 7fd93b400640 1 -- 172.21.15.2:0/2073027514 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd934000cb0 con 0x7fd928004780 2024-08-17T02:26:42.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.861+0000 7fd93b400640 1 -- 172.21.15.2:0/2073027514 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93400f950 con 0x7fd928004780 2024-08-17T02:26:42.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.861+0000 7fd94ae00640 1 -- 172.21.15.2:0/2073027514 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd94415a250 con 0x7fd928004780 2024-08-17T02:26:42.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.861+0000 7fd94ae00640 1 -- 172.21.15.2:0/2073027514 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9441516e0 con 0x7fd928004780 2024-08-17T02:26:42.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.862+0000 7fd94ae00640 1 -- 172.21.15.2:0/2073027514 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd944063fb0 con 0x7fd928004780 2024-08-17T02:26:42.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.863+0000 7fd93b400640 1 -- 172.21.15.2:0/2073027514 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd93401b070 con 0x7fd928004780 2024-08-17T02:26:42.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.864+0000 7fd93b400640 1 --2- 172.21.15.2:0/2073027514 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd924065150 0x7fd924067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.864+0000 7fd93b400640 1 -- 172.21.15.2:0/2073027514 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fd934019070 con 0x7fd928004780 2024-08-17T02:26:42.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.864+0000 7fd943400640 1 --2- 172.21.15.2:0/2073027514 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd924065150 0x7fd924067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.865+0000 7fd943400640 1 --2- 172.21.15.2:0/2073027514 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd924065150 0x7fd924067600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd944156c60 tx=0x7fd930035000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:42.869+0000 7fd93b400640 1 -- 172.21.15.2:0/2073027514 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd93404fec0 con 0x7fd928004780 2024-08-17T02:26:43.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.052+0000 7fd94ae00640 1 -- 172.21.15.2:0/2073027514 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9440b3b70 con 0x7fd928004780 2024-08-17T02:26:43.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.053+0000 7fd93b400640 1 -- 172.21.15.2:0/2073027514 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18551 (secure 0 0 0) 0x7fd934004e60 con 0x7fd928004780 2024-08-17T02:26:43.054 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:26:43.054 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":36,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:24:37.793272+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:21.215146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:22.134466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000001044477.meta","create_time":"2024-08-17T02:24:33.976587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001044477"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001044477.data","create_time":"2024-08-17T02:24:34.827029+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001044477"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:43.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.055+0000 7fd94ae00640 1 -- 172.21.15.2:0/2073027514 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd924065150 msgr2=0x7fd924067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.055+0000 7fd94ae00640 1 --2- 172.21.15.2:0/2073027514 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd924065150 0x7fd924067600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd944156c60 tx=0x7fd930035000 comp rx=0 tx=0).stop 2024-08-17T02:26:43.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.055+0000 7fd94ae00640 1 -- 172.21.15.2:0/2073027514 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd928004780 msgr2=0x7fd9441511a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.055+0000 7fd94ae00640 1 --2- 172.21.15.2:0/2073027514 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd928004780 0x7fd9441511a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd934001ed0 tx=0x7fd9440ca2b0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.055+0000 7fd94ae00640 1 -- 172.21.15.2:0/2073027514 shutdown_connections 2024-08-17T02:26:43.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.055+0000 7fd94ae00640 1 --2- 172.21.15.2:0/2073027514 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd924065150 0x7fd924067600 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.055+0000 7fd94ae00640 1 --2- 172.21.15.2:0/2073027514 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd944159200 0x7fd944159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.055+0000 7fd94ae00640 1 --2- 172.21.15.2:0/2073027514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd94415aa50 0x7fd94415aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.055+0000 7fd94ae00640 1 --2- 172.21.15.2:0/2073027514 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd928004780 0x7fd9441511a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.055+0000 7fd94ae00640 1 -- 172.21.15.2:0/2073027514 >> 172.21.15.2:0/2073027514 conn(0x7fd94406e590 msgr2=0x7fd9440b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:43.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.055+0000 7fd94ae00640 1 -- 172.21.15.2:0/2073027514 shutdown_connections 2024-08-17T02:26:43.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.055+0000 7fd94ae00640 1 -- 172.21.15.2:0/2073027514 wait complete. 2024-08-17T02:26:43.072 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:26:43.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.224+0000 7f172ca00640 1 Processor -- start 2024-08-17T02:26:43.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.224+0000 7f172ca00640 1 -- start start 2024-08-17T02:26:43.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.225+0000 7f172ca00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1728158a00 0x7f1728158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.225+0000 7f172ca00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f17280cb190 0x7f17280cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.225+0000 7f172ca00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17280cbc50 con 0x7f172806e590 2024-08-17T02:26:43.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.225+0000 7f172ca00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17280cbf30 con 0x7f17280cb190 2024-08-17T02:26:43.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.225+0000 7f172ca00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17280cc210 con 0x7f1728158a00 2024-08-17T02:26:43.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.225+0000 7f1726a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f17280cb190 0x7f17280cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.225+0000 7f1726a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f17280cb190 0x7f17280cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48496/0 (socket says 172.21.15.2:48496) 2024-08-17T02:26:43.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.225+0000 7f1727e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f172806e590 0x7f17280683e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55530/0 (socket says 172.21.15.2:55530) 2024-08-17T02:26:43.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.225+0000 7f1726a00640 1 -- 172.21.15.2:0/2312282211 learned_addr learned my addr 172.21.15.2:0/2312282211 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:43.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.226+0000 7f1727400640 1 --2- 172.21.15.2:0/2312282211 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1728158a00 0x7f1728158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.226+0000 7f1726a00640 1 -- 172.21.15.2:0/2312282211 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1728158a00 msgr2=0x7f1728158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:43.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.226+0000 7f1726a00640 1 --2- 172.21.15.2:0/2312282211 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1728158a00 0x7f1728158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.226+0000 7f1726a00640 1 -- 172.21.15.2:0/2312282211 >> v1:172.21.15.2:6789/0 conn(0x7f172806e590 legacy=0x7f17280683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.226+0000 7f1726000640 1 -- 172.21.15.2:0/2312282211 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397360806 0 0) 0x7f17280cbc50 con 0x7f172806e590 2024-08-17T02:26:43.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.226+0000 7f1726a00640 1 -- 172.21.15.2:0/2312282211 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17280b2930 con 0x7f17280cb190 2024-08-17T02:26:43.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.227+0000 7f1726a00640 1 --2- 172.21.15.2:0/2312282211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17280cb190 0x7f17280cb5c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1714009910 tx=0x7f17140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bdc7338fcb1305c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.227+0000 7f1726000640 1 -- 172.21.15.2:0/2312282211 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171402ae40 con 0x7f17280cb190 2024-08-17T02:26:43.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.227+0000 7f1726000640 1 -- 172.21.15.2:0/2312282211 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1714032440 con 0x7f17280cb190 2024-08-17T02:26:43.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.227+0000 7f1726000640 1 -- 172.21.15.2:0/2312282211 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17140327e0 con 0x7f17280cb190 2024-08-17T02:26:43.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.228+0000 7f172ca00640 1 -- 172.21.15.2:0/2312282211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17280cb190 msgr2=0x7f17280cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.228+0000 7f172ca00640 1 --2- 172.21.15.2:0/2312282211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17280cb190 0x7f17280cb5c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1714009910 tx=0x7f17140091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.228+0000 7f172ca00640 1 -- 172.21.15.2:0/2312282211 shutdown_connections 2024-08-17T02:26:43.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.228+0000 7f172ca00640 1 --2- 172.21.15.2:0/2312282211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17280cb190 0x7f17280cb5c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.228+0000 7f172ca00640 1 --2- 172.21.15.2:0/2312282211 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1728158a00 0x7f1728158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.228+0000 7f172ca00640 1 -- 172.21.15.2:0/2312282211 >> 172.21.15.2:0/2312282211 conn(0x7f17280cfb80 msgr2=0x7f17280cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:43.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.228+0000 7f172ca00640 1 -- 172.21.15.2:0/2312282211 shutdown_connections 2024-08-17T02:26:43.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.228+0000 7f172ca00640 1 -- 172.21.15.2:0/2312282211 wait complete. 2024-08-17T02:26:43.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.229+0000 7f172ca00640 1 Processor -- start 2024-08-17T02:26:43.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.230+0000 7f172ca00640 1 -- start start 2024-08-17T02:26:43.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.230+0000 7f172ca00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f172806e590 0x7f172816cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.230+0000 7f172ca00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17280cb190 0x7f17280a79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.230+0000 7f172ca00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1728158a00 0x7f17280c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.231+0000 7f172ca00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17280a80f0 con 0x7f1728158a00 2024-08-17T02:26:43.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.231+0000 7f172ca00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17280a8400 con 0x7f172806e590 2024-08-17T02:26:43.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.231+0000 7f172ca00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17280a86e0 con 0x7f17280cb190 2024-08-17T02:26:43.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.231+0000 7f1727e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1728158a00 0x7f17280c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.231+0000 7f1727e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1728158a00 0x7f17280c62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48512/0 (socket says 172.21.15.2:48512) 2024-08-17T02:26:43.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.231+0000 7f1727e00640 1 -- 172.21.15.2:0/1105668191 learned_addr learned my addr 172.21.15.2:0/1105668191 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:43.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.231+0000 7f1727400640 1 --2- 172.21.15.2:0/1105668191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f172806e590 0x7f172816cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.231+0000 7f1726a00640 1 --2- 172.21.15.2:0/1105668191 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17280cb190 0x7f17280a79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.231+0000 7f1727e00640 1 -- 172.21.15.2:0/1105668191 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17280cb190 msgr2=0x7f17280a79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.231+0000 7f1727e00640 1 --2- 172.21.15.2:0/1105668191 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17280cb190 0x7f17280a79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.231+0000 7f1727e00640 1 -- 172.21.15.2:0/1105668191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f172806e590 msgr2=0x7f172816cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.231+0000 7f1727e00640 1 --2- 172.21.15.2:0/1105668191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f172806e590 0x7f172816cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.231+0000 7f1727e00640 1 -- 172.21.15.2:0/1105668191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1714009450 con 0x7f1728158a00 2024-08-17T02:26:43.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.232+0000 7f1727e00640 1 --2- 172.21.15.2:0/1105668191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1728158a00 0x7f17280c62f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f172000c870 tx=0x7f1720001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.232+0000 7f171ea00640 1 -- 172.21.15.2:0/1105668191 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172000ce60 con 0x7f1728158a00 2024-08-17T02:26:43.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.232+0000 7f171ea00640 1 -- 172.21.15.2:0/1105668191 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1720005d60 con 0x7f1728158a00 2024-08-17T02:26:43.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.232+0000 7f171ea00640 1 -- 172.21.15.2:0/1105668191 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172000a890 con 0x7f1728158a00 2024-08-17T02:26:43.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.232+0000 7f172ca00640 1 -- 172.21.15.2:0/1105668191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17280a89c0 con 0x7f1728158a00 2024-08-17T02:26:43.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.232+0000 7f172ca00640 1 -- 172.21.15.2:0/1105668191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17280c6830 con 0x7f1728158a00 2024-08-17T02:26:43.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.233+0000 7f172ca00640 1 -- 172.21.15.2:0/1105668191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1728070720 con 0x7f1728158a00 2024-08-17T02:26:43.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.234+0000 7f171ea00640 1 -- 172.21.15.2:0/1105668191 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f172000acc0 con 0x7f1728158a00 2024-08-17T02:26:43.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.235+0000 7f171ea00640 1 --2- 172.21.15.2:0/1105668191 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1708065150 0x7f1708067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.235+0000 7f171ea00640 1 -- 172.21.15.2:0/1105668191 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f17200824a0 con 0x7f1728158a00 2024-08-17T02:26:43.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.235+0000 7f1727400640 1 --2- 172.21.15.2:0/1105668191 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1708065150 0x7f1708067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.236+0000 7f1727400640 1 --2- 172.21.15.2:0/1105668191 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1708065150 0x7f1708067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f171800bd40 tx=0x7f1718008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.238+0000 7f171ea00640 1 -- 172.21.15.2:0/1105668191 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1720050270 con 0x7f1728158a00 2024-08-17T02:26:43.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.460+0000 7f172ca00640 1 -- 172.21.15.2:0/1105668191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f17280caa60 con 0x7f1728158a00 2024-08-17T02:26:43.461 INFO:tasks.ceph.mon.a.smithi002.stderr:2024-08-17T02:26:43.461+0000 7f7a23e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:26:43.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.465+0000 7f171ea00640 1 -- 172.21.15.2:0/1105668191 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1720053890 con 0x7f1728158a00 2024-08-17T02:26:43.465 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:26:43.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.467+0000 7f172ca00640 1 -- 172.21.15.2:0/1105668191 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1708065150 msgr2=0x7f1708067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.467+0000 7f172ca00640 1 --2- 172.21.15.2:0/1105668191 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1708065150 0x7f1708067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f171800bd40 tx=0x7f1718008040 comp rx=0 tx=0).stop 2024-08-17T02:26:43.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.467+0000 7f172ca00640 1 -- 172.21.15.2:0/1105668191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1728158a00 msgr2=0x7f17280c62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.467+0000 7f172ca00640 1 --2- 172.21.15.2:0/1105668191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1728158a00 0x7f17280c62f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f172000c870 tx=0x7f1720001630 comp rx=0 tx=0).stop 2024-08-17T02:26:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.467+0000 7f172ca00640 1 -- 172.21.15.2:0/1105668191 shutdown_connections 2024-08-17T02:26:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.467+0000 7f172ca00640 1 --2- 172.21.15.2:0/1105668191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1728158a00 0x7f17280c62f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.467+0000 7f172ca00640 1 --2- 172.21.15.2:0/1105668191 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1708065150 0x7f1708067600 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.467+0000 7f172ca00640 1 --2- 172.21.15.2:0/1105668191 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17280cb190 0x7f17280a79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.467+0000 7f172ca00640 1 --2- 172.21.15.2:0/1105668191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f172806e590 0x7f172816cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.467+0000 7f172ca00640 1 -- 172.21.15.2:0/1105668191 >> 172.21.15.2:0/1105668191 conn(0x7f17280cfb80 msgr2=0x7f17280b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.467+0000 7f172ca00640 1 -- 172.21.15.2:0/1105668191 shutdown_connections 2024-08-17T02:26:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.467+0000 7f172ca00640 1 -- 172.21.15.2:0/1105668191 wait complete. 2024-08-17T02:26:43.476 INFO:tasks.ceph.mds.a.smithi002.stderr: -7186> 2024-08-17T02:24:27.619+0000 7fdea5a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:26:43.483 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:26:43.523 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2024-08-17T02:26:43.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.642+0000 7f3b96200640 1 Processor -- start 2024-08-17T02:26:43.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.642+0000 7f3b96200640 1 -- start start 2024-08-17T02:26:43.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.643+0000 7f3b96200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3b900ad960 0x7f3b9015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.643+0000 7f3b96200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b900add30 0x7f3b90156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.643+0000 7f3b96200640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b9015b5e0 con 0x7f3b900ca050 2024-08-17T02:26:43.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.643+0000 7f3b96200640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b900cb160 con 0x7f3b900ad960 2024-08-17T02:26:43.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.643+0000 7f3b96200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b900b0d10 con 0x7f3b900add30 2024-08-17T02:26:43.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.644+0000 7f3b8f400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3b900ad960 0x7f3b9015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.644+0000 7f3b8fe00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b900add30 0x7f3b90156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.644+0000 7f3b8f400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3b900ad960 0x7f3b9015b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:35314/0 (socket says 172.21.15.2:35314) 2024-08-17T02:26:43.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.644+0000 7f3b8fe00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b900add30 0x7f3b90156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:57264/0 (socket says 172.21.15.2:57264) 2024-08-17T02:26:43.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.644+0000 7f3b8f400640 1 -- 172.21.15.2:0/3755964368 learned_addr learned my addr 172.21.15.2:0/3755964368 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:43.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.644+0000 7f3b8ea00640 1 --1- 172.21.15.2:0/3755964368 >> v1:172.21.15.145:6789/0 conn(0x7f3b900ca050 0x7f3b90156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:35636/0 (socket says 172.21.15.2:35636) 2024-08-17T02:26:43.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.644+0000 7f3b8fe00640 1 -- 172.21.15.2:0/3755964368 >> v2:172.21.15.145:3300/0 conn(0x7f3b900ad960 msgr2=0x7f3b9015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:43.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.644+0000 7f3b8fe00640 1 --2- 172.21.15.2:0/3755964368 >> v2:172.21.15.145:3300/0 conn(0x7f3b900ad960 0x7f3b9015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.644+0000 7f3b8fe00640 1 -- 172.21.15.2:0/3755964368 >> v1:172.21.15.145:6789/0 conn(0x7f3b900ca050 legacy=0x7f3b90156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.644+0000 7f3b8e000640 1 -- 172.21.15.2:0/3755964368 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1752519374 0 0) 0x7f3b7c001110 con 0x7f3b900ca050 2024-08-17T02:26:43.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.644+0000 7f3b8fe00640 1 -- 172.21.15.2:0/3755964368 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b900ca550 con 0x7f3b900add30 2024-08-17T02:26:43.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.644+0000 7f3b8f400640 1 --2- 172.21.15.2:0/3755964368 >> v2:172.21.15.145:3300/0 conn(0x7f3b900ad960 0x7f3b9015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:43.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.645+0000 7f3b8fe00640 1 --2- 172.21.15.2:0/3755964368 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b900add30 0x7f3b90156b30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3b88009e60 tx=0x7f3b88009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54d135af12f36f2f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.646+0000 7f3b8e000640 1 -- 172.21.15.2:0/3755964368 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b88007550 con 0x7f3b900add30 2024-08-17T02:26:43.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.646+0000 7f3b8e000640 1 -- 172.21.15.2:0/3755964368 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8802d050 con 0x7f3b900add30 2024-08-17T02:26:43.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.646+0000 7f3b8e000640 1 -- 172.21.15.2:0/3755964368 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b88007900 con 0x7f3b900add30 2024-08-17T02:26:43.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.646+0000 7f3b96200640 1 -- 172.21.15.2:0/3755964368 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b900add30 msgr2=0x7f3b90156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.646+0000 7f3b96200640 1 --2- 172.21.15.2:0/3755964368 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b900add30 0x7f3b90156b30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3b88009e60 tx=0x7f3b88009780 comp rx=0 tx=0).stop 2024-08-17T02:26:43.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.646+0000 7f3b96200640 1 -- 172.21.15.2:0/3755964368 shutdown_connections 2024-08-17T02:26:43.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.646+0000 7f3b96200640 1 --2- 172.21.15.2:0/3755964368 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b900add30 0x7f3b90156b30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.646+0000 7f3b96200640 1 --2- 172.21.15.2:0/3755964368 >> v2:172.21.15.145:3300/0 conn(0x7f3b900ad960 0x7f3b9015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.646+0000 7f3b96200640 1 -- 172.21.15.2:0/3755964368 >> 172.21.15.2:0/3755964368 conn(0x7f3b90066e60 msgr2=0x7f3b90067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:43.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.647+0000 7f3b96200640 1 -- 172.21.15.2:0/3755964368 shutdown_connections 2024-08-17T02:26:43.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.647+0000 7f3b96200640 1 -- 172.21.15.2:0/3755964368 wait complete. 2024-08-17T02:26:43.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.648+0000 7f3b96200640 1 Processor -- start 2024-08-17T02:26:43.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.649+0000 7f3b96200640 1 -- start start 2024-08-17T02:26:43.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.649+0000 7f3b96200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b900ad960 0x7f3b90153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.649+0000 7f3b96200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b900add30 0x7f3b900ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.649+0000 7f3b96200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b900ca050 0x7f3b9014b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.649+0000 7f3b96200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9014ccf0 con 0x7f3b900ad960 2024-08-17T02:26:43.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.649+0000 7f3b96200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b900aca40 con 0x7f3b900ca050 2024-08-17T02:26:43.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.649+0000 7f3b96200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b900abe30 con 0x7f3b900add30 2024-08-17T02:26:43.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.650+0000 7f3b8f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b900ad960 0x7f3b90153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.650+0000 7f3b8f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b900ad960 0x7f3b90153370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48548/0 (socket says 172.21.15.2:48548) 2024-08-17T02:26:43.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.650+0000 7f3b8f400640 1 -- 172.21.15.2:0/2462019339 learned_addr learned my addr 172.21.15.2:0/2462019339 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:43.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.650+0000 7f3b8fe00640 1 --2- 172.21.15.2:0/2462019339 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b900ca050 0x7f3b9014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.650+0000 7f3b8ea00640 1 --2- 172.21.15.2:0/2462019339 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b900add30 0x7f3b900ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.650+0000 7f3b8f400640 1 -- 172.21.15.2:0/2462019339 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b900add30 msgr2=0x7f3b900ab4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.650+0000 7f3b8f400640 1 --2- 172.21.15.2:0/2462019339 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b900add30 0x7f3b900ab4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.650+0000 7f3b8f400640 1 -- 172.21.15.2:0/2462019339 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b900ca050 msgr2=0x7f3b9014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.650+0000 7f3b8f400640 1 --2- 172.21.15.2:0/2462019339 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b900ca050 0x7f3b9014b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.650+0000 7f3b8f400640 1 -- 172.21.15.2:0/2462019339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b80009450 con 0x7f3b900ad960 2024-08-17T02:26:43.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.651+0000 7f3b8f400640 1 --2- 172.21.15.2:0/2462019339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b900ad960 0x7f3b90153370 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3b8000ea30 tx=0x7f3b800091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.651+0000 7f3b86a00640 1 -- 172.21.15.2:0/2462019339 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8000ca10 con 0x7f3b900ad960 2024-08-17T02:26:43.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.651+0000 7f3b86a00640 1 -- 172.21.15.2:0/2462019339 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8000cb70 con 0x7f3b900ad960 2024-08-17T02:26:43.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.651+0000 7f3b96200640 1 -- 172.21.15.2:0/2462019339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b88009a20 con 0x7f3b900ad960 2024-08-17T02:26:43.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.651+0000 7f3b86a00640 1 -- 172.21.15.2:0/2462019339 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b80013470 con 0x7f3b900ad960 2024-08-17T02:26:43.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.651+0000 7f3b96200640 1 -- 172.21.15.2:0/2462019339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b900ac3f0 con 0x7f3b900ad960 2024-08-17T02:26:43.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.652+0000 7f3b96200640 1 -- 172.21.15.2:0/2462019339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b90063fb0 con 0x7f3b900ad960 2024-08-17T02:26:43.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.653+0000 7f3b86a00640 1 -- 172.21.15.2:0/2462019339 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3b80013820 con 0x7f3b900ad960 2024-08-17T02:26:43.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.654+0000 7f3b86a00640 1 --2- 172.21.15.2:0/2462019339 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3b70065150 0x7f3b70067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.654+0000 7f3b86a00640 1 -- 172.21.15.2:0/2462019339 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f3b80082c70 con 0x7f3b900ad960 2024-08-17T02:26:43.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.654+0000 7f3b8ea00640 1 --2- 172.21.15.2:0/2462019339 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3b70065150 0x7f3b70067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.655+0000 7f3b8ea00640 1 --2- 172.21.15.2:0/2462019339 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3b70065150 0x7f3b70067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3b900c9980 tx=0x7f3b7c0079a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.658+0000 7f3b86a00640 1 -- 172.21.15.2:0/2462019339 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3b800508b0 con 0x7f3b900ad960 2024-08-17T02:26:43.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:43.879+0000 7f3b96200640 1 -- 172.21.15.2:0/2462019339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3b900cb5a0 con 0x7f3b900ad960 2024-08-17T02:26:44.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.469+0000 7f3b86a00640 1 -- 172.21.15.2:0/2462019339 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3b80053ed0 con 0x7f3b900ad960 2024-08-17T02:26:44.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.472+0000 7f3b96200640 1 -- 172.21.15.2:0/2462019339 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3b70065150 msgr2=0x7f3b70067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.472+0000 7f3b96200640 1 --2- 172.21.15.2:0/2462019339 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3b70065150 0x7f3b70067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3b900c9980 tx=0x7f3b7c0079a0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.472+0000 7f3b96200640 1 -- 172.21.15.2:0/2462019339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b900ad960 msgr2=0x7f3b90153370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.472+0000 7f3b96200640 1 --2- 172.21.15.2:0/2462019339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b900ad960 0x7f3b90153370 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3b8000ea30 tx=0x7f3b800091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.472+0000 7f3b96200640 1 -- 172.21.15.2:0/2462019339 shutdown_connections 2024-08-17T02:26:44.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.472+0000 7f3b96200640 1 --2- 172.21.15.2:0/2462019339 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b900ca050 0x7f3b9014b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.472+0000 7f3b96200640 1 --2- 172.21.15.2:0/2462019339 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3b70065150 0x7f3b70067600 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.472+0000 7f3b96200640 1 --2- 172.21.15.2:0/2462019339 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b900add30 0x7f3b900ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.472+0000 7f3b96200640 1 --2- 172.21.15.2:0/2462019339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b900ad960 0x7f3b90153370 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.472+0000 7f3b96200640 1 -- 172.21.15.2:0/2462019339 >> 172.21.15.2:0/2462019339 conn(0x7f3b90066e60 msgr2=0x7f3b9006d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:44.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.473+0000 7f3b96200640 1 -- 172.21.15.2:0/2462019339 shutdown_connections 2024-08-17T02:26:44.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.473+0000 7f3b96200640 1 -- 172.21.15.2:0/2462019339 wait complete. 2024-08-17T02:26:44.490 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:26:44.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.689+0000 7f3627000640 1 Processor -- start 2024-08-17T02:26:44.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.690+0000 7f3627000640 1 -- start start 2024-08-17T02:26:44.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.691+0000 7f3627000640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f36201556c0 0x7f3620159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.691+0000 7f3627000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36200c8f20 con 0x7f3620155a90 2024-08-17T02:26:44.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.691+0000 7f3627000640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36201599b0 con 0x7f36200ad430 2024-08-17T02:26:44.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.691+0000 7f3627000640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3620159c50 con 0x7f36201556c0 2024-08-17T02:26:44.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.691+0000 7f3625200640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3620155a90 0x7f36200acd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55558/0 (socket says 172.21.15.2:55558) 2024-08-17T02:26:44.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.691+0000 7f3625200640 1 -- 172.21.15.2:0/3660027880 learned_addr learned my addr 172.21.15.2:0/3660027880 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:26:44.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.692+0000 7f361fe00640 1 -- 172.21.15.2:0/3660027880 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710380682 0 0) 0x7f36200c8f20 con 0x7f3620155a90 2024-08-17T02:26:44.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.692+0000 7f361fe00640 1 -- 172.21.15.2:0/3660027880 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36080034e0 con 0x7f3620155a90 2024-08-17T02:26:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.692+0000 7f3625c00640 1 --2- 172.21.15.2:0/3660027880 >> v2:172.21.15.145:3300/0 conn(0x7f36201556c0 0x7f3620159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.692+0000 7f361fe00640 1 -- 172.21.15.2:0/3660027880 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2542885301 0 0) 0x7f36201599b0 con 0x7f36200ad430 2024-08-17T02:26:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.692+0000 7f361fe00640 1 -- 172.21.15.2:0/3660027880 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36200c8f20 con 0x7f36200ad430 2024-08-17T02:26:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.692+0000 7f361fe00640 1 -- 172.21.15.2:0/3660027880 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3189034309 0 0) 0x7f36080034e0 con 0x7f3620155a90 2024-08-17T02:26:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.692+0000 7f361fe00640 1 -- 172.21.15.2:0/3660027880 >> v2:172.21.15.145:3300/0 conn(0x7f36201556c0 msgr2=0x7f3620159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.692+0000 7f361fe00640 1 --2- 172.21.15.2:0/3660027880 >> v2:172.21.15.145:3300/0 conn(0x7f36201556c0 0x7f3620159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.692+0000 7f361fe00640 1 -- 172.21.15.2:0/3660027880 >> v1:172.21.15.145:6789/0 conn(0x7f36200ad430 legacy=0x7f36200c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.692+0000 7f361fe00640 1 -- 172.21.15.2:0/3660027880 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3620159f30 con 0x7f3620155a90 2024-08-17T02:26:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.692+0000 7f361fe00640 1 -- 172.21.15.2:0/3660027880 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7f360c001470 con 0x7f3620155a90 2024-08-17T02:26:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.692+0000 7f361fe00640 1 -- 172.21.15.2:0/3660027880 >> v1:172.21.15.2:6789/0 conn(0x7f3620155a90 legacy=0x7f36200acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.692+0000 7f361fe00640 1 --2- 172.21.15.2:0/3660027880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3608003bb0 0x7f3608003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.692+0000 7f361fe00640 1 --2- 172.21.15.2:0/3660027880 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3608004780 0x7f3608004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.692+0000 7f361fe00640 1 --2- 172.21.15.2:0/3660027880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3608005180 0x7f360800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.692+0000 7f361fe00640 1 -- 172.21.15.2:0/3660027880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3620159c50 con 0x7f3608005180 2024-08-17T02:26:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.692+0000 7f361fe00640 1 -- 172.21.15.2:0/3660027880 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360800c120 con 0x7f3608003bb0 2024-08-17T02:26:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.692+0000 7f361fe00640 1 -- 172.21.15.2:0/3660027880 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360800e4f0 con 0x7f3608004780 2024-08-17T02:26:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.692+0000 7f3626600640 1 --2- 172.21.15.2:0/3660027880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3608005180 0x7f360800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.693+0000 7f3625c00640 1 --2- 172.21.15.2:0/3660027880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3608003bb0 0x7f3608003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.693+0000 7f3625200640 1 --2- 172.21.15.2:0/3660027880 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3608004780 0x7f3608004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.693+0000 7f3626600640 1 -- 172.21.15.2:0/3660027880 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3608004780 msgr2=0x7f3608004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.693+0000 7f3626600640 1 --2- 172.21.15.2:0/3660027880 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3608004780 0x7f3608004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.693+0000 7f3626600640 1 -- 172.21.15.2:0/3660027880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3608003bb0 msgr2=0x7f3608003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.693+0000 7f3626600640 1 --2- 172.21.15.2:0/3660027880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3608003bb0 0x7f3608003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.693+0000 7f3626600640 1 -- 172.21.15.2:0/3660027880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36080034e0 con 0x7f3608005180 2024-08-17T02:26:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.694+0000 7f3626600640 1 -- 172.21.15.2:0/3660027880 reap_dead start 2024-08-17T02:26:44.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.694+0000 7f3626600640 1 --2- 172.21.15.2:0/3660027880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3608005180 0x7f360800b9d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f362006d870 tx=0x7f3618007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f5f79b16d038c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.694+0000 7f361fe00640 1 -- 172.21.15.2:0/3660027880 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3618031440 con 0x7f3608005180 2024-08-17T02:26:44.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.694+0000 7f361fe00640 1 -- 172.21.15.2:0/3660027880 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361802d050 con 0x7f3608005180 2024-08-17T02:26:44.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.694+0000 7f361fe00640 1 -- 172.21.15.2:0/3660027880 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36180317f0 con 0x7f3608005180 2024-08-17T02:26:44.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.695+0000 7f3627000640 1 -- 172.21.15.2:0/3660027880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3608005180 msgr2=0x7f360800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.695+0000 7f3627000640 1 --2- 172.21.15.2:0/3660027880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3608005180 0x7f360800b9d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f362006d870 tx=0x7f3618007f90 comp rx=0 tx=0).stop 2024-08-17T02:26:44.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.695+0000 7f3627000640 1 -- 172.21.15.2:0/3660027880 shutdown_connections 2024-08-17T02:26:44.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.695+0000 7f3627000640 1 --2- 172.21.15.2:0/3660027880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3608005180 0x7f360800b9d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.695+0000 7f3627000640 1 -- 172.21.15.2:0/3660027880 >> 172.21.15.2:0/3660027880 conn(0x7f3620066e60 msgr2=0x7f3620067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:44.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.695+0000 7f3627000640 1 -- 172.21.15.2:0/3660027880 shutdown_connections 2024-08-17T02:26:44.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.695+0000 7f3627000640 1 -- 172.21.15.2:0/3660027880 wait complete. 2024-08-17T02:26:44.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.696+0000 7f3627000640 1 Processor -- start 2024-08-17T02:26:44.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.696+0000 7f3627000640 1 -- start start 2024-08-17T02:26:44.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.697+0000 7f3627000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3608005180 0x7f3620158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.697+0000 7f3627000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36201531c0 0x7f3620164e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.697+0000 7f3627000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3620165390 0x7f3620165800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.697+0000 7f3627000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3620165d40 con 0x7f3608005180 2024-08-17T02:26:44.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.697+0000 7f3627000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3620154370 con 0x7f36201531c0 2024-08-17T02:26:44.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.697+0000 7f3627000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3620154800 con 0x7f3620165390 2024-08-17T02:26:44.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.697+0000 7f3625c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3608005180 0x7f3620158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.698+0000 7f3625c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3608005180 0x7f3620158910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48570/0 (socket says 172.21.15.2:48570) 2024-08-17T02:26:44.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.698+0000 7f3625c00640 1 -- 172.21.15.2:0/3146840581 learned_addr learned my addr 172.21.15.2:0/3146840581 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:44.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.698+0000 7f3625200640 1 --2- 172.21.15.2:0/3146840581 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36201531c0 0x7f3620164e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.698+0000 7f3626600640 1 --2- 172.21.15.2:0/3146840581 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3620165390 0x7f3620165800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.698+0000 7f3625c00640 1 -- 172.21.15.2:0/3146840581 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3620165390 msgr2=0x7f3620165800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.698+0000 7f3625c00640 1 --2- 172.21.15.2:0/3146840581 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3620165390 0x7f3620165800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.698+0000 7f3625c00640 1 -- 172.21.15.2:0/3146840581 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36201531c0 msgr2=0x7f3620164e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.698+0000 7f3625c00640 1 --2- 172.21.15.2:0/3146840581 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36201531c0 0x7f3620164e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.698+0000 7f3625c00640 1 -- 172.21.15.2:0/3146840581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3620153760 con 0x7f3608005180 2024-08-17T02:26:44.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.698+0000 7f3625200640 1 --2- 172.21.15.2:0/3146840581 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36201531c0 0x7f3620164e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:44.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.698+0000 7f3625c00640 1 --2- 172.21.15.2:0/3146840581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3608005180 0x7f3620158910 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3614011a60 tx=0x7f36140090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.698+0000 7f361cc00640 1 -- 172.21.15.2:0/3146840581 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361400fb00 con 0x7f3608005180 2024-08-17T02:26:44.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.699+0000 7f361cc00640 1 -- 172.21.15.2:0/3146840581 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361400fc60 con 0x7f3608005180 2024-08-17T02:26:44.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.699+0000 7f3627000640 1 -- 172.21.15.2:0/3146840581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3620153a40 con 0x7f3608005180 2024-08-17T02:26:44.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.699+0000 7f361cc00640 1 -- 172.21.15.2:0/3146840581 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3614014440 con 0x7f3608005180 2024-08-17T02:26:44.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.699+0000 7f3627000640 1 -- 172.21.15.2:0/3146840581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3620154000 con 0x7f3608005180 2024-08-17T02:26:44.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.700+0000 7f3627000640 1 -- 172.21.15.2:0/3146840581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3620063f10 con 0x7f3608005180 2024-08-17T02:26:44.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.700+0000 7f361cc00640 1 -- 172.21.15.2:0/3146840581 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3614014870 con 0x7f3608005180 2024-08-17T02:26:44.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.701+0000 7f361cc00640 1 --2- 172.21.15.2:0/3146840581 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3600065150 0x7f3600067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.701+0000 7f361cc00640 1 -- 172.21.15.2:0/3146840581 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f3614018030 con 0x7f3608005180 2024-08-17T02:26:44.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.702+0000 7f3625200640 1 --2- 172.21.15.2:0/3146840581 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3600065150 0x7f3600067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.702+0000 7f3625200640 1 --2- 172.21.15.2:0/3146840581 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3600065150 0x7f3600067600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f360c000e10 tx=0x7f360c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.705+0000 7f361cc00640 1 -- 172.21.15.2:0/3146840581 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3614050fa0 con 0x7f3608005180 2024-08-17T02:26:44.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:44.890+0000 7f3627000640 1 -- 172.21.15.2:0/3146840581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f362006eb50 con 0x7f3608005180 2024-08-17T02:26:45.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.471+0000 7f361cc00640 1 -- 172.21.15.2:0/3146840581 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) v1 ==== 181+0+0 (secure 0 0 0) 0x7f36140545c0 con 0x7f3608005180 2024-08-17T02:26:45.472 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:26:45.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.474+0000 7f3627000640 1 -- 172.21.15.2:0/3146840581 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3600065150 msgr2=0x7f3600067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.474+0000 7f3627000640 1 --2- 172.21.15.2:0/3146840581 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3600065150 0x7f3600067600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f360c000e10 tx=0x7f360c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:45.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.474+0000 7f3627000640 1 -- 172.21.15.2:0/3146840581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3608005180 msgr2=0x7f3620158910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.474+0000 7f3627000640 1 --2- 172.21.15.2:0/3146840581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3608005180 0x7f3620158910 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3614011a60 tx=0x7f36140090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.474+0000 7f3627000640 1 -- 172.21.15.2:0/3146840581 shutdown_connections 2024-08-17T02:26:45.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.474+0000 7f3627000640 1 --2- 172.21.15.2:0/3146840581 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3600065150 0x7f3600067600 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.474+0000 7f3627000640 1 --2- 172.21.15.2:0/3146840581 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3620165390 0x7f3620165800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.474+0000 7f3627000640 1 --2- 172.21.15.2:0/3146840581 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36201531c0 0x7f3620164e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.474+0000 7f3627000640 1 --2- 172.21.15.2:0/3146840581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3608005180 0x7f3620158910 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.474+0000 7f3627000640 1 -- 172.21.15.2:0/3146840581 >> 172.21.15.2:0/3146840581 conn(0x7f3620066e60 msgr2=0x7f36200ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:45.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.474+0000 7f3627000640 1 -- 172.21.15.2:0/3146840581 shutdown_connections 2024-08-17T02:26:45.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.474+0000 7f3627000640 1 -- 172.21.15.2:0/3146840581 wait complete. 2024-08-17T02:26:45.492 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:26:45.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.651+0000 7f8d75600640 1 Processor -- start 2024-08-17T02:26:45.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.651+0000 7f8d75600640 1 -- start start 2024-08-17T02:26:45.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.652+0000 7f8d75600640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8d700add70 0x7f8d700ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.652+0000 7f8d75600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d701582b0 con 0x7f8d700aed30 2024-08-17T02:26:45.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.652+0000 7f8d75600640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d700ca110 con 0x7f8d70156a90 2024-08-17T02:26:45.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.652+0000 7f8d75600640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d700c9f80 con 0x7f8d700add70 2024-08-17T02:26:45.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.652+0000 7f8d6f400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8d700aed30 0x7f8d700ca5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35878/0 (socket says 172.21.15.2:35878) 2024-08-17T02:26:45.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.652+0000 7f8d6f400640 1 -- 172.21.15.2:0/470881202 learned_addr learned my addr 172.21.15.2:0/470881202 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:26:45.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.653+0000 7f8d6e000640 1 --2- 172.21.15.2:0/470881202 >> v2:172.21.15.145:3300/0 conn(0x7f8d700add70 0x7f8d700ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.653+0000 7f8d6d600640 1 -- 172.21.15.2:0/470881202 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693361221 0 0) 0x7f8d701582b0 con 0x7f8d700aed30 2024-08-17T02:26:45.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.653+0000 7f8d6d600640 1 -- 172.21.15.2:0/470881202 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d540034e0 con 0x7f8d700aed30 2024-08-17T02:26:45.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.653+0000 7f8d6e000640 1 -- 172.21.15.2:0/470881202 >> v1:172.21.15.145:6789/0 conn(0x7f8d70156a90 legacy=0x7f8d700ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.653+0000 7f8d6e000640 1 -- 172.21.15.2:0/470881202 >> v1:172.21.15.2:6789/0 conn(0x7f8d700aed30 legacy=0x7f8d700ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.653+0000 7f8d6e000640 1 -- 172.21.15.2:0/470881202 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d700af4b0 con 0x7f8d700add70 2024-08-17T02:26:45.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.654+0000 7f8d6e000640 1 --2- 172.21.15.2:0/470881202 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d700add70 0x7f8d700ae7f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009850 tx=0x7f8d5c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=672a1bf4de7be43d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:45.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.655+0000 7f8d6d600640 1 -- 172.21.15.2:0/470881202 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c02ae20 con 0x7f8d700add70 2024-08-17T02:26:45.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.655+0000 7f8d6d600640 1 -- 172.21.15.2:0/470881202 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c032440 con 0x7f8d700add70 2024-08-17T02:26:45.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.655+0000 7f8d6d600640 1 -- 172.21.15.2:0/470881202 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c0327e0 con 0x7f8d700add70 2024-08-17T02:26:45.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.655+0000 7f8d75600640 1 -- 172.21.15.2:0/470881202 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d700add70 msgr2=0x7f8d700ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.655+0000 7f8d75600640 1 --2- 172.21.15.2:0/470881202 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d700add70 0x7f8d700ae7f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009850 tx=0x7f8d5c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.655+0000 7f8d75600640 1 -- 172.21.15.2:0/470881202 shutdown_connections 2024-08-17T02:26:45.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.655+0000 7f8d75600640 1 --2- 172.21.15.2:0/470881202 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d700add70 0x7f8d700ae7f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.655+0000 7f8d75600640 1 -- 172.21.15.2:0/470881202 >> 172.21.15.2:0/470881202 conn(0x7f8d70066e60 msgr2=0x7f8d70067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:45.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.655+0000 7f8d75600640 1 -- 172.21.15.2:0/470881202 shutdown_connections 2024-08-17T02:26:45.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.655+0000 7f8d75600640 1 -- 172.21.15.2:0/470881202 wait complete. 2024-08-17T02:26:45.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.657+0000 7f8d75600640 1 Processor -- start 2024-08-17T02:26:45.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.657+0000 7f8d75600640 1 -- start start 2024-08-17T02:26:45.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.658+0000 7f8d75600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d700add70 0x7f8d70159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.658+0000 7f8d75600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d700aed30 0x7f8d700c0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.658+0000 7f8d75600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8d70156a90 0x7f8d701528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.658+0000 7f8d75600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d70159870 con 0x7f8d700aed30 2024-08-17T02:26:45.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.658+0000 7f8d75600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d70158c60 con 0x7f8d700add70 2024-08-17T02:26:45.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.658+0000 7f8d75600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d70158f40 con 0x7f8d70156a90 2024-08-17T02:26:45.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.658+0000 7f8d6e000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d700aed30 0x7f8d700c0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.658+0000 7f8d6e000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d700aed30 0x7f8d700c0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57550/0 (socket says 172.21.15.2:57550) 2024-08-17T02:26:45.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.658+0000 7f8d6e000640 1 -- 172.21.15.2:0/1759138280 learned_addr learned my addr 172.21.15.2:0/1759138280 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:45.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.658+0000 7f8d6ea00640 1 --2- 172.21.15.2:0/1759138280 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d700add70 0x7f8d70159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.658+0000 7f8d6f400640 1 --2- 172.21.15.2:0/1759138280 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8d70156a90 0x7f8d701528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.659+0000 7f8d6e000640 1 -- 172.21.15.2:0/1759138280 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8d70156a90 msgr2=0x7f8d701528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.659+0000 7f8d6e000640 1 --2- 172.21.15.2:0/1759138280 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8d70156a90 0x7f8d701528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.659+0000 7f8d6e000640 1 -- 172.21.15.2:0/1759138280 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d700add70 msgr2=0x7f8d70159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.659+0000 7f8d6e000640 1 --2- 172.21.15.2:0/1759138280 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d700add70 0x7f8d70159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.659+0000 7f8d6e000640 1 -- 172.21.15.2:0/1759138280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5c009390 con 0x7f8d700aed30 2024-08-17T02:26:45.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.659+0000 7f8d6e000640 1 --2- 172.21.15.2:0/1759138280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d700aed30 0x7f8d700c0970 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009360 tx=0x7f8d5c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:45.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.659+0000 7f8d66000640 1 -- 172.21.15.2:0/1759138280 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c000d10 con 0x7f8d700aed30 2024-08-17T02:26:45.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.659+0000 7f8d66000640 1 -- 172.21.15.2:0/1759138280 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c031e00 con 0x7f8d700aed30 2024-08-17T02:26:45.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.659+0000 7f8d66000640 1 -- 172.21.15.2:0/1759138280 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c03d650 con 0x7f8d700aed30 2024-08-17T02:26:45.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.659+0000 7f8d75600640 1 -- 172.21.15.2:0/1759138280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d70159220 con 0x7f8d700aed30 2024-08-17T02:26:45.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.659+0000 7f8d75600640 1 -- 172.21.15.2:0/1759138280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d7015a240 con 0x7f8d700aed30 2024-08-17T02:26:45.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.660+0000 7f8d75600640 1 -- 172.21.15.2:0/1759138280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d701599e0 con 0x7f8d700aed30 2024-08-17T02:26:45.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.661+0000 7f8d66000640 1 -- 172.21.15.2:0/1759138280 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8d5c039040 con 0x7f8d700aed30 2024-08-17T02:26:45.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.662+0000 7f8d66000640 1 --2- 172.21.15.2:0/1759138280 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8d50065150 0x7f8d50067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.662+0000 7f8d66000640 1 -- 172.21.15.2:0/1759138280 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6251+0+0 (secure 0 0 0) 0x7f8d5c0a2590 con 0x7f8d700aed30 2024-08-17T02:26:45.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.662+0000 7f8d6ea00640 1 --2- 172.21.15.2:0/1759138280 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8d50065150 0x7f8d50067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.663+0000 7f8d6ea00640 1 --2- 172.21.15.2:0/1759138280 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8d50065150 0x7f8d50067600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8d700c3190 tx=0x7f8d60009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:45.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.666+0000 7f8d66000640 1 -- 172.21.15.2:0/1759138280 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8d5c070440 con 0x7f8d700aed30 2024-08-17T02:26:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:45.848+0000 7f8d75600640 1 -- 172.21.15.2:0/1759138280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8d70063fb0 con 0x7f8d700aed30 2024-08-17T02:26:46.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.476+0000 7f8d66000640 1 -- 172.21.15.2:0/1759138280 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8d5c073a60 con 0x7f8d700aed30 2024-08-17T02:26:46.478 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2024-08-17T02:26:46.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.479+0000 7f8d75600640 1 -- 172.21.15.2:0/1759138280 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8d50065150 msgr2=0x7f8d50067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.479+0000 7f8d75600640 1 --2- 172.21.15.2:0/1759138280 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8d50065150 0x7f8d50067600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8d700c3190 tx=0x7f8d60009040 comp rx=0 tx=0).stop 2024-08-17T02:26:46.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.479+0000 7f8d75600640 1 -- 172.21.15.2:0/1759138280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d700aed30 msgr2=0x7f8d700c0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.479+0000 7f8d75600640 1 --2- 172.21.15.2:0/1759138280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d700aed30 0x7f8d700c0970 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009360 tx=0x7f8d5c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:46.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.479+0000 7f8d75600640 1 -- 172.21.15.2:0/1759138280 shutdown_connections 2024-08-17T02:26:46.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.479+0000 7f8d75600640 1 --2- 172.21.15.2:0/1759138280 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8d50065150 0x7f8d50067600 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.479+0000 7f8d75600640 1 --2- 172.21.15.2:0/1759138280 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8d70156a90 0x7f8d701528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.479+0000 7f8d75600640 1 --2- 172.21.15.2:0/1759138280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d700aed30 0x7f8d700c0970 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.479+0000 7f8d75600640 1 --2- 172.21.15.2:0/1759138280 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d700add70 0x7f8d70159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.479+0000 7f8d75600640 1 -- 172.21.15.2:0/1759138280 >> 172.21.15.2:0/1759138280 conn(0x7f8d70066e60 msgr2=0x7f8d701549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.479+0000 7f8d75600640 1 -- 172.21.15.2:0/1759138280 shutdown_connections 2024-08-17T02:26:46.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.479+0000 7f8d75600640 1 -- 172.21.15.2:0/1759138280 wait complete. 2024-08-17T02:26:46.497 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:46.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.650+0000 7effb6c00640 1 Processor -- start 2024-08-17T02:26:46.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.650+0000 7effb6c00640 1 -- start start 2024-08-17T02:26:46.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.651+0000 7effb6c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7effb00afca0 0x7effb00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.651+0000 7effb6c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7effb00acf10 0x7effb0159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.651+0000 7effb6c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb015a4e0 con 0x7effb01589a0 2024-08-17T02:26:46.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.651+0000 7effb6c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb00b0980 con 0x7effb00acf10 2024-08-17T02:26:46.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.651+0000 7effb6c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb00c92b0 con 0x7effb00afca0 2024-08-17T02:26:46.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.651+0000 7effa7e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7effb00acf10 0x7effb0159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.651+0000 7effb4c00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7effb01589a0 0x7effb006d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35892/0 (socket says 172.21.15.2:35892) 2024-08-17T02:26:46.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.651+0000 7effa7e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7effb00acf10 0x7effb0159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57556/0 (socket says 172.21.15.2:57556) 2024-08-17T02:26:46.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.651+0000 7effb4c00640 1 -- 172.21.15.2:0/1243375092 learned_addr learned my addr 172.21.15.2:0/1243375092 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:26:46.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.651+0000 7effafe00640 1 --2- 172.21.15.2:0/1243375092 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7effb00afca0 0x7effb00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.652+0000 7effa7e00640 1 -- 172.21.15.2:0/1243375092 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7effb00afca0 msgr2=0x7effb00b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:46.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.652+0000 7effa7e00640 1 --2- 172.21.15.2:0/1243375092 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7effb00afca0 0x7effb00b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.652+0000 7effa7e00640 1 -- 172.21.15.2:0/1243375092 >> v1:172.21.15.2:6789/0 conn(0x7effb01589a0 legacy=0x7effb006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.652+0000 7effa7e00640 1 -- 172.21.15.2:0/1243375092 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb00ad480 con 0x7effb00acf10 2024-08-17T02:26:46.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.652+0000 7effaf400640 1 -- 172.21.15.2:0/1243375092 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216348730 0 0) 0x7effa8001490 con 0x7effb01589a0 2024-08-17T02:26:46.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.653+0000 7effa7e00640 1 --2- 172.21.15.2:0/1243375092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effb00acf10 0x7effb0159fa0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7eff98009880 tx=0x7eff980090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd57d472ad1d11a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.653+0000 7effaf400640 1 -- 172.21.15.2:0/1243375092 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9802ad90 con 0x7effb00acf10 2024-08-17T02:26:46.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.653+0000 7effaf400640 1 -- 172.21.15.2:0/1243375092 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff98032440 con 0x7effb00acf10 2024-08-17T02:26:46.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.653+0000 7effaf400640 1 -- 172.21.15.2:0/1243375092 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff980327e0 con 0x7effb00acf10 2024-08-17T02:26:46.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.653+0000 7effb6c00640 1 -- 172.21.15.2:0/1243375092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effb00acf10 msgr2=0x7effb0159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.653+0000 7effb6c00640 1 --2- 172.21.15.2:0/1243375092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effb00acf10 0x7effb0159fa0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7eff98009880 tx=0x7eff980090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.654+0000 7effb6c00640 1 -- 172.21.15.2:0/1243375092 shutdown_connections 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.654+0000 7effb6c00640 1 --2- 172.21.15.2:0/1243375092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effb00acf10 0x7effb0159fa0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.654+0000 7effb6c00640 1 --2- 172.21.15.2:0/1243375092 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7effb00afca0 0x7effb00b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.654+0000 7effb6c00640 1 -- 172.21.15.2:0/1243375092 >> 172.21.15.2:0/1243375092 conn(0x7effb0066e60 msgr2=0x7effb0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.654+0000 7effb6c00640 1 -- 172.21.15.2:0/1243375092 shutdown_connections 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.654+0000 7effb6c00640 1 -- 172.21.15.2:0/1243375092 wait complete. 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.655+0000 7effb6c00640 1 Processor -- start 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.655+0000 7effb6c00640 1 -- start start 2024-08-17T02:26:46.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.656+0000 7effb6c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effb00acf10 0x7effb015bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.656+0000 7effb6c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7effb00afca0 0x7effb015a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.656+0000 7effb6c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effb01589a0 0x7effb00c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.656+0000 7effb6c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb015b900 con 0x7effb01589a0 2024-08-17T02:26:46.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.656+0000 7effb6c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb015acf0 con 0x7effb00acf10 2024-08-17T02:26:46.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.656+0000 7effb6c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb015afd0 con 0x7effb00afca0 2024-08-17T02:26:46.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.656+0000 7effb4c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effb01589a0 0x7effb00c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.656+0000 7effb4c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effb01589a0 0x7effb00c7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57562/0 (socket says 172.21.15.2:57562) 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.656+0000 7effb4c00640 1 -- 172.21.15.2:0/1574369901 learned_addr learned my addr 172.21.15.2:0/1574369901 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.657+0000 7effafe00640 1 --2- 172.21.15.2:0/1574369901 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effb00acf10 0x7effb015bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.657+0000 7effa7e00640 1 --2- 172.21.15.2:0/1574369901 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7effb00afca0 0x7effb015a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.657+0000 7effb4c00640 1 -- 172.21.15.2:0/1574369901 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7effb00afca0 msgr2=0x7effb015a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.657+0000 7effb4c00640 1 --2- 172.21.15.2:0/1574369901 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7effb00afca0 0x7effb015a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.657+0000 7effb4c00640 1 -- 172.21.15.2:0/1574369901 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effb00acf10 msgr2=0x7effb015bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.657+0000 7effb4c00640 1 --2- 172.21.15.2:0/1574369901 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effb00acf10 0x7effb015bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.657+0000 7effb4c00640 1 -- 172.21.15.2:0/1574369901 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff98009390 con 0x7effb01589a0 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.657+0000 7effb4c00640 1 --2- 172.21.15.2:0/1574369901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effb01589a0 0x7effb00c7230 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7effa800cbf0 tx=0x7effa80019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.658+0000 7effa7400640 1 -- 172.21.15.2:0/1574369901 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa800ce10 con 0x7effb01589a0 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.658+0000 7effa7400640 1 -- 172.21.15.2:0/1574369901 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa800a850 con 0x7effb01589a0 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.658+0000 7effa7400640 1 -- 172.21.15.2:0/1574369901 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa800ac90 con 0x7effb01589a0 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.658+0000 7effb6c00640 1 -- 172.21.15.2:0/1574369901 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb015b2b0 con 0x7effb01589a0 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.658+0000 7effb6c00640 1 -- 172.21.15.2:0/1574369901 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb00c12a0 con 0x7effb01589a0 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.659+0000 7effb6c00640 1 -- 172.21.15.2:0/1574369901 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb015ba70 con 0x7effb01589a0 2024-08-17T02:26:46.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.660+0000 7effa7400640 1 -- 172.21.15.2:0/1574369901 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7effa8007300 con 0x7effb01589a0 2024-08-17T02:26:46.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.660+0000 7effa7400640 1 --2- 172.21.15.2:0/1574369901 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7eff8c065150 0x7eff8c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.660+0000 7effa7400640 1 -- 172.21.15.2:0/1574369901 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7effa8082490 con 0x7effb01589a0 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.661+0000 7effafe00640 1 --2- 172.21.15.2:0/1574369901 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7eff8c065150 0x7eff8c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.661+0000 7effafe00640 1 --2- 172.21.15.2:0/1574369901 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7eff8c065150 0x7eff8c067600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7effa0009d20 tx=0x7effa00090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.664+0000 7effa7400640 1 -- 172.21.15.2:0/1574369901 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7effa80504e0 con 0x7effb01589a0 2024-08-17T02:26:46.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.850+0000 7effb6c00640 1 -- 172.21.15.2:0/1574369901 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effb015a4e0 con 0x7effb01589a0 2024-08-17T02:26:46.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.851+0000 7effa7400640 1 -- 172.21.15.2:0/1574369901 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+15462 (secure 0 0 0) 0x7effb015a4e0 con 0x7effb01589a0 2024-08-17T02:26:46.852 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:26:46.852 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":39,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:26:46.470913+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000001044477.meta","create_time":"2024-08-17T02:24:33.976587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001044477"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001044477.data","create_time":"2024-08-17T02:24:34.827029+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001044477"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6835/3013258535":"2024-08-18T02:26:43.461593+0000","172.21.15.2:6833/3013258535":"2024-08-18T02:26:43.461593+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:46.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.853+0000 7effb6c00640 1 -- 172.21.15.2:0/1574369901 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7eff8c065150 msgr2=0x7eff8c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.853+0000 7effb6c00640 1 --2- 172.21.15.2:0/1574369901 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7eff8c065150 0x7eff8c067600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7effa0009d20 tx=0x7effa00090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.853+0000 7effb6c00640 1 -- 172.21.15.2:0/1574369901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effb01589a0 msgr2=0x7effb00c7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.853+0000 7effb6c00640 1 --2- 172.21.15.2:0/1574369901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effb01589a0 0x7effb00c7230 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7effa800cbf0 tx=0x7effa80019b0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.853+0000 7effb6c00640 1 -- 172.21.15.2:0/1574369901 shutdown_connections 2024-08-17T02:26:46.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.853+0000 7effb6c00640 1 --2- 172.21.15.2:0/1574369901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effb01589a0 0x7effb00c7230 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.853+0000 7effb6c00640 1 --2- 172.21.15.2:0/1574369901 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7eff8c065150 0x7eff8c067600 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.853+0000 7effb6c00640 1 --2- 172.21.15.2:0/1574369901 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7effb00afca0 0x7effb015a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.853+0000 7effb6c00640 1 --2- 172.21.15.2:0/1574369901 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effb00acf10 0x7effb015bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.853+0000 7effb6c00640 1 -- 172.21.15.2:0/1574369901 >> 172.21.15.2:0/1574369901 conn(0x7effb0066e60 msgr2=0x7effb00c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.853+0000 7effb6c00640 1 -- 172.21.15.2:0/1574369901 shutdown_connections 2024-08-17T02:26:46.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:46.853+0000 7effb6c00640 1 -- 172.21.15.2:0/1574369901 wait complete. 2024-08-17T02:26:46.870 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:23:26.107978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000001044477.meta', 'create_time': '2024-08-17T02:24:33.976587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000001044477'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000001044477.data', 'create_time': '2024-08-17T02:24:34.827029+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000001044477'}}}] 2024-08-17T02:26:46.870 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:47.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.023+0000 7fd250800640 1 Processor -- start 2024-08-17T02:26:47.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.023+0000 7fd250800640 1 -- start start 2024-08-17T02:26:47.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.024+0000 7fd250800640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd248156bd0 0x7fd2480b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.024+0000 7fd250800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd2480adf90 0x7fd2480b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.025+0000 7fd250800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2480ac040 con 0x7fd248156fa0 2024-08-17T02:26:47.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.025+0000 7fd250800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd248067810 con 0x7fd2480adf90 2024-08-17T02:26:47.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.025+0000 7fd250800640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2480ab150 con 0x7fd248156bd0 2024-08-17T02:26:47.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.025+0000 7fd24d400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd2480adf90 0x7fd2480b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.025+0000 7fd24d400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd2480adf90 0x7fd2480b10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57576/0 (socket says 172.21.15.2:57576) 2024-08-17T02:26:47.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.025+0000 7fd24d400640 1 -- 172.21.15.2:0/4261536866 learned_addr learned my addr 172.21.15.2:0/4261536866 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:47.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.025+0000 7fd24e800640 1 --1- 172.21.15.2:0/4261536866 >> v1:172.21.15.2:6789/0 conn(0x7fd248156fa0 0x7fd2480ac4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35894/0 (socket says 172.21.15.2:35894) 2024-08-17T02:26:47.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.025+0000 7fd24de00640 1 --2- 172.21.15.2:0/4261536866 >> v2:172.21.15.145:3300/0 conn(0x7fd248156bd0 0x7fd2480b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.025+0000 7fd24d400640 1 -- 172.21.15.2:0/4261536866 >> v2:172.21.15.145:3300/0 conn(0x7fd248156bd0 msgr2=0x7fd2480b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.025+0000 7fd24d400640 1 --2- 172.21.15.2:0/4261536866 >> v2:172.21.15.145:3300/0 conn(0x7fd248156bd0 0x7fd2480b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.025+0000 7fd24d400640 1 -- 172.21.15.2:0/4261536866 >> v1:172.21.15.2:6789/0 conn(0x7fd248156fa0 legacy=0x7fd2480ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.025+0000 7fd24d400640 1 -- 172.21.15.2:0/4261536866 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2480ab430 con 0x7fd2480adf90 2024-08-17T02:26:47.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.026+0000 7fd24d400640 1 --2- 172.21.15.2:0/4261536866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2480adf90 0x7fd2480b10b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd238009910 tx=0x7fd2380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca9cc4fcca6476 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.027+0000 7fd24ca00640 1 -- 172.21.15.2:0/4261536866 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23802ae70 con 0x7fd2480adf90 2024-08-17T02:26:47.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.027+0000 7fd24ca00640 1 -- 172.21.15.2:0/4261536866 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd238032440 con 0x7fd2480adf90 2024-08-17T02:26:47.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.027+0000 7fd24ca00640 1 -- 172.21.15.2:0/4261536866 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd238032820 con 0x7fd2480adf90 2024-08-17T02:26:47.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.027+0000 7fd250800640 1 -- 172.21.15.2:0/4261536866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2480adf90 msgr2=0x7fd2480b10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.027+0000 7fd250800640 1 --2- 172.21.15.2:0/4261536866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2480adf90 0x7fd2480b10b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd238009910 tx=0x7fd2380091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.027+0000 7fd250800640 1 -- 172.21.15.2:0/4261536866 shutdown_connections 2024-08-17T02:26:47.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.027+0000 7fd250800640 1 --2- 172.21.15.2:0/4261536866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2480adf90 0x7fd2480b10b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.027+0000 7fd250800640 1 --2- 172.21.15.2:0/4261536866 >> v2:172.21.15.145:3300/0 conn(0x7fd248156bd0 0x7fd2480b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.027+0000 7fd250800640 1 -- 172.21.15.2:0/4261536866 >> 172.21.15.2:0/4261536866 conn(0x7fd2480cc390 msgr2=0x7fd248066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.027+0000 7fd250800640 1 -- 172.21.15.2:0/4261536866 shutdown_connections 2024-08-17T02:26:47.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.027+0000 7fd250800640 1 -- 172.21.15.2:0/4261536866 wait complete. 2024-08-17T02:26:47.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.029+0000 7fd250800640 1 Processor -- start 2024-08-17T02:26:47.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.029+0000 7fd250800640 1 -- start start 2024-08-17T02:26:47.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.030+0000 7fd250800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2480adf90 0x7fd248145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.030+0000 7fd250800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd248156bd0 0x7fd24815b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.030+0000 7fd250800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd248156fa0 0x7fd24815b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.030+0000 7fd250800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2480aadf0 con 0x7fd2480adf90 2024-08-17T02:26:47.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.030+0000 7fd250800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2481575f0 con 0x7fd248156bd0 2024-08-17T02:26:47.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.030+0000 7fd250800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2481578d0 con 0x7fd248156fa0 2024-08-17T02:26:47.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.030+0000 7fd24de00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2480adf90 0x7fd248145350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.030+0000 7fd24de00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2480adf90 0x7fd248145350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57578/0 (socket says 172.21.15.2:57578) 2024-08-17T02:26:47.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.030+0000 7fd24de00640 1 -- 172.21.15.2:0/1363865926 learned_addr learned my addr 172.21.15.2:0/1363865926 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:47.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.030+0000 7fd24d400640 1 --2- 172.21.15.2:0/1363865926 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd248156bd0 0x7fd24815b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.030+0000 7fd24e800640 1 --2- 172.21.15.2:0/1363865926 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd248156fa0 0x7fd24815b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.030+0000 7fd24de00640 1 -- 172.21.15.2:0/1363865926 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd248156fa0 msgr2=0x7fd24815b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.030+0000 7fd24de00640 1 --2- 172.21.15.2:0/1363865926 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd248156fa0 0x7fd24815b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.030+0000 7fd24de00640 1 -- 172.21.15.2:0/1363865926 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd248156bd0 msgr2=0x7fd24815b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.030+0000 7fd24de00640 1 --2- 172.21.15.2:0/1363865926 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd248156bd0 0x7fd24815b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.030+0000 7fd24de00640 1 -- 172.21.15.2:0/1363865926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd238009450 con 0x7fd2480adf90 2024-08-17T02:26:47.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.030+0000 7fd24e800640 1 --2- 172.21.15.2:0/1363865926 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd248156fa0 0x7fd24815b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:47.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.030+0000 7fd24d400640 1 --2- 172.21.15.2:0/1363865926 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd248156bd0 0x7fd24815b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:47.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.031+0000 7fd24de00640 1 --2- 172.21.15.2:0/1363865926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2480adf90 0x7fd248145350 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00ea20 tx=0x7fd23c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.031+0000 7fd241600640 1 -- 172.21.15.2:0/1363865926 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c00ca10 con 0x7fd2480adf90 2024-08-17T02:26:47.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.031+0000 7fd241600640 1 -- 172.21.15.2:0/1363865926 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c00cb70 con 0x7fd2480adf90 2024-08-17T02:26:47.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.031+0000 7fd241600640 1 -- 172.21.15.2:0/1363865926 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c013470 con 0x7fd2480adf90 2024-08-17T02:26:47.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.031+0000 7fd250800640 1 -- 172.21.15.2:0/1363865926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd248157bb0 con 0x7fd2480adf90 2024-08-17T02:26:47.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.031+0000 7fd250800640 1 -- 172.21.15.2:0/1363865926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd248145890 con 0x7fd2480adf90 2024-08-17T02:26:47.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.032+0000 7fd250800640 1 -- 172.21.15.2:0/1363865926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2480c89f0 con 0x7fd2480adf90 2024-08-17T02:26:47.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.033+0000 7fd241600640 1 -- 172.21.15.2:0/1363865926 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd23c013860 con 0x7fd2480adf90 2024-08-17T02:26:47.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.034+0000 7fd241600640 1 --2- 172.21.15.2:0/1363865926 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd22c065150 0x7fd22c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.035+0000 7fd241600640 1 -- 172.21.15.2:0/1363865926 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fd23c082860 con 0x7fd2480adf90 2024-08-17T02:26:47.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.035+0000 7fd24d400640 1 --2- 172.21.15.2:0/1363865926 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd22c065150 0x7fd22c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.036+0000 7fd24d400640 1 --2- 172.21.15.2:0/1363865926 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd22c065150 0x7fd22c067600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd238034000 tx=0x7fd238032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.038+0000 7fd241600640 1 -- 172.21.15.2:0/1363865926 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd2480c89f0 con 0x7fd2480adf90 2024-08-17T02:26:47.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.235+0000 7fd250800640 1 -- 172.21.15.2:0/1363865926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd24806ea10 con 0x7fd2480adf90 2024-08-17T02:26:47.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.236+0000 7fd241600640 1 -- 172.21.15.2:0/1363865926 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd24806ea10 con 0x7fd2480adf90 2024-08-17T02:26:47.237 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-17T02:26:47.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.237+0000 7fd250800640 1 -- 172.21.15.2:0/1363865926 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd22c065150 msgr2=0x7fd22c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.237+0000 7fd250800640 1 --2- 172.21.15.2:0/1363865926 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd22c065150 0x7fd22c067600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd238034000 tx=0x7fd238032000 comp rx=0 tx=0).stop 2024-08-17T02:26:47.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.237+0000 7fd250800640 1 -- 172.21.15.2:0/1363865926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2480adf90 msgr2=0x7fd248145350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.237+0000 7fd250800640 1 --2- 172.21.15.2:0/1363865926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2480adf90 0x7fd248145350 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00ea20 tx=0x7fd23c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.238+0000 7fd250800640 1 -- 172.21.15.2:0/1363865926 shutdown_connections 2024-08-17T02:26:47.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.238+0000 7fd250800640 1 --2- 172.21.15.2:0/1363865926 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fd22c065150 0x7fd22c067600 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.238+0000 7fd250800640 1 --2- 172.21.15.2:0/1363865926 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd248156fa0 0x7fd24815b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.238+0000 7fd250800640 1 --2- 172.21.15.2:0/1363865926 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd248156bd0 0x7fd24815b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.238+0000 7fd250800640 1 --2- 172.21.15.2:0/1363865926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2480adf90 0x7fd248145350 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.238+0000 7fd250800640 1 -- 172.21.15.2:0/1363865926 >> 172.21.15.2:0/1363865926 conn(0x7fd2480cc390 msgr2=0x7fd24806a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.238+0000 7fd250800640 1 -- 172.21.15.2:0/1363865926 shutdown_connections 2024-08-17T02:26:47.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.238+0000 7fd250800640 1 -- 172.21.15.2:0/1363865926 wait complete. 2024-08-17T02:26:47.255 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000001044477.meta pg_num 2024-08-17T02:26:47.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.408+0000 7f8ea2000640 1 Processor -- start 2024-08-17T02:26:47.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.408+0000 7f8ea2000640 1 -- start start 2024-08-17T02:26:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.409+0000 7f8ea2000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e9c158e10 0x7f8e9c068180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.409+0000 7f8ea2000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e9c0c40a0 con 0x7f8e9c068dd0 2024-08-17T02:26:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.409+0000 7f8ea2000640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e9c069240 con 0x7f8e9c1591e0 2024-08-17T02:26:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.409+0000 7f8ea2000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0694e0 con 0x7f8e9c158e10 2024-08-17T02:26:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.409+0000 7f8e9be00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8e9c068dd0 0x7f8e9c0cbfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35906/0 (socket says 172.21.15.2:35906) 2024-08-17T02:26:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.409+0000 7f8e9be00640 1 -- 172.21.15.2:0/2741589712 learned_addr learned my addr 172.21.15.2:0/2741589712 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:26:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.410+0000 7f8e9b400640 1 --2- 172.21.15.2:0/2741589712 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e9c158e10 0x7f8e9c068180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.410+0000 7f8e9aa00640 1 -- 172.21.15.2:0/2741589712 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962831720 0 0) 0x7f8e9c0c40a0 con 0x7f8e9c068dd0 2024-08-17T02:26:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.410+0000 7f8e9aa00640 1 -- 172.21.15.2:0/2741589712 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e800034e0 con 0x7f8e9c068dd0 2024-08-17T02:26:47.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.410+0000 7f8e9aa00640 1 -- 172.21.15.2:0/2741589712 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 703399725 0 0) 0x7f8e800034e0 con 0x7f8e9c068dd0 2024-08-17T02:26:47.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.410+0000 7f8e9aa00640 1 -- 172.21.15.2:0/2741589712 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e9c158e10 msgr2=0x7f8e9c068180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.410+0000 7f8e9aa00640 1 --2- 172.21.15.2:0/2741589712 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e9c158e10 0x7f8e9c068180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.410+0000 7f8e9aa00640 1 -- 172.21.15.2:0/2741589712 >> v1:172.21.15.145:6789/0 conn(0x7f8e9c1591e0 legacy=0x7f8e9c0686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.410+0000 7f8e9aa00640 1 -- 172.21.15.2:0/2741589712 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c0c3a50 con 0x7f8e9c068dd0 2024-08-17T02:26:47.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.410+0000 7f8e9aa00640 1 -- 172.21.15.2:0/2741589712 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7f8e940017f0 con 0x7f8e9c068dd0 2024-08-17T02:26:47.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.410+0000 7f8e9aa00640 1 -- 172.21.15.2:0/2741589712 >> v1:172.21.15.2:6789/0 conn(0x7f8e9c068dd0 legacy=0x7f8e9c0cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.410+0000 7f8e9aa00640 1 --2- 172.21.15.2:0/2741589712 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e80003a00 0x7f8e80003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.410+0000 7f8e9aa00640 1 --2- 172.21.15.2:0/2741589712 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e9c158e10 0x7f8e80004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.410+0000 7f8e9aa00640 1 --2- 172.21.15.2:0/2741589712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e80004cc0 0x7f8e80005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.410+0000 7f8e9aa00640 1 -- 172.21.15.2:0/2741589712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0694e0 con 0x7f8e80004cc0 2024-08-17T02:26:47.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.410+0000 7f8e9aa00640 1 -- 172.21.15.2:0/2741589712 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8000bae0 con 0x7f8e80003a00 2024-08-17T02:26:47.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.410+0000 7f8e9aa00640 1 -- 172.21.15.2:0/2741589712 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8000bca0 con 0x7f8e9c158e10 2024-08-17T02:26:47.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.411+0000 7f8e9be00640 1 --2- 172.21.15.2:0/2741589712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e80004cc0 0x7f8e80005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.411+0000 7f8e9b400640 1 --2- 172.21.15.2:0/2741589712 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e80003a00 0x7f8e80003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.411+0000 7f8e93e00640 1 --2- 172.21.15.2:0/2741589712 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e9c158e10 0x7f8e80004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.411+0000 7f8e9be00640 1 -- 172.21.15.2:0/2741589712 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e9c158e10 msgr2=0x7f8e80004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.411+0000 7f8e9be00640 1 --2- 172.21.15.2:0/2741589712 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e9c158e10 0x7f8e80004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.411+0000 7f8e9be00640 1 -- 172.21.15.2:0/2741589712 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e80003a00 msgr2=0x7f8e80003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.411+0000 7f8e9be00640 1 --2- 172.21.15.2:0/2741589712 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e80003a00 0x7f8e80003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.411+0000 7f8e9be00640 1 -- 172.21.15.2:0/2741589712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e800034e0 con 0x7f8e80004cc0 2024-08-17T02:26:47.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.412+0000 7f8e9be00640 1 --2- 172.21.15.2:0/2741589712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e80004cc0 0x7f8e80005130 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400a900 tx=0x7f8e940021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f53dc8a381bb2b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.412+0000 7f8e9aa00640 1 -- 172.21.15.2:0/2741589712 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e940070f0 con 0x7f8e80004cc0 2024-08-17T02:26:47.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.412+0000 7f8e9aa00640 1 -- 172.21.15.2:0/2741589712 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e94007270 con 0x7f8e80004cc0 2024-08-17T02:26:47.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.412+0000 7f8e9aa00640 1 -- 172.21.15.2:0/2741589712 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e94007630 con 0x7f8e80004cc0 2024-08-17T02:26:47.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.413+0000 7f8ea2000640 1 -- 172.21.15.2:0/2741589712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e80004cc0 msgr2=0x7f8e80005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.413+0000 7f8ea2000640 1 --2- 172.21.15.2:0/2741589712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e80004cc0 0x7f8e80005130 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400a900 tx=0x7f8e940021d0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.413+0000 7f8e9be00640 1 -- 172.21.15.2:0/2741589712 reap_dead start 2024-08-17T02:26:47.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.413+0000 7f8ea2000640 1 -- 172.21.15.2:0/2741589712 shutdown_connections 2024-08-17T02:26:47.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.413+0000 7f8ea2000640 1 -- 172.21.15.2:0/2741589712 >> 172.21.15.2:0/2741589712 conn(0x7f8e9c0ce590 msgr2=0x7f8e9c0ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.413+0000 7f8ea2000640 1 -- 172.21.15.2:0/2741589712 shutdown_connections 2024-08-17T02:26:47.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.413+0000 7f8ea2000640 1 -- 172.21.15.2:0/2741589712 wait complete. 2024-08-17T02:26:47.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.414+0000 7f8ea2000640 1 Processor -- start 2024-08-17T02:26:47.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.415+0000 7f8ea2000640 1 -- start start 2024-08-17T02:26:47.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.415+0000 7f8ea2000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e9c14e9b0 0x7f8e9c0ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.415+0000 7f8ea2000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e9c14ed80 0x7f8e9c0ad900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.415+0000 7f8ea2000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e9c0c6b50 0x7f8e9c0c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.415+0000 7f8ea2000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0c7530 con 0x7f8e9c0c6b50 2024-08-17T02:26:47.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.415+0000 7f8ea2000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0b1ea0 con 0x7f8e9c14e9b0 2024-08-17T02:26:47.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.415+0000 7f8ea2000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0b1290 con 0x7f8e9c14ed80 2024-08-17T02:26:47.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.416+0000 7f8e9be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e9c0c6b50 0x7f8e9c0c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.416+0000 7f8e9be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e9c0c6b50 0x7f8e9c0c6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57598/0 (socket says 172.21.15.2:57598) 2024-08-17T02:26:47.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.416+0000 7f8e9be00640 1 -- 172.21.15.2:0/704951285 learned_addr learned my addr 172.21.15.2:0/704951285 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:47.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.416+0000 7f8e9b400640 1 --2- 172.21.15.2:0/704951285 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e9c14e9b0 0x7f8e9c0ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.416+0000 7f8e93e00640 1 --2- 172.21.15.2:0/704951285 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e9c14ed80 0x7f8e9c0ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.416+0000 7f8e9be00640 1 -- 172.21.15.2:0/704951285 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e9c14ed80 msgr2=0x7f8e9c0ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.416+0000 7f8e9be00640 1 --2- 172.21.15.2:0/704951285 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e9c14ed80 0x7f8e9c0ad900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.416+0000 7f8e9be00640 1 -- 172.21.15.2:0/704951285 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e9c14e9b0 msgr2=0x7f8e9c0ad3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.416+0000 7f8e9be00640 1 --2- 172.21.15.2:0/704951285 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e9c14e9b0 0x7f8e9c0ad3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.416+0000 7f8e9be00640 1 -- 172.21.15.2:0/704951285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c0b1570 con 0x7f8e9c0c6b50 2024-08-17T02:26:47.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.417+0000 7f8e9be00640 1 --2- 172.21.15.2:0/704951285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e9c0c6b50 0x7f8e9c0c6ff0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400a960 tx=0x7f8e94034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.417+0000 7f8e92a00640 1 -- 172.21.15.2:0/704951285 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e94007070 con 0x7f8e9c0c6b50 2024-08-17T02:26:47.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.417+0000 7f8e92a00640 1 -- 172.21.15.2:0/704951285 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9402c6c0 con 0x7f8e9c0c6b50 2024-08-17T02:26:47.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.417+0000 7f8e92a00640 1 -- 172.21.15.2:0/704951285 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9402ca80 con 0x7f8e9c0c6b50 2024-08-17T02:26:47.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.417+0000 7f8ea2000640 1 -- 172.21.15.2:0/704951285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9c0b1850 con 0x7f8e9c0c6b50 2024-08-17T02:26:47.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.417+0000 7f8ea2000640 1 -- 172.21.15.2:0/704951285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9c0af370 con 0x7f8e9c0c6b50 2024-08-17T02:26:47.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.418+0000 7f8ea2000640 1 -- 172.21.15.2:0/704951285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e9c0b2030 con 0x7f8e9c0c6b50 2024-08-17T02:26:47.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.419+0000 7f8e92a00640 1 -- 172.21.15.2:0/704951285 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8e9402d480 con 0x7f8e9c0c6b50 2024-08-17T02:26:47.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.420+0000 7f8e92a00640 1 --2- 172.21.15.2:0/704951285 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8e78065150 0x7f8e78067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.420+0000 7f8e92a00640 1 -- 172.21.15.2:0/704951285 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f8e940a2ec0 con 0x7f8e9c0c6b50 2024-08-17T02:26:47.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.420+0000 7f8e9b400640 1 --2- 172.21.15.2:0/704951285 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8e78065150 0x7f8e78067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.421+0000 7f8e9b400640 1 --2- 172.21.15.2:0/704951285 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8e78065150 0x7f8e78067600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c006e70 tx=0x7f8e8c0090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.424+0000 7f8e92a00640 1 -- 172.21.15.2:0/704951285 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8e94070f10 con 0x7f8e9c0c6b50 2024-08-17T02:26:47.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.604+0000 7f8ea2000640 1 -- 172.21.15.2:0/704951285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000001044477.meta", "var": "pg_num"} v 0) v1 -- 0x7f8e9c063fb0 con 0x7f8e9c0c6b50 2024-08-17T02:26:47.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.605+0000 7f8e92a00640 1 -- 172.21.15.2:0/704951285 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000001044477.meta", "var": "pg_num"}]=0 v39) v1 ==== 124+0+11 (secure 0 0 0) 0x7f8e94074530 con 0x7f8e9c0c6b50 2024-08-17T02:26:47.606 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:26:47.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.607+0000 7f8ea2000640 1 -- 172.21.15.2:0/704951285 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8e78065150 msgr2=0x7f8e78067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.607+0000 7f8ea2000640 1 --2- 172.21.15.2:0/704951285 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8e78065150 0x7f8e78067600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c006e70 tx=0x7f8e8c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.607+0000 7f8ea2000640 1 -- 172.21.15.2:0/704951285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e9c0c6b50 msgr2=0x7f8e9c0c6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.607+0000 7f8ea2000640 1 --2- 172.21.15.2:0/704951285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e9c0c6b50 0x7f8e9c0c6ff0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400a960 tx=0x7f8e94034000 comp rx=0 tx=0).stop 2024-08-17T02:26:47.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.607+0000 7f8ea2000640 1 -- 172.21.15.2:0/704951285 shutdown_connections 2024-08-17T02:26:47.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.607+0000 7f8ea2000640 1 --2- 172.21.15.2:0/704951285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e9c0c6b50 0x7f8e9c0c6ff0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.607+0000 7f8ea2000640 1 --2- 172.21.15.2:0/704951285 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8e78065150 0x7f8e78067600 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.607+0000 7f8ea2000640 1 --2- 172.21.15.2:0/704951285 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e9c14ed80 0x7f8e9c0ad900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.607+0000 7f8ea2000640 1 --2- 172.21.15.2:0/704951285 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e9c14e9b0 0x7f8e9c0ad3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.607+0000 7f8ea2000640 1 -- 172.21.15.2:0/704951285 >> 172.21.15.2:0/704951285 conn(0x7f8e9c0ce590 msgr2=0x7f8e9c0ac810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.607+0000 7f8ea2000640 1 -- 172.21.15.2:0/704951285 shutdown_connections 2024-08-17T02:26:47.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.607+0000 7f8ea2000640 1 -- 172.21.15.2:0/704951285 wait complete. 2024-08-17T02:26:47.624 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000001044477.data pg_num 2024-08-17T02:26:47.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.776+0000 7fb8b9800640 1 Processor -- start 2024-08-17T02:26:47.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.776+0000 7fb8b9800640 1 -- start start 2024-08-17T02:26:47.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.778+0000 7fb8b9800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8b40ca050 0x7fb8b4156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.778+0000 7fb8b9800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb8b40add30 0x7fb8b415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.778+0000 7fb8b9800640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b415b5e0 con 0x7fb8b40ad960 2024-08-17T02:26:47.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.778+0000 7fb8b9800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b40cb160 con 0x7fb8b40add30 2024-08-17T02:26:47.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.778+0000 7fb8b9800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40b0d10 con 0x7fb8b40ca050 2024-08-17T02:26:47.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.778+0000 7fb8b3400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb8b40add30 0x7fb8b415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.778+0000 7fb8b3400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb8b40add30 0x7fb8b415b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57612/0 (socket says 172.21.15.2:57612) 2024-08-17T02:26:47.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.778+0000 7fb8b3400640 1 -- 172.21.15.2:0/1856985753 learned_addr learned my addr 172.21.15.2:0/1856985753 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:47.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.778+0000 7fb8abe00640 1 --2- 172.21.15.2:0/1856985753 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8b40ca050 0x7fb8b4156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.778+0000 7fb8b3400640 1 -- 172.21.15.2:0/1856985753 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8b40ca050 msgr2=0x7fb8b4156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.778+0000 7fb8b3400640 1 --2- 172.21.15.2:0/1856985753 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8b40ca050 0x7fb8b4156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.779+0000 7fb8b3400640 1 -- 172.21.15.2:0/1856985753 >> v1:172.21.15.145:6789/0 conn(0x7fb8b40ad960 legacy=0x7fb8b4156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.779+0000 7fb8b3400640 1 -- 172.21.15.2:0/1856985753 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b40ca550 con 0x7fb8b40add30 2024-08-17T02:26:47.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.780+0000 7fb8b3400640 1 --2- 172.21.15.2:0/1856985753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b40add30 0x7fb8b415b0a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac009f20 tx=0x7fb8ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77cc215816136e90 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.780+0000 7fb8b2000640 1 -- 172.21.15.2:0/1856985753 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac032450 con 0x7fb8b40add30 2024-08-17T02:26:47.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.780+0000 7fb8b2000640 1 -- 172.21.15.2:0/1856985753 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ac0325b0 con 0x7fb8b40add30 2024-08-17T02:26:47.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.780+0000 7fb8b2000640 1 -- 172.21.15.2:0/1856985753 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac032990 con 0x7fb8b40add30 2024-08-17T02:26:47.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.780+0000 7fb8b9800640 1 -- 172.21.15.2:0/1856985753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b40add30 msgr2=0x7fb8b415b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.780+0000 7fb8b9800640 1 --2- 172.21.15.2:0/1856985753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b40add30 0x7fb8b415b0a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac009f20 tx=0x7fb8ac009840 comp rx=0 tx=0).stop 2024-08-17T02:26:47.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.781+0000 7fb8b9800640 1 -- 172.21.15.2:0/1856985753 shutdown_connections 2024-08-17T02:26:47.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.781+0000 7fb8b9800640 1 --2- 172.21.15.2:0/1856985753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b40add30 0x7fb8b415b0a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.781+0000 7fb8b9800640 1 --2- 172.21.15.2:0/1856985753 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8b40ca050 0x7fb8b4156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.781+0000 7fb8b9800640 1 -- 172.21.15.2:0/1856985753 >> 172.21.15.2:0/1856985753 conn(0x7fb8b4066e60 msgr2=0x7fb8b4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.781+0000 7fb8b9800640 1 -- 172.21.15.2:0/1856985753 shutdown_connections 2024-08-17T02:26:47.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.781+0000 7fb8b9800640 1 -- 172.21.15.2:0/1856985753 wait complete. 2024-08-17T02:26:47.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.782+0000 7fb8b9800640 1 Processor -- start 2024-08-17T02:26:47.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.782+0000 7fb8b9800640 1 -- start start 2024-08-17T02:26:47.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.783+0000 7fb8b9800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8b40ad960 0x7fb8b41473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.783+0000 7fb8b9800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b40add30 0x7fb8b4149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.783+0000 7fb8b9800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8b40ca050 0x7fb8b4147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.783+0000 7fb8b9800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b414f440 con 0x7fb8b40add30 2024-08-17T02:26:47.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.783+0000 7fb8b9800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b416a8e0 con 0x7fb8b40ca050 2024-08-17T02:26:47.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.783+0000 7fb8b9800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b416abc0 con 0x7fb8b40ad960 2024-08-17T02:26:47.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.783+0000 7fb8abe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b40add30 0x7fb8b4149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.783+0000 7fb8abe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b40add30 0x7fb8b4149330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57622/0 (socket says 172.21.15.2:57622) 2024-08-17T02:26:47.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.783+0000 7fb8abe00640 1 -- 172.21.15.2:0/3545706331 learned_addr learned my addr 172.21.15.2:0/3545706331 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:47.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.784+0000 7fb8b3400640 1 --2- 172.21.15.2:0/3545706331 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8b40ca050 0x7fb8b4147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.784+0000 7fb8b2a00640 1 --2- 172.21.15.2:0/3545706331 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8b40ad960 0x7fb8b41473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.784+0000 7fb8abe00640 1 -- 172.21.15.2:0/3545706331 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8b40ad960 msgr2=0x7fb8b41473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.784+0000 7fb8abe00640 1 --2- 172.21.15.2:0/3545706331 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8b40ad960 0x7fb8b41473c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.784+0000 7fb8abe00640 1 -- 172.21.15.2:0/3545706331 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8b40ca050 msgr2=0x7fb8b4147bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.784+0000 7fb8abe00640 1 --2- 172.21.15.2:0/3545706331 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8b40ca050 0x7fb8b4147bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.784+0000 7fb8abe00640 1 -- 172.21.15.2:0/3545706331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac009ae0 con 0x7fb8b40add30 2024-08-17T02:26:47.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.784+0000 7fb8abe00640 1 --2- 172.21.15.2:0/3545706331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b40add30 0x7fb8b4149330 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00d890 tx=0x7fb89c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.784+0000 7fb8aa000640 1 -- 172.21.15.2:0/3545706331 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c00de20 con 0x7fb8b40add30 2024-08-17T02:26:47.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.784+0000 7fb8aa000640 1 -- 172.21.15.2:0/3545706331 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89c0098b0 con 0x7fb8b40add30 2024-08-17T02:26:47.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.784+0000 7fb8aa000640 1 -- 172.21.15.2:0/3545706331 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c009c50 con 0x7fb8b40add30 2024-08-17T02:26:47.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.785+0000 7fb8b9800640 1 -- 172.21.15.2:0/3545706331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b416aea0 con 0x7fb8b40add30 2024-08-17T02:26:47.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.785+0000 7fb8b9800640 1 -- 172.21.15.2:0/3545706331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b4147900 con 0x7fb8b40add30 2024-08-17T02:26:47.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.786+0000 7fb8b9800640 1 -- 172.21.15.2:0/3545706331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b414f5b0 con 0x7fb8b40add30 2024-08-17T02:26:47.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.787+0000 7fb8aa000640 1 -- 172.21.15.2:0/3545706331 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb89c012630 con 0x7fb8b40add30 2024-08-17T02:26:47.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.787+0000 7fb8aa000640 1 --2- 172.21.15.2:0/3545706331 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb890065150 0x7fb890067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.787+0000 7fb8aa000640 1 -- 172.21.15.2:0/3545706331 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fb89c0829d0 con 0x7fb8b40add30 2024-08-17T02:26:47.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.788+0000 7fb8b2a00640 1 --2- 172.21.15.2:0/3545706331 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb890065150 0x7fb890067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.788+0000 7fb8b2a00640 1 --2- 172.21.15.2:0/3545706331 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb890065150 0x7fb890067600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4007fd0 tx=0x7fb8a4007e30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.791+0000 7fb8aa000640 1 -- 172.21.15.2:0/3545706331 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb89c050a20 con 0x7fb8b40add30 2024-08-17T02:26:47.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.973+0000 7fb8b9800640 1 -- 172.21.15.2:0/3545706331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000001044477.data", "var": "pg_num"} v 0) v1 -- 0x7fb8b4063fb0 con 0x7fb8b40add30 2024-08-17T02:26:47.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.974+0000 7fb8aa000640 1 -- 172.21.15.2:0/3545706331 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000001044477.data", "var": "pg_num"}]=0 v39) v1 ==== 124+0+11 (secure 0 0 0) 0x7fb89c054040 con 0x7fb8b40add30 2024-08-17T02:26:47.975 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:26:47.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.976+0000 7fb8b9800640 1 -- 172.21.15.2:0/3545706331 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb890065150 msgr2=0x7fb890067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.976+0000 7fb8b9800640 1 --2- 172.21.15.2:0/3545706331 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb890065150 0x7fb890067600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4007fd0 tx=0x7fb8a4007e30 comp rx=0 tx=0).stop 2024-08-17T02:26:47.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.976+0000 7fb8b9800640 1 -- 172.21.15.2:0/3545706331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b40add30 msgr2=0x7fb8b4149330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.976+0000 7fb8b9800640 1 --2- 172.21.15.2:0/3545706331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b40add30 0x7fb8b4149330 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00d890 tx=0x7fb89c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:47.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.976+0000 7fb8b9800640 1 -- 172.21.15.2:0/3545706331 shutdown_connections 2024-08-17T02:26:47.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.976+0000 7fb8b9800640 1 --2- 172.21.15.2:0/3545706331 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8b40ca050 0x7fb8b4147bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.976+0000 7fb8b9800640 1 --2- 172.21.15.2:0/3545706331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b40add30 0x7fb8b4149330 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.976+0000 7fb8b9800640 1 --2- 172.21.15.2:0/3545706331 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fb890065150 0x7fb890067600 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.976+0000 7fb8b9800640 1 --2- 172.21.15.2:0/3545706331 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8b40ad960 0x7fb8b41473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.976+0000 7fb8b9800640 1 -- 172.21.15.2:0/3545706331 >> 172.21.15.2:0/3545706331 conn(0x7fb8b4066e60 msgr2=0x7fb8b41534c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.976+0000 7fb8b9800640 1 -- 172.21.15.2:0/3545706331 shutdown_connections 2024-08-17T02:26:47.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:47.976+0000 7fb8b9800640 1 -- 172.21.15.2:0/3545706331 wait complete. 2024-08-17T02:26:47.993 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:48.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.144+0000 7fc36e200640 1 Processor -- start 2024-08-17T02:26:48.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.144+0000 7fc36e200640 1 -- start start 2024-08-17T02:26:48.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.145+0000 7fc36e200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc3680c8290 0x7fc3680ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.145+0000 7fc36e200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3680aca30 0x7fc368067010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.145+0000 7fc36e200640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3680aa5a0 con 0x7fc368158af0 2024-08-17T02:26:48.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.145+0000 7fc36e200640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3680abde0 con 0x7fc3680c8290 2024-08-17T02:26:48.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.145+0000 7fc36e200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3680ace30 con 0x7fc3680aca30 2024-08-17T02:26:48.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.146+0000 7fc367e00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc3680c8290 0x7fc3680ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.146+0000 7fc36d800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3680aca30 0x7fc368067010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.146+0000 7fc367e00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc3680c8290 0x7fc3680ac4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:55006/0 (socket says 172.21.15.2:55006) 2024-08-17T02:26:48.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.146+0000 7fc367e00640 1 -- 172.21.15.2:0/1414668277 learned_addr learned my addr 172.21.15.2:0/1414668277 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:48.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.146+0000 7fc36ce00640 1 --1- 172.21.15.2:0/1414668277 >> v1:172.21.15.145:6789/0 conn(0x7fc368158af0 0x7fc3680ae530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:56932/0 (socket says 172.21.15.2:56932) 2024-08-17T02:26:48.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.146+0000 7fc367e00640 1 -- 172.21.15.2:0/1414668277 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3680aca30 msgr2=0x7fc368067010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:48.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.146+0000 7fc367e00640 1 --2- 172.21.15.2:0/1414668277 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3680aca30 0x7fc368067010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.146+0000 7fc367e00640 1 -- 172.21.15.2:0/1414668277 >> v1:172.21.15.145:6789/0 conn(0x7fc368158af0 legacy=0x7fc3680ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.146+0000 7fc367e00640 1 -- 172.21.15.2:0/1414668277 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3680a9c70 con 0x7fc3680c8290 2024-08-17T02:26:48.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.147+0000 7fc367e00640 1 --2- 172.21.15.2:0/1414668277 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3680c8290 0x7fc3680ac4f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc354009910 tx=0x7fc3540091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=835e2f652b7cb47d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.148+0000 7fc367400640 1 -- 172.21.15.2:0/1414668277 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35402ae40 con 0x7fc3680c8290 2024-08-17T02:26:48.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.148+0000 7fc367400640 1 -- 172.21.15.2:0/1414668277 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc354032440 con 0x7fc3680c8290 2024-08-17T02:26:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.148+0000 7fc367400640 1 -- 172.21.15.2:0/1414668277 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354032820 con 0x7fc3680c8290 2024-08-17T02:26:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.148+0000 7fc36e200640 1 -- 172.21.15.2:0/1414668277 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3680c8290 msgr2=0x7fc3680ac4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.148+0000 7fc36e200640 1 --2- 172.21.15.2:0/1414668277 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3680c8290 0x7fc3680ac4f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc354009910 tx=0x7fc3540091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.148+0000 7fc36e200640 1 -- 172.21.15.2:0/1414668277 shutdown_connections 2024-08-17T02:26:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.148+0000 7fc36e200640 1 --2- 172.21.15.2:0/1414668277 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3680aca30 0x7fc368067010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.148+0000 7fc36e200640 1 --2- 172.21.15.2:0/1414668277 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3680c8290 0x7fc3680ac4f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.148+0000 7fc36e200640 1 -- 172.21.15.2:0/1414668277 >> 172.21.15.2:0/1414668277 conn(0x7fc3680cc060 msgr2=0x7fc3680cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.148+0000 7fc36e200640 1 -- 172.21.15.2:0/1414668277 shutdown_connections 2024-08-17T02:26:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.148+0000 7fc36e200640 1 -- 172.21.15.2:0/1414668277 wait complete. 2024-08-17T02:26:48.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.150+0000 7fc36e200640 1 Processor -- start 2024-08-17T02:26:48.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.150+0000 7fc36e200640 1 -- start start 2024-08-17T02:26:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.151+0000 7fc36e200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3680aca30 0x7fc368140410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.151+0000 7fc36e200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3680c8290 0x7fc3680c6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.151+0000 7fc36e200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc368158af0 0x7fc3680c4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.151+0000 7fc36e200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36806ad30 con 0x7fc3680c8290 2024-08-17T02:26:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.151+0000 7fc36e200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3680c7df0 con 0x7fc368158af0 2024-08-17T02:26:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.151+0000 7fc36e200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc368140950 con 0x7fc3680aca30 2024-08-17T02:26:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.151+0000 7fc367e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3680c8290 0x7fc3680c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.151+0000 7fc367e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3680c8290 0x7fc3680c6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57634/0 (socket says 172.21.15.2:57634) 2024-08-17T02:26:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.151+0000 7fc367e00640 1 -- 172.21.15.2:0/134330920 learned_addr learned my addr 172.21.15.2:0/134330920 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:48.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.151+0000 7fc36ce00640 1 --2- 172.21.15.2:0/134330920 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3680aca30 0x7fc368140410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.151+0000 7fc36d800640 1 --2- 172.21.15.2:0/134330920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc368158af0 0x7fc3680c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.151+0000 7fc367e00640 1 -- 172.21.15.2:0/134330920 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3680aca30 msgr2=0x7fc368140410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.151+0000 7fc367e00640 1 --2- 172.21.15.2:0/134330920 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3680aca30 0x7fc368140410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.151+0000 7fc367e00640 1 -- 172.21.15.2:0/134330920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc368158af0 msgr2=0x7fc3680c4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.151+0000 7fc367e00640 1 --2- 172.21.15.2:0/134330920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc368158af0 0x7fc3680c4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.151+0000 7fc367e00640 1 -- 172.21.15.2:0/134330920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc354009450 con 0x7fc3680c8290 2024-08-17T02:26:48.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.152+0000 7fc367e00640 1 --2- 172.21.15.2:0/134330920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3680c8290 0x7fc3680c6790 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc354035040 tx=0x7fc354032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.152+0000 7fc35be00640 1 -- 172.21.15.2:0/134330920 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354031c80 con 0x7fc3680c8290 2024-08-17T02:26:48.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.152+0000 7fc35be00640 1 -- 172.21.15.2:0/134330920 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc354031e40 con 0x7fc3680c8290 2024-08-17T02:26:48.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.152+0000 7fc36e200640 1 -- 172.21.15.2:0/134330920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3680c71e0 con 0x7fc3680c8290 2024-08-17T02:26:48.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.152+0000 7fc35be00640 1 -- 172.21.15.2:0/134330920 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35403d670 con 0x7fc3680c8290 2024-08-17T02:26:48.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.152+0000 7fc36e200640 1 -- 172.21.15.2:0/134330920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3680c77a0 con 0x7fc3680c8290 2024-08-17T02:26:48.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.153+0000 7fc36e200640 1 -- 172.21.15.2:0/134330920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc368070720 con 0x7fc3680c8290 2024-08-17T02:26:48.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.154+0000 7fc35be00640 1 -- 172.21.15.2:0/134330920 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc354039040 con 0x7fc3680c8290 2024-08-17T02:26:48.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.155+0000 7fc35be00640 1 --2- 172.21.15.2:0/134330920 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc348065180 0x7fc348067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.155+0000 7fc35be00640 1 -- 172.21.15.2:0/134330920 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fc35402ae40 con 0x7fc3680c8290 2024-08-17T02:26:48.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.156+0000 7fc36ce00640 1 --2- 172.21.15.2:0/134330920 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc348065180 0x7fc348067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.156+0000 7fc36ce00640 1 --2- 172.21.15.2:0/134330920 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc348065180 0x7fc348067630 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc35c007800 tx=0x7fc35c007e20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.159+0000 7fc35be00640 1 -- 172.21.15.2:0/134330920 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc354070350 con 0x7fc3680c8290 2024-08-17T02:26:48.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.379+0000 7fc36e200640 1 -- 172.21.15.2:0/134330920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc368157c70 con 0x7fc3680c8290 2024-08-17T02:26:48.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.380+0000 7fc35be00640 1 -- 172.21.15.2:0/134330920 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4615 (secure 0 0 0) 0x7fc354073970 con 0x7fc3680c8290 2024-08-17T02:26:48.381 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:26:48.381 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1347318932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1347318932},{"type":"v1","addr":"172.21.15.2:6834","nonce":1347318932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6836/4156967978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":4156967978},{"type":"v1","addr":"172.21.15.145:6836","nonce":4156967978}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/1687147178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":1687147178},{"type":"v1","addr":"172.21.15.2:6835","nonce":1687147178}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:35.805568+0000","modified":"2024-08-17T02:24:37.800310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4903":{"gid":4903,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.145:6837/1729489536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":1729489536},{"type":"v1","addr":"172.21.15.145:6837","nonce":1729489536}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001044477","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:26:48.381 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 23 2024-08-17T02:26:48.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.382+0000 7fc36e200640 1 -- 172.21.15.2:0/134330920 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc348065180 msgr2=0x7fc348067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.382+0000 7fc36e200640 1 --2- 172.21.15.2:0/134330920 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc348065180 0x7fc348067630 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc35c007800 tx=0x7fc35c007e20 comp rx=0 tx=0).stop 2024-08-17T02:26:48.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.382+0000 7fc36e200640 1 -- 172.21.15.2:0/134330920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3680c8290 msgr2=0x7fc3680c6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.382+0000 7fc36e200640 1 --2- 172.21.15.2:0/134330920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3680c8290 0x7fc3680c6790 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc354035040 tx=0x7fc354032000 comp rx=0 tx=0).stop 2024-08-17T02:26:48.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.382+0000 7fc36e200640 1 -- 172.21.15.2:0/134330920 shutdown_connections 2024-08-17T02:26:48.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.382+0000 7fc36e200640 1 --2- 172.21.15.2:0/134330920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc368158af0 0x7fc3680c4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.382+0000 7fc36e200640 1 --2- 172.21.15.2:0/134330920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3680c8290 0x7fc3680c6790 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.382+0000 7fc36e200640 1 --2- 172.21.15.2:0/134330920 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc348065180 0x7fc348067630 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.382+0000 7fc36e200640 1 --2- 172.21.15.2:0/134330920 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3680aca30 0x7fc368140410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.382+0000 7fc36e200640 1 -- 172.21.15.2:0/134330920 >> 172.21.15.2:0/134330920 conn(0x7fc3680cc060 msgr2=0x7fc3680af080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.382+0000 7fc36e200640 1 -- 172.21.15.2:0/134330920 shutdown_connections 2024-08-17T02:26:48.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.382+0000 7fc36e200640 1 -- 172.21.15.2:0/134330920 wait complete. 2024-08-17T02:26:48.398 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:48.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.549+0000 7f2ea3200640 1 Processor -- start 2024-08-17T02:26:48.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.550+0000 7f2ea3200640 1 -- start start 2024-08-17T02:26:48.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.551+0000 7f2ea3200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e9c158b10 0x7f2e9c0b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.551+0000 7f2ea3200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2e9c067570 0x7f2e9c0aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.551+0000 7f2ea3200640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9c0a9620 con 0x7f2e9c0b25c0 2024-08-17T02:26:48.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.551+0000 7f2ea3200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9c0aa420 con 0x7f2e9c067570 2024-08-17T02:26:48.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.551+0000 7f2ea3200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0a9850 con 0x7f2e9c158b10 2024-08-17T02:26:48.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.551+0000 7f2ea2800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2e9c067570 0x7f2e9c0aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.551+0000 7f2ea2800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2e9c067570 0x7f2e9c0aa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57646/0 (socket says 172.21.15.2:57646) 2024-08-17T02:26:48.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.551+0000 7f2ea2800640 1 -- 172.21.15.2:0/1263068863 learned_addr learned my addr 172.21.15.2:0/1263068863 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:48.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.552+0000 7f2ea1e00640 1 --2- 172.21.15.2:0/1263068863 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e9c158b10 0x7f2e9c0b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.552+0000 7f2ea2800640 1 -- 172.21.15.2:0/1263068863 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e9c158b10 msgr2=0x7f2e9c0b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:48.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.552+0000 7f2ea2800640 1 --2- 172.21.15.2:0/1263068863 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e9c158b10 0x7f2e9c0b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.552+0000 7f2ea2800640 1 -- 172.21.15.2:0/1263068863 >> v1:172.21.15.145:6789/0 conn(0x7f2e9c0b25c0 legacy=0x7f2e9c066e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.552+0000 7f2ea2800640 1 -- 172.21.15.2:0/1263068863 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c067c40 con 0x7f2e9c067570 2024-08-17T02:26:48.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.553+0000 7f2ea2800640 1 --2- 172.21.15.2:0/1263068863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e9c067570 0x7f2e9c0aa8b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009f50 tx=0x7f2e98009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=690abbcd5b35e43f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.553+0000 7f2ea0a00640 1 -- 172.21.15.2:0/1263068863 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e98031400 con 0x7f2e9c067570 2024-08-17T02:26:48.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.553+0000 7f2ea0a00640 1 -- 172.21.15.2:0/1263068863 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9802d050 con 0x7f2e9c067570 2024-08-17T02:26:48.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.553+0000 7f2ea0a00640 1 -- 172.21.15.2:0/1263068863 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e980317d0 con 0x7f2e9c067570 2024-08-17T02:26:48.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.553+0000 7f2ea3200640 1 -- 172.21.15.2:0/1263068863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e9c067570 msgr2=0x7f2e9c0aa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.553+0000 7f2ea3200640 1 --2- 172.21.15.2:0/1263068863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e9c067570 0x7f2e9c0aa8b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009f50 tx=0x7f2e98009840 comp rx=0 tx=0).stop 2024-08-17T02:26:48.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.554+0000 7f2ea3200640 1 -- 172.21.15.2:0/1263068863 shutdown_connections 2024-08-17T02:26:48.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.554+0000 7f2ea3200640 1 --2- 172.21.15.2:0/1263068863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e9c067570 0x7f2e9c0aa8b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.554+0000 7f2ea3200640 1 --2- 172.21.15.2:0/1263068863 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e9c158b10 0x7f2e9c0b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.554+0000 7f2ea3200640 1 -- 172.21.15.2:0/1263068863 >> 172.21.15.2:0/1263068863 conn(0x7f2e9c095a70 msgr2=0x7f2e9c095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.554+0000 7f2ea3200640 1 -- 172.21.15.2:0/1263068863 shutdown_connections 2024-08-17T02:26:48.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.554+0000 7f2ea3200640 1 -- 172.21.15.2:0/1263068863 wait complete. 2024-08-17T02:26:48.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.555+0000 7f2ea3200640 1 Processor -- start 2024-08-17T02:26:48.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.555+0000 7f2ea3200640 1 -- start start 2024-08-17T02:26:48.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.556+0000 7f2ea3200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e9c067570 0x7f2e9c0ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.556+0000 7f2ea3200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e9c0b25c0 0x7f2e9c0ae910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.556+0000 7f2ea3200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e9c158b10 0x7f2e9c151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.556+0000 7f2ea3200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c1596d0 con 0x7f2e9c158b10 2024-08-17T02:26:48.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.556+0000 7f2ea3200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c15a250 con 0x7f2e9c0b25c0 2024-08-17T02:26:48.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.556+0000 7f2ea3200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c159920 con 0x7f2e9c067570 2024-08-17T02:26:48.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.556+0000 7f2ea2800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e9c158b10 0x7f2e9c151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.556+0000 7f2ea2800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e9c158b10 0x7f2e9c151640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57648/0 (socket says 172.21.15.2:57648) 2024-08-17T02:26:48.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.556+0000 7f2ea1e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e9c067570 0x7f2e9c0ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.556+0000 7f2ea2800640 1 -- 172.21.15.2:0/2162375390 learned_addr learned my addr 172.21.15.2:0/2162375390 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:48.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.556+0000 7f2ea1400640 1 --2- 172.21.15.2:0/2162375390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e9c0b25c0 0x7f2e9c0ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.557+0000 7f2ea2800640 1 -- 172.21.15.2:0/2162375390 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e9c067570 msgr2=0x7f2e9c0ae3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.557+0000 7f2ea2800640 1 --2- 172.21.15.2:0/2162375390 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e9c067570 0x7f2e9c0ae3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.557+0000 7f2ea2800640 1 -- 172.21.15.2:0/2162375390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e9c0b25c0 msgr2=0x7f2e9c0ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.557+0000 7f2ea2800640 1 --2- 172.21.15.2:0/2162375390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e9c0b25c0 0x7f2e9c0ae910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.557+0000 7f2ea2800640 1 -- 172.21.15.2:0/2162375390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e98009ae0 con 0x7f2e9c158b10 2024-08-17T02:26:48.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.557+0000 7f2ea2800640 1 --2- 172.21.15.2:0/2162375390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e9c158b10 0x7f2e9c151640 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009fb0 tx=0x7f2e98036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.557+0000 7f2e95600640 1 -- 172.21.15.2:0/2162375390 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e98008e50 con 0x7f2e9c158b10 2024-08-17T02:26:48.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.558+0000 7f2e95600640 1 -- 172.21.15.2:0/2162375390 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9803b410 con 0x7f2e9c158b10 2024-08-17T02:26:48.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.558+0000 7f2e95600640 1 -- 172.21.15.2:0/2162375390 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9803b7d0 con 0x7f2e9c158b10 2024-08-17T02:26:48.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.558+0000 7f2ea3200640 1 -- 172.21.15.2:0/2162375390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9c159c00 con 0x7f2e9c158b10 2024-08-17T02:26:48.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.558+0000 7f2ea3200640 1 -- 172.21.15.2:0/2162375390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9c14e2a0 con 0x7f2e9c158b10 2024-08-17T02:26:48.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.559+0000 7f2ea3200640 1 -- 172.21.15.2:0/2162375390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9c15a3c0 con 0x7f2e9c158b10 2024-08-17T02:26:48.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.559+0000 7f2e95600640 1 -- 172.21.15.2:0/2162375390 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2e98038050 con 0x7f2e9c158b10 2024-08-17T02:26:48.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.561+0000 7f2e95600640 1 --2- 172.21.15.2:0/2162375390 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2e80065180 0x7f2e80067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.561+0000 7f2e95600640 1 -- 172.21.15.2:0/2162375390 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f2e980a2ab0 con 0x7f2e9c158b10 2024-08-17T02:26:48.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.561+0000 7f2ea1e00640 1 --2- 172.21.15.2:0/2162375390 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2e80065180 0x7f2e80067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.562+0000 7f2ea1e00640 1 --2- 172.21.15.2:0/2162375390 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2e80065180 0x7f2e80067630 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000bd40 tx=0x7f2e90008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.565+0000 7f2e95600640 1 -- 172.21.15.2:0/2162375390 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2e98070bc0 con 0x7f2e9c158b10 2024-08-17T02:26:48.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.747+0000 7f2ea3200640 1 -- 172.21.15.2:0/2162375390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e9c070720 con 0x7f2e9c158b10 2024-08-17T02:26:48.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.748+0000 7f2e95600640 1 -- 172.21.15.2:0/2162375390 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+15462 (secure 0 0 0) 0x7f2e980741e0 con 0x7f2e9c158b10 2024-08-17T02:26:48.750 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:26:48.750 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":39,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:26:46.470913+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000001044477.meta","create_time":"2024-08-17T02:24:33.976587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001044477"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001044477.data","create_time":"2024-08-17T02:24:34.827029+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001044477"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6835/3013258535":"2024-08-18T02:26:43.461593+0000","172.21.15.2:6833/3013258535":"2024-08-18T02:26:43.461593+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:48.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.750+0000 7f2ea3200640 1 -- 172.21.15.2:0/2162375390 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2e80065180 msgr2=0x7f2e80067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.750+0000 7f2ea3200640 1 --2- 172.21.15.2:0/2162375390 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2e80065180 0x7f2e80067630 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000bd40 tx=0x7f2e90008040 comp rx=0 tx=0).stop 2024-08-17T02:26:48.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.750+0000 7f2ea3200640 1 -- 172.21.15.2:0/2162375390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e9c158b10 msgr2=0x7f2e9c151640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.750+0000 7f2ea3200640 1 --2- 172.21.15.2:0/2162375390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e9c158b10 0x7f2e9c151640 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009fb0 tx=0x7f2e98036000 comp rx=0 tx=0).stop 2024-08-17T02:26:48.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.750+0000 7f2ea3200640 1 -- 172.21.15.2:0/2162375390 shutdown_connections 2024-08-17T02:26:48.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.750+0000 7f2ea3200640 1 --2- 172.21.15.2:0/2162375390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e9c158b10 0x7f2e9c151640 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.750+0000 7f2ea3200640 1 --2- 172.21.15.2:0/2162375390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e9c0b25c0 0x7f2e9c0ae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.750+0000 7f2ea3200640 1 --2- 172.21.15.2:0/2162375390 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2e80065180 0x7f2e80067630 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.750+0000 7f2ea3200640 1 --2- 172.21.15.2:0/2162375390 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2e9c067570 0x7f2e9c0ae3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.750+0000 7f2ea3200640 1 -- 172.21.15.2:0/2162375390 >> 172.21.15.2:0/2162375390 conn(0x7f2e9c095a70 msgr2=0x7f2e9c156ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.750+0000 7f2ea3200640 1 -- 172.21.15.2:0/2162375390 shutdown_connections 2024-08-17T02:26:48.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.751+0000 7f2ea3200640 1 -- 172.21.15.2:0/2162375390 wait complete. 2024-08-17T02:26:48.767 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000001044477 and related pools 2024-08-17T02:26:48.767 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:48.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.919+0000 7fec0b200640 1 Processor -- start 2024-08-17T02:26:48.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.919+0000 7fec0b200640 1 -- start start 2024-08-17T02:26:48.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.920+0000 7fec0b200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fec04158f20 0x7fec04062f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.920+0000 7fec0b200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec0415a950 0x7fec040a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.920+0000 7fec0b200640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec04067510 con 0x7fec040a9630 2024-08-17T02:26:48.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.920+0000 7fec0b200640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec040a9ab0 con 0x7fec04158f20 2024-08-17T02:26:48.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.920+0000 7fec0b200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec04066f00 con 0x7fec0415a950 2024-08-17T02:26:48.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.921+0000 7fec03e00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fec04158f20 0x7fec04062f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.921+0000 7febfbe00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec0415a950 0x7fec040a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.921+0000 7fec03e00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fec04158f20 0x7fec04062f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:55038/0 (socket says 172.21.15.2:55038) 2024-08-17T02:26:48.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.921+0000 7fec03e00640 1 -- 172.21.15.2:0/1992903527 learned_addr learned my addr 172.21.15.2:0/1992903527 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:48.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.921+0000 7fec09200640 1 --1- 172.21.15.2:0/1992903527 >> v1:172.21.15.145:6789/0 conn(0x7fec040a9630 0x7fec040679a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:56960/0 (socket says 172.21.15.2:56960) 2024-08-17T02:26:48.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.921+0000 7fec03e00640 1 -- 172.21.15.2:0/1992903527 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec0415a950 msgr2=0x7fec040a90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:48.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.921+0000 7fec03e00640 1 --2- 172.21.15.2:0/1992903527 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec0415a950 0x7fec040a90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.921+0000 7fec03e00640 1 -- 172.21.15.2:0/1992903527 >> v1:172.21.15.145:6789/0 conn(0x7fec040a9630 legacy=0x7fec040679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.921+0000 7fec03e00640 1 -- 172.21.15.2:0/1992903527 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec040ccda0 con 0x7fec04158f20 2024-08-17T02:26:48.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.921+0000 7fec03400640 1 -- 172.21.15.2:0/1992903527 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4273433765 0 0) 0x7fec04067510 con 0x7fec040a9630 2024-08-17T02:26:48.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.922+0000 7fec03e00640 1 --2- 172.21.15.2:0/1992903527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec04158f20 0x7fec04062f40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7febf4009910 tx=0x7febf40091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cfa47b2530c324 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.923+0000 7fec03400640 1 -- 172.21.15.2:0/1992903527 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf402ae40 con 0x7fec04158f20 2024-08-17T02:26:48.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.923+0000 7fec03400640 1 -- 172.21.15.2:0/1992903527 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf4032440 con 0x7fec04158f20 2024-08-17T02:26:48.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.923+0000 7fec03400640 1 -- 172.21.15.2:0/1992903527 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf40327e0 con 0x7fec04158f20 2024-08-17T02:26:48.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.923+0000 7fec0b200640 1 -- 172.21.15.2:0/1992903527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec04158f20 msgr2=0x7fec04062f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.923+0000 7fec0b200640 1 --2- 172.21.15.2:0/1992903527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec04158f20 0x7fec04062f40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7febf4009910 tx=0x7febf40091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.923+0000 7fec0b200640 1 -- 172.21.15.2:0/1992903527 shutdown_connections 2024-08-17T02:26:48.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.923+0000 7fec0b200640 1 --2- 172.21.15.2:0/1992903527 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec0415a950 0x7fec040a90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.923+0000 7fec0b200640 1 --2- 172.21.15.2:0/1992903527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec04158f20 0x7fec04062f40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.923+0000 7fec0b200640 1 -- 172.21.15.2:0/1992903527 >> 172.21.15.2:0/1992903527 conn(0x7fec0406e5b0 msgr2=0x7fec040b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.923+0000 7fec0b200640 1 -- 172.21.15.2:0/1992903527 shutdown_connections 2024-08-17T02:26:48.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.923+0000 7fec0b200640 1 -- 172.21.15.2:0/1992903527 wait complete. 2024-08-17T02:26:48.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.925+0000 7fec0b200640 1 Processor -- start 2024-08-17T02:26:48.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.925+0000 7fec0b200640 1 -- start start 2024-08-17T02:26:48.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.926+0000 7fec0b200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec040a9630 0x7fec04149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.926+0000 7fec0b200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04158f20 0x7fec041699e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.926+0000 7fec0b200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec0415a950 0x7fec040adc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.926+0000 7fec0b200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec04169550 con 0x7fec04158f20 2024-08-17T02:26:48.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.926+0000 7fec0b200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec040997c0 con 0x7fec0415a950 2024-08-17T02:26:48.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.926+0000 7fec0b200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0409a000 con 0x7fec040a9630 2024-08-17T02:26:48.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.926+0000 7febfbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04158f20 0x7fec041699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.926+0000 7febfbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04158f20 0x7fec041699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57662/0 (socket says 172.21.15.2:57662) 2024-08-17T02:26:48.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.926+0000 7febfbe00640 1 -- 172.21.15.2:0/190742013 learned_addr learned my addr 172.21.15.2:0/190742013 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:48.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.926+0000 7fec03e00640 1 --2- 172.21.15.2:0/190742013 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec040a9630 0x7fec04149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.926+0000 7fec09200640 1 --2- 172.21.15.2:0/190742013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec0415a950 0x7fec040adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.927+0000 7febfbe00640 1 -- 172.21.15.2:0/190742013 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec040a9630 msgr2=0x7fec04149d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.927+0000 7febfbe00640 1 --2- 172.21.15.2:0/190742013 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec040a9630 0x7fec04149d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.927+0000 7febfbe00640 1 -- 172.21.15.2:0/190742013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec0415a950 msgr2=0x7fec040adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.927+0000 7febfbe00640 1 --2- 172.21.15.2:0/190742013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec0415a950 0x7fec040adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.927+0000 7febfbe00640 1 -- 172.21.15.2:0/190742013 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf4009450 con 0x7fec04158f20 2024-08-17T02:26:48.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.927+0000 7febfbe00640 1 --2- 172.21.15.2:0/190742013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04158f20 0x7fec041699e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7febec00e930 tx=0x7febec0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.927+0000 7febfb400640 1 -- 172.21.15.2:0/190742013 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec00c8e0 con 0x7fec04158f20 2024-08-17T02:26:48.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.927+0000 7fec0b200640 1 -- 172.21.15.2:0/190742013 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec04169f20 con 0x7fec04158f20 2024-08-17T02:26:48.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.927+0000 7febfb400640 1 -- 172.21.15.2:0/190742013 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec00ca40 con 0x7fec04158f20 2024-08-17T02:26:48.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.927+0000 7febfb400640 1 -- 172.21.15.2:0/190742013 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec00cde0 con 0x7fec04158f20 2024-08-17T02:26:48.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.927+0000 7fec0b200640 1 -- 172.21.15.2:0/190742013 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec04099a40 con 0x7fec04158f20 2024-08-17T02:26:48.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.929+0000 7fec0b200640 1 -- 172.21.15.2:0/190742013 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec04169700 con 0x7fec04158f20 2024-08-17T02:26:48.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.929+0000 7febfb400640 1 -- 172.21.15.2:0/190742013 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7febec013680 con 0x7fec04158f20 2024-08-17T02:26:48.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.930+0000 7febfb400640 1 --2- 172.21.15.2:0/190742013 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7febe0065150 0x7febe0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.930+0000 7febfb400640 1 -- 172.21.15.2:0/190742013 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7febec082730 con 0x7fec04158f20 2024-08-17T02:26:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.930+0000 7fec03e00640 1 --2- 172.21.15.2:0/190742013 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7febe0065150 0x7febe0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.931+0000 7fec03e00640 1 --2- 172.21.15.2:0/190742013 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7febe0065150 0x7febe0067600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7febf4034000 tx=0x7febf4032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:48.934+0000 7febfb400640 1 -- 172.21.15.2:0/190742013 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fec04169700 con 0x7fec04158f20 2024-08-17T02:26:49.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.157+0000 7fec0b200640 1 -- 172.21.15.2:0/190742013 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec04169700 con 0x7fec04158f20 2024-08-17T02:26:49.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.158+0000 7febfb400640 1 -- 172.21.15.2:0/190742013 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4615 (secure 0 0 0) 0x7fec04169700 con 0x7fec04158f20 2024-08-17T02:26:49.159 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:26:49.159 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1347318932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1347318932},{"type":"v1","addr":"172.21.15.2:6834","nonce":1347318932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6836/4156967978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":4156967978},{"type":"v1","addr":"172.21.15.145:6836","nonce":4156967978}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/1687147178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":1687147178},{"type":"v1","addr":"172.21.15.2:6835","nonce":1687147178}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:35.805568+0000","modified":"2024-08-17T02:24:37.800310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4903":{"gid":4903,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.145:6837/1729489536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":1729489536},{"type":"v1","addr":"172.21.15.145:6837","nonce":1729489536}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001044477","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:26:49.159 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 23 2024-08-17T02:26:49.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.160+0000 7fec0b200640 1 -- 172.21.15.2:0/190742013 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7febe0065150 msgr2=0x7febe0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.160+0000 7fec0b200640 1 --2- 172.21.15.2:0/190742013 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7febe0065150 0x7febe0067600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7febf4034000 tx=0x7febf4032000 comp rx=0 tx=0).stop 2024-08-17T02:26:49.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.160+0000 7fec0b200640 1 -- 172.21.15.2:0/190742013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04158f20 msgr2=0x7fec041699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.160+0000 7fec0b200640 1 --2- 172.21.15.2:0/190742013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04158f20 0x7fec041699e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7febec00e930 tx=0x7febec0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.160+0000 7fec0b200640 1 -- 172.21.15.2:0/190742013 shutdown_connections 2024-08-17T02:26:49.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.160+0000 7fec0b200640 1 --2- 172.21.15.2:0/190742013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec0415a950 0x7fec040adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.160+0000 7fec0b200640 1 --2- 172.21.15.2:0/190742013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04158f20 0x7fec041699e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.160+0000 7fec0b200640 1 --2- 172.21.15.2:0/190742013 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7febe0065150 0x7febe0067600 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.160+0000 7fec0b200640 1 --2- 172.21.15.2:0/190742013 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec040a9630 0x7fec04149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.160+0000 7fec0b200640 1 -- 172.21.15.2:0/190742013 >> 172.21.15.2:0/190742013 conn(0x7fec0406e5b0 msgr2=0x7fec040b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:49.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.160+0000 7fec0b200640 1 -- 172.21.15.2:0/190742013 shutdown_connections 2024-08-17T02:26:49.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.160+0000 7fec0b200640 1 -- 172.21.15.2:0/190742013 wait complete. 2024-08-17T02:26:49.176 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:49.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.326+0000 7f1e28a00640 1 Processor -- start 2024-08-17T02:26:49.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.326+0000 7f1e28a00640 1 -- start start 2024-08-17T02:26:49.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.327+0000 7f1e28a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e240ae4a0 0x7f1e240abda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.328+0000 7f1e28a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e240ac740 con 0x7f1e240ac2e0 2024-08-17T02:26:49.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.328+0000 7f1e28a00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e240682e0 con 0x7f1e24158bf0 2024-08-17T02:26:49.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.328+0000 7f1e28a00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e240afa40 con 0x7f1e240ae4a0 2024-08-17T02:26:49.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.328+0000 7f1e23200640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1e240ac2e0 0x7f1e24068770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35918/0 (socket says 172.21.15.2:35918) 2024-08-17T02:26:49.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.328+0000 7f1e23200640 1 -- 172.21.15.2:0/2995581862 learned_addr learned my addr 172.21.15.2:0/2995581862 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:26:49.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.328+0000 7f1e19e00640 1 --2- 172.21.15.2:0/2995581862 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e240ae4a0 0x7f1e240abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.328+0000 7f1e21e00640 1 -- 172.21.15.2:0/2995581862 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87045096 0 0) 0x7f1e1c001490 con 0x7f1e240ac2e0 2024-08-17T02:26:49.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.328+0000 7f1e21e00640 1 -- 172.21.15.2:0/2995581862 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e080034e0 con 0x7f1e240ac2e0 2024-08-17T02:26:49.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.329+0000 7f1e21e00640 1 -- 172.21.15.2:0/2995581862 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161344117 0 0) 0x7f1e240682e0 con 0x7f1e24158bf0 2024-08-17T02:26:49.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.329+0000 7f1e21e00640 1 -- 172.21.15.2:0/2995581862 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e1c001490 con 0x7f1e24158bf0 2024-08-17T02:26:49.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.329+0000 7f1e19e00640 1 -- 172.21.15.2:0/2995581862 >> v1:172.21.15.145:6789/0 conn(0x7f1e24158bf0 legacy=0x7f1e240af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.329+0000 7f1e19e00640 1 -- 172.21.15.2:0/2995581862 >> v1:172.21.15.2:6789/0 conn(0x7f1e240ac2e0 legacy=0x7f1e24068770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.329+0000 7f1e21e00640 1 -- 172.21.15.2:0/2995581862 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 91816806 0 0) 0x7f1e080034e0 con 0x7f1e240ac2e0 2024-08-17T02:26:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.329+0000 7f1e19e00640 1 -- 172.21.15.2:0/2995581862 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e240afca0 con 0x7f1e240ae4a0 2024-08-17T02:26:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.330+0000 7f1e19e00640 1 --2- 172.21.15.2:0/2995581862 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e240ae4a0 0x7f1e240abda0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c009880 tx=0x7f1e0c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e853fbc4222a56b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.330+0000 7f1e21e00640 1 -- 172.21.15.2:0/2995581862 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c001980 con 0x7f1e240ae4a0 2024-08-17T02:26:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.330+0000 7f1e21e00640 1 -- 172.21.15.2:0/2995581862 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0c02aac0 con 0x7f1e240ae4a0 2024-08-17T02:26:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.330+0000 7f1e21e00640 1 -- 172.21.15.2:0/2995581862 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c02ae40 con 0x7f1e240ae4a0 2024-08-17T02:26:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.331+0000 7f1e28a00640 1 -- 172.21.15.2:0/2995581862 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e240ae4a0 msgr2=0x7f1e240abda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.331+0000 7f1e28a00640 1 --2- 172.21.15.2:0/2995581862 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e240ae4a0 0x7f1e240abda0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c009880 tx=0x7f1e0c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.331+0000 7f1e28a00640 1 -- 172.21.15.2:0/2995581862 shutdown_connections 2024-08-17T02:26:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.331+0000 7f1e28a00640 1 --2- 172.21.15.2:0/2995581862 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e240ae4a0 0x7f1e240abda0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.331+0000 7f1e28a00640 1 -- 172.21.15.2:0/2995581862 >> 172.21.15.2:0/2995581862 conn(0x7f1e240ce420 msgr2=0x7f1e24095d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.331+0000 7f1e28a00640 1 -- 172.21.15.2:0/2995581862 shutdown_connections 2024-08-17T02:26:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.331+0000 7f1e28a00640 1 -- 172.21.15.2:0/2995581862 wait complete. 2024-08-17T02:26:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.332+0000 7f1e28a00640 1 Processor -- start 2024-08-17T02:26:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.332+0000 7f1e28a00640 1 -- start start 2024-08-17T02:26:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.333+0000 7f1e28a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e240ac2e0 0x7f1e240b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.333+0000 7f1e28a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e240ae4a0 0x7f1e24154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.333+0000 7f1e28a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e24158bf0 0x7f1e2415e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.333+0000 7f1e28a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e240caec0 con 0x7f1e240ae4a0 2024-08-17T02:26:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.333+0000 7f1e28a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e240b1670 con 0x7f1e240ac2e0 2024-08-17T02:26:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.333+0000 7f1e28a00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e240cac00 con 0x7f1e24158bf0 2024-08-17T02:26:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.334+0000 7f1e19e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e240ae4a0 0x7f1e24154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.334+0000 7f1e19e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e240ae4a0 0x7f1e24154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57670/0 (socket says 172.21.15.2:57670) 2024-08-17T02:26:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.334+0000 7f1e19e00640 1 -- 172.21.15.2:0/2294013705 learned_addr learned my addr 172.21.15.2:0/2294013705 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.334+0000 7f1e23200640 1 --2- 172.21.15.2:0/2294013705 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e24158bf0 0x7f1e2415e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.334+0000 7f1e22800640 1 --2- 172.21.15.2:0/2294013705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e240ac2e0 0x7f1e240b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.334+0000 7f1e19e00640 1 -- 172.21.15.2:0/2294013705 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e24158bf0 msgr2=0x7f1e2415e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.334+0000 7f1e19e00640 1 --2- 172.21.15.2:0/2294013705 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e24158bf0 0x7f1e2415e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.334+0000 7f1e19e00640 1 -- 172.21.15.2:0/2294013705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e240ac2e0 msgr2=0x7f1e240b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.334+0000 7f1e19e00640 1 --2- 172.21.15.2:0/2294013705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e240ac2e0 0x7f1e240b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.334+0000 7f1e19e00640 1 -- 172.21.15.2:0/2294013705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0c009390 con 0x7f1e240ae4a0 2024-08-17T02:26:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.334+0000 7f1e19e00640 1 --2- 172.21.15.2:0/2294013705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e240ae4a0 0x7f1e24154630 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c0097d0 tx=0x7f1e0c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.335+0000 7f1e1aa00640 1 -- 172.21.15.2:0/2294013705 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c03c6f0 con 0x7f1e240ae4a0 2024-08-17T02:26:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.335+0000 7f1e1aa00640 1 -- 172.21.15.2:0/2294013705 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0c03c850 con 0x7f1e240ae4a0 2024-08-17T02:26:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.335+0000 7f1e1aa00640 1 -- 172.21.15.2:0/2294013705 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c03cc10 con 0x7f1e240ae4a0 2024-08-17T02:26:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.335+0000 7f1e28a00640 1 -- 172.21.15.2:0/2294013705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e240b2120 con 0x7f1e240ae4a0 2024-08-17T02:26:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.335+0000 7f1e28a00640 1 -- 172.21.15.2:0/2294013705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e240b1900 con 0x7f1e240ae4a0 2024-08-17T02:26:49.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.336+0000 7f1e28a00640 1 -- 172.21.15.2:0/2294013705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e240cb030 con 0x7f1e240ae4a0 2024-08-17T02:26:49.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.336+0000 7f1e1aa00640 1 -- 172.21.15.2:0/2294013705 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1e0c039050 con 0x7f1e240ae4a0 2024-08-17T02:26:49.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.337+0000 7f1e1aa00640 1 --2- 172.21.15.2:0/2294013705 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1e00065150 0x7f1e00067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.337+0000 7f1e1aa00640 1 -- 172.21.15.2:0/2294013705 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f1e0c0a2eb0 con 0x7f1e240ae4a0 2024-08-17T02:26:49.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.338+0000 7f1e22800640 1 --2- 172.21.15.2:0/2294013705 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1e00065150 0x7f1e00067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.338+0000 7f1e22800640 1 --2- 172.21.15.2:0/2294013705 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1e00065150 0x7f1e00067600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1e14003a10 tx=0x7f1e14007cc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.341+0000 7f1e1aa00640 1 -- 172.21.15.2:0/2294013705 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1e240cb030 con 0x7f1e240ae4a0 2024-08-17T02:26:49.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.561+0000 7f1e28a00640 1 -- 172.21.15.2:0/2294013705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e240cb000 con 0x7f1e240ae4a0 2024-08-17T02:26:49.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.561+0000 7f1e1aa00640 1 -- 172.21.15.2:0/2294013705 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4615 (secure 0 0 0) 0x7f1e0c037090 con 0x7f1e240ae4a0 2024-08-17T02:26:49.562 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:26:49.563 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1347318932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1347318932},{"type":"v1","addr":"172.21.15.2:6834","nonce":1347318932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6836/4156967978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":4156967978},{"type":"v1","addr":"172.21.15.145:6836","nonce":4156967978}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/1687147178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":1687147178},{"type":"v1","addr":"172.21.15.2:6835","nonce":1687147178}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:35.805568+0000","modified":"2024-08-17T02:24:37.800310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4903":{"gid":4903,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.145:6837/1729489536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":1729489536},{"type":"v1","addr":"172.21.15.145:6837","nonce":1729489536}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001044477","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:26:49.563 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 23 2024-08-17T02:26:49.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.563+0000 7f1e28a00640 1 -- 172.21.15.2:0/2294013705 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1e00065150 msgr2=0x7f1e00067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.563+0000 7f1e28a00640 1 --2- 172.21.15.2:0/2294013705 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1e00065150 0x7f1e00067600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1e14003a10 tx=0x7f1e14007cc0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.563+0000 7f1e28a00640 1 -- 172.21.15.2:0/2294013705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e240ae4a0 msgr2=0x7f1e24154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.563+0000 7f1e28a00640 1 --2- 172.21.15.2:0/2294013705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e240ae4a0 0x7f1e24154630 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c0097d0 tx=0x7f1e0c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:49.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.563+0000 7f1e28a00640 1 -- 172.21.15.2:0/2294013705 shutdown_connections 2024-08-17T02:26:49.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.563+0000 7f1e28a00640 1 --2- 172.21.15.2:0/2294013705 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1e00065150 0x7f1e00067600 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.563+0000 7f1e28a00640 1 --2- 172.21.15.2:0/2294013705 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e24158bf0 0x7f1e2415e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.563+0000 7f1e28a00640 1 --2- 172.21.15.2:0/2294013705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e240ae4a0 0x7f1e24154630 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.563+0000 7f1e28a00640 1 --2- 172.21.15.2:0/2294013705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e240ac2e0 0x7f1e240b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.563+0000 7f1e28a00640 1 -- 172.21.15.2:0/2294013705 >> 172.21.15.2:0/2294013705 conn(0x7f1e240ce420 msgr2=0x7f1e240aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:49.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.563+0000 7f1e28a00640 1 -- 172.21.15.2:0/2294013705 shutdown_connections 2024-08-17T02:26:49.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.564+0000 7f1e28a00640 1 -- 172.21.15.2:0/2294013705 wait complete. 2024-08-17T02:26:49.580 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:49.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.730+0000 7f5961c00640 1 Processor -- start 2024-08-17T02:26:49.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.730+0000 7f5961c00640 1 -- start start 2024-08-17T02:26:49.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.731+0000 7f5961c00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f595c0afca0 0x7f595c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.731+0000 7f5961c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f595c0acf10 0x7f595c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.731+0000 7f5961c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f595c1589a0 0x7f595c158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.731+0000 7f5961c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f595c0b0980 con 0x7f595c1589a0 2024-08-17T02:26:49.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.731+0000 7f5961c00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f595c15a4e0 con 0x7f595c0afca0 2024-08-17T02:26:49.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.731+0000 7f5961c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595c0c92b0 con 0x7f595c0acf10 2024-08-17T02:26:49.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.732+0000 7f595b400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f595c1589a0 0x7f595c158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.732+0000 7f595b400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f595c1589a0 0x7f595c158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57676/0 (socket says 172.21.15.2:57676) 2024-08-17T02:26:49.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.732+0000 7f595b400640 1 -- 172.21.15.2:0/4158008314 learned_addr learned my addr 172.21.15.2:0/4158008314 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:49.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.732+0000 7f5953e00640 1 --2- 172.21.15.2:0/4158008314 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f595c0acf10 0x7f595c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.732+0000 7f595aa00640 1 --2- 172.21.15.2:0/4158008314 >> v2:172.21.15.145:3300/0 conn(0x7f595c0afca0 0x7f595c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.732+0000 7f595b400640 1 -- 172.21.15.2:0/4158008314 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f595c0acf10 msgr2=0x7f595c159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:49.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.732+0000 7f595b400640 1 --2- 172.21.15.2:0/4158008314 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f595c0acf10 0x7f595c159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.732+0000 7f595b400640 1 -- 172.21.15.2:0/4158008314 >> v2:172.21.15.145:3300/0 conn(0x7f595c0afca0 msgr2=0x7f595c0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:49.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.732+0000 7f595b400640 1 --2- 172.21.15.2:0/4158008314 >> v2:172.21.15.145:3300/0 conn(0x7f595c0afca0 0x7f595c0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.732+0000 7f595b400640 1 -- 172.21.15.2:0/4158008314 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c159360 con 0x7f595c1589a0 2024-08-17T02:26:49.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.733+0000 7f595b400640 1 --2- 172.21.15.2:0/4158008314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f595c1589a0 0x7f595c158e20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f595400d1a0 tx=0x7f595400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb6640817ea0482 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.733+0000 7f595a000640 1 -- 172.21.15.2:0/4158008314 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595400b0d0 con 0x7f595c1589a0 2024-08-17T02:26:49.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.734+0000 7f595a000640 1 -- 172.21.15.2:0/4158008314 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595400b230 con 0x7f595c1589a0 2024-08-17T02:26:49.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.734+0000 7f595a000640 1 -- 172.21.15.2:0/4158008314 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5954009610 con 0x7f595c1589a0 2024-08-17T02:26:49.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.734+0000 7f5961c00640 1 -- 172.21.15.2:0/4158008314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f595c1589a0 msgr2=0x7f595c158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.734+0000 7f5961c00640 1 --2- 172.21.15.2:0/4158008314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f595c1589a0 0x7f595c158e20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f595400d1a0 tx=0x7f595400ba50 comp rx=0 tx=0).stop 2024-08-17T02:26:49.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.734+0000 7f5961c00640 1 -- 172.21.15.2:0/4158008314 shutdown_connections 2024-08-17T02:26:49.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.734+0000 7f5961c00640 1 --2- 172.21.15.2:0/4158008314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f595c1589a0 0x7f595c158e20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.734+0000 7f5961c00640 1 --2- 172.21.15.2:0/4158008314 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f595c0acf10 0x7f595c159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.734+0000 7f5961c00640 1 --2- 172.21.15.2:0/4158008314 >> v2:172.21.15.145:3300/0 conn(0x7f595c0afca0 0x7f595c0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.734+0000 7f5961c00640 1 -- 172.21.15.2:0/4158008314 >> 172.21.15.2:0/4158008314 conn(0x7f595c066e60 msgr2=0x7f595c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:49.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.734+0000 7f5961c00640 1 -- 172.21.15.2:0/4158008314 shutdown_connections 2024-08-17T02:26:49.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.734+0000 7f5961c00640 1 -- 172.21.15.2:0/4158008314 wait complete. 2024-08-17T02:26:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.736+0000 7f5961c00640 1 Processor -- start 2024-08-17T02:26:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.736+0000 7f5961c00640 1 -- start start 2024-08-17T02:26:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.737+0000 7f5961c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f595c0acf10 0x7f595c169ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.737+0000 7f5961c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f595c0afca0 0x7f595c16bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.737+0000 7f5961c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f595c1589a0 0x7f595c0c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.737+0000 7f5961c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c16d170 con 0x7f595c0afca0 2024-08-17T02:26:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.737+0000 7f5961c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c16c560 con 0x7f595c1589a0 2024-08-17T02:26:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.737+0000 7f5961c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595c16c840 con 0x7f595c0acf10 2024-08-17T02:26:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.737+0000 7f5953e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f595c0afca0 0x7f595c16bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.737+0000 7f5953e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f595c0afca0 0x7f595c16bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57686/0 (socket says 172.21.15.2:57686) 2024-08-17T02:26:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.737+0000 7f5953e00640 1 -- 172.21.15.2:0/2122379045 learned_addr learned my addr 172.21.15.2:0/2122379045 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.737+0000 7f5953e00640 1 -- 172.21.15.2:0/2122379045 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f595c0acf10 msgr2=0x7f595c169ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.737+0000 7f5953e00640 1 --2- 172.21.15.2:0/2122379045 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f595c0acf10 0x7f595c169ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.737+0000 7f5953e00640 1 -- 172.21.15.2:0/2122379045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f595c1589a0 msgr2=0x7f595c0c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.737+0000 7f595b400640 1 --2- 172.21.15.2:0/2122379045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f595c1589a0 0x7f595c0c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.737+0000 7f5953e00640 1 --2- 172.21.15.2:0/2122379045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f595c1589a0 0x7f595c0c4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.737+0000 7f5953e00640 1 -- 172.21.15.2:0/2122379045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595400bcf0 con 0x7f595c0afca0 2024-08-17T02:26:49.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.737+0000 7f595b400640 1 --2- 172.21.15.2:0/2122379045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f595c1589a0 0x7f595c0c4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:49.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.738+0000 7f5953e00640 1 --2- 172.21.15.2:0/2122379045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f595c0afca0 0x7f595c16bba0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f594400d890 tx=0x7f5944008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.738+0000 7f5952000640 1 -- 172.21.15.2:0/2122379045 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594400de20 con 0x7f595c0afca0 2024-08-17T02:26:49.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.738+0000 7f5952000640 1 -- 172.21.15.2:0/2122379045 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59440098b0 con 0x7f595c0afca0 2024-08-17T02:26:49.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.738+0000 7f5952000640 1 -- 172.21.15.2:0/2122379045 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5944009c50 con 0x7f595c0afca0 2024-08-17T02:26:49.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.738+0000 7f5961c00640 1 -- 172.21.15.2:0/2122379045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f595c16cb20 con 0x7f595c0afca0 2024-08-17T02:26:49.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.738+0000 7f5961c00640 1 -- 172.21.15.2:0/2122379045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f595c16c0e0 con 0x7f595c0afca0 2024-08-17T02:26:49.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.739+0000 7f5961c00640 1 -- 172.21.15.2:0/2122379045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f595c063fb0 con 0x7f595c0afca0 2024-08-17T02:26:49.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.740+0000 7f5952000640 1 -- 172.21.15.2:0/2122379045 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5944014620 con 0x7f595c0afca0 2024-08-17T02:26:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.741+0000 7f5952000640 1 --2- 172.21.15.2:0/2122379045 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5938065150 0x7f5938067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.741+0000 7f5952000640 1 -- 172.21.15.2:0/2122379045 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f5944082cd0 con 0x7f595c0afca0 2024-08-17T02:26:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.741+0000 7f595aa00640 1 --2- 172.21.15.2:0/2122379045 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5938065150 0x7f5938067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.742+0000 7f595aa00640 1 --2- 172.21.15.2:0/2122379045 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5938065150 0x7f5938067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f595c0c1d10 tx=0x7f594c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.745+0000 7f5952000640 1 -- 172.21.15.2:0/2122379045 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5944050dc0 con 0x7f595c0afca0 2024-08-17T02:26:49.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.929+0000 7f5961c00640 1 -- 172.21.15.2:0/2122379045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f595c16d2b0 con 0x7f595c0afca0 2024-08-17T02:26:49.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.930+0000 7f5952000640 1 -- 172.21.15.2:0/2122379045 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+15462 (secure 0 0 0) 0x7f595c16d2b0 con 0x7f595c0afca0 2024-08-17T02:26:49.931 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:26:49.932 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":39,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:26:46.470913+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000001044477.meta","create_time":"2024-08-17T02:24:33.976587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001044477"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001044477.data","create_time":"2024-08-17T02:24:34.827029+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001044477"}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6835/3013258535":"2024-08-18T02:26:43.461593+0000","172.21.15.2:6833/3013258535":"2024-08-18T02:26:43.461593+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:49.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.932+0000 7f5961c00640 1 -- 172.21.15.2:0/2122379045 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5938065150 msgr2=0x7f5938067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.932+0000 7f5961c00640 1 --2- 172.21.15.2:0/2122379045 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5938065150 0x7f5938067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f595c0c1d10 tx=0x7f594c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:49.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.932+0000 7f5961c00640 1 -- 172.21.15.2:0/2122379045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f595c0afca0 msgr2=0x7f595c16bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.932+0000 7f5961c00640 1 --2- 172.21.15.2:0/2122379045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f595c0afca0 0x7f595c16bba0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f594400d890 tx=0x7f5944008040 comp rx=0 tx=0).stop 2024-08-17T02:26:49.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.932+0000 7f5961c00640 1 -- 172.21.15.2:0/2122379045 shutdown_connections 2024-08-17T02:26:49.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.932+0000 7f5961c00640 1 --2- 172.21.15.2:0/2122379045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f595c1589a0 0x7f595c0c4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.932+0000 7f5961c00640 1 --2- 172.21.15.2:0/2122379045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f595c0afca0 0x7f595c16bba0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.932+0000 7f5961c00640 1 --2- 172.21.15.2:0/2122379045 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5938065150 0x7f5938067600 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.932+0000 7f5961c00640 1 --2- 172.21.15.2:0/2122379045 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f595c0acf10 0x7f595c169ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.932+0000 7f5961c00640 1 -- 172.21.15.2:0/2122379045 >> 172.21.15.2:0/2122379045 conn(0x7f595c066e60 msgr2=0x7f595c0c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:49.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.932+0000 7f5961c00640 1 -- 172.21.15.2:0/2122379045 shutdown_connections 2024-08-17T02:26:49.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:49.933+0000 7f5961c00640 1 -- 172.21.15.2:0/2122379045 wait complete. 2024-08-17T02:26:49.948 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000001044477 2024-08-17T02:26:50.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.101+0000 7fee85e00640 1 Processor -- start 2024-08-17T02:26:50.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.101+0000 7fee85e00640 1 -- start start 2024-08-17T02:26:50.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.102+0000 7fee85e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee800ac000 0x7fee80163ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.102+0000 7fee85e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee800a96c0 con 0x7fee80159120 2024-08-17T02:26:50.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.102+0000 7fee85e00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee800acf00 con 0x7fee80158d50 2024-08-17T02:26:50.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.102+0000 7fee85e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee800af7d0 con 0x7fee800ac000 2024-08-17T02:26:50.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.102+0000 7fee7e000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fee80159120 0x7fee800ab8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35920/0 (socket says 172.21.15.2:35920) 2024-08-17T02:26:50.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.102+0000 7fee7e000640 1 -- 172.21.15.2:0/2969919252 learned_addr learned my addr 172.21.15.2:0/2969919252 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:26:50.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.102+0000 7fee7f400640 1 --2- 172.21.15.2:0/2969919252 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee800ac000 0x7fee80163ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.103+0000 7fee7d600640 1 -- 172.21.15.2:0/2969919252 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900502384 0 0) 0x7fee800a96c0 con 0x7fee80159120 2024-08-17T02:26:50.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.103+0000 7fee7d600640 1 -- 172.21.15.2:0/2969919252 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee640034e0 con 0x7fee80159120 2024-08-17T02:26:50.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.103+0000 7fee7d600640 1 -- 172.21.15.2:0/2969919252 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950241643 0 0) 0x7fee800acf00 con 0x7fee80158d50 2024-08-17T02:26:50.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.103+0000 7fee7d600640 1 -- 172.21.15.2:0/2969919252 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee800a96c0 con 0x7fee80158d50 2024-08-17T02:26:50.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.103+0000 7fee7f400640 1 -- 172.21.15.2:0/2969919252 >> v1:172.21.15.145:6789/0 conn(0x7fee80158d50 legacy=0x7fee800ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.103+0000 7fee7f400640 1 -- 172.21.15.2:0/2969919252 >> v1:172.21.15.2:6789/0 conn(0x7fee80159120 legacy=0x7fee800ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.103+0000 7fee7f400640 1 -- 172.21.15.2:0/2969919252 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee800a98f0 con 0x7fee800ac000 2024-08-17T02:26:50.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.104+0000 7fee7f400640 1 --2- 172.21.15.2:0/2969919252 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee800ac000 0x7fee80163ab0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fee78009e90 tx=0x7fee78009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53f16f11cfa1ade8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.104+0000 7fee7d600640 1 -- 172.21.15.2:0/2969919252 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee78007550 con 0x7fee800ac000 2024-08-17T02:26:50.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.104+0000 7fee7d600640 1 -- 172.21.15.2:0/2969919252 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7802d050 con 0x7fee800ac000 2024-08-17T02:26:50.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.104+0000 7fee7d600640 1 -- 172.21.15.2:0/2969919252 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee780078c0 con 0x7fee800ac000 2024-08-17T02:26:50.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.105+0000 7fee85e00640 1 -- 172.21.15.2:0/2969919252 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee800ac000 msgr2=0x7fee80163ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.105+0000 7fee85e00640 1 --2- 172.21.15.2:0/2969919252 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee800ac000 0x7fee80163ab0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fee78009e90 tx=0x7fee78009780 comp rx=0 tx=0).stop 2024-08-17T02:26:50.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.105+0000 7fee85e00640 1 -- 172.21.15.2:0/2969919252 shutdown_connections 2024-08-17T02:26:50.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.105+0000 7fee85e00640 1 --2- 172.21.15.2:0/2969919252 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee800ac000 0x7fee80163ab0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.105+0000 7fee85e00640 1 -- 172.21.15.2:0/2969919252 >> 172.21.15.2:0/2969919252 conn(0x7fee80095a70 msgr2=0x7fee80095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:50.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.105+0000 7fee85e00640 1 -- 172.21.15.2:0/2969919252 shutdown_connections 2024-08-17T02:26:50.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.105+0000 7fee85e00640 1 -- 172.21.15.2:0/2969919252 wait complete. 2024-08-17T02:26:50.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.107+0000 7fee85e00640 1 Processor -- start 2024-08-17T02:26:50.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.107+0000 7fee85e00640 1 -- start start 2024-08-17T02:26:50.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.108+0000 7fee85e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee800ac000 0x7fee8015b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.108+0000 7fee85e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee80158d50 0x7fee80155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.108+0000 7fee85e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee80159120 0x7fee801524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.108+0000 7fee85e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee80155140 con 0x7fee80158d50 2024-08-17T02:26:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.108+0000 7fee85e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee801548a0 con 0x7fee800ac000 2024-08-17T02:26:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.108+0000 7fee85e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee80154b80 con 0x7fee80159120 2024-08-17T02:26:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.108+0000 7fee7e000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee80158d50 0x7fee80155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.108+0000 7fee7e000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee80158d50 0x7fee80155730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57702/0 (socket says 172.21.15.2:57702) 2024-08-17T02:26:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.108+0000 7fee7e000640 1 -- 172.21.15.2:0/2123933359 learned_addr learned my addr 172.21.15.2:0/2123933359 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.108+0000 7fee7ea00640 1 --2- 172.21.15.2:0/2123933359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee800ac000 0x7fee8015b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.108+0000 7fee7f400640 1 --2- 172.21.15.2:0/2123933359 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee80159120 0x7fee801524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.108+0000 7fee7e000640 1 -- 172.21.15.2:0/2123933359 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee80159120 msgr2=0x7fee801524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.108+0000 7fee7e000640 1 --2- 172.21.15.2:0/2123933359 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee80159120 0x7fee801524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.108+0000 7fee7e000640 1 -- 172.21.15.2:0/2123933359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee800ac000 msgr2=0x7fee8015b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.108+0000 7fee7e000640 1 --2- 172.21.15.2:0/2123933359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee800ac000 0x7fee8015b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.108+0000 7fee7e000640 1 -- 172.21.15.2:0/2123933359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee78009a20 con 0x7fee80158d50 2024-08-17T02:26:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.109+0000 7fee7e000640 1 --2- 172.21.15.2:0/2123933359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee80158d50 0x7fee80155730 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fee6c005840 tx=0x7fee6c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.109+0000 7fee76000640 1 -- 172.21.15.2:0/2123933359 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c005aa0 con 0x7fee80158d50 2024-08-17T02:26:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.109+0000 7fee76000640 1 -- 172.21.15.2:0/2123933359 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6c005c00 con 0x7fee80158d50 2024-08-17T02:26:50.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.109+0000 7fee76000640 1 -- 172.21.15.2:0/2123933359 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c0070d0 con 0x7fee80158d50 2024-08-17T02:26:50.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.109+0000 7fee85e00640 1 -- 172.21.15.2:0/2123933359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee80154e60 con 0x7fee80158d50 2024-08-17T02:26:50.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.109+0000 7fee85e00640 1 -- 172.21.15.2:0/2123933359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee8015bca0 con 0x7fee80158d50 2024-08-17T02:26:50.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.110+0000 7fee85e00640 1 -- 172.21.15.2:0/2123933359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee80063fb0 con 0x7fee80158d50 2024-08-17T02:26:50.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.111+0000 7fee76000640 1 -- 172.21.15.2:0/2123933359 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fee6c007500 con 0x7fee80158d50 2024-08-17T02:26:50.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.112+0000 7fee76000640 1 --2- 172.21.15.2:0/2123933359 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fee60065150 0x7fee60067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.112+0000 7fee76000640 1 -- 172.21.15.2:0/2123933359 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fee6c0819c0 con 0x7fee80158d50 2024-08-17T02:26:50.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.112+0000 7fee7ea00640 1 --2- 172.21.15.2:0/2123933359 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fee60065150 0x7fee60067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.113+0000 7fee7ea00640 1 --2- 172.21.15.2:0/2123933359 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fee60065150 0x7fee60067600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fee70000c00 tx=0x7fee70007ca0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.116+0000 7fee76000640 1 -- 172.21.15.2:0/2123933359 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fee6c04fa10 con 0x7fee80158d50 2024-08-17T02:26:50.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.337+0000 7fee85e00640 1 -- 172.21.15.2:0/2123933359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000001044477"} v 0) v1 -- 0x7fee800b28f0 con 0x7fee80158d50 2024-08-17T02:26:50.339 INFO:tasks.ceph.mon.a.smithi002.stderr:2024-08-17T02:26:50.338+0000 7f7a23e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:26:50.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.342+0000 7fee76000640 1 -- 172.21.15.2:0/2123933359 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000001044477"}]=0 volume_0000000001044477 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 195+0+0 (secure 0 0 0) 0x7fee6c017020 con 0x7fee80158d50 2024-08-17T02:26:50.343 INFO:teuthology.orchestra.run.smithi002.stderr:volume_0000000001044477 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:26:50.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.344+0000 7fee85e00640 1 -- 172.21.15.2:0/2123933359 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fee60065150 msgr2=0x7fee60067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.344+0000 7fee85e00640 1 --2- 172.21.15.2:0/2123933359 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fee60065150 0x7fee60067600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fee70000c00 tx=0x7fee70007ca0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.344+0000 7fee85e00640 1 -- 172.21.15.2:0/2123933359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee80158d50 msgr2=0x7fee80155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.344+0000 7fee85e00640 1 --2- 172.21.15.2:0/2123933359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee80158d50 0x7fee80155730 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fee6c005840 tx=0x7fee6c007e10 comp rx=0 tx=0).stop 2024-08-17T02:26:50.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.345+0000 7fee85e00640 1 -- 172.21.15.2:0/2123933359 shutdown_connections 2024-08-17T02:26:50.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.345+0000 7fee85e00640 1 --2- 172.21.15.2:0/2123933359 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fee60065150 0x7fee60067600 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.345+0000 7fee85e00640 1 --2- 172.21.15.2:0/2123933359 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee80159120 0x7fee801524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.345+0000 7fee85e00640 1 --2- 172.21.15.2:0/2123933359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee80158d50 0x7fee80155730 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.345+0000 7fee85e00640 1 --2- 172.21.15.2:0/2123933359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee800ac000 0x7fee8015b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.345+0000 7fee85e00640 1 -- 172.21.15.2:0/2123933359 >> 172.21.15.2:0/2123933359 conn(0x7fee80095a70 msgr2=0x7fee80066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:50.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.345+0000 7fee85e00640 1 -- 172.21.15.2:0/2123933359 shutdown_connections 2024-08-17T02:26:50.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.345+0000 7fee85e00640 1 -- 172.21.15.2:0/2123933359 wait complete. 2024-08-17T02:26:50.352 INFO:tasks.ceph.mds.d.smithi145.stderr: -3103> 2024-08-17T02:24:41.614+0000 7f9368400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:26:50.362 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000001044477 --yes-i-really-mean-it 2024-08-17T02:26:50.396 INFO:tasks.ceph.mds.d.smithi145.stdout:starting mds.d at 2024-08-17T02:26:50.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.517+0000 7f7877400640 1 Processor -- start 2024-08-17T02:26:50.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.517+0000 7f7877400640 1 -- start start 2024-08-17T02:26:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.518+0000 7f7877400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f787006e060 0x7f787006e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.518+0000 7f7877400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f78700af340 0x7f78700af780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.518+0000 7f7877400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78700aeeb0 con 0x7f7870155040 2024-08-17T02:26:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.518+0000 7f7877400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f787006e9f0 con 0x7f78700af340 2024-08-17T02:26:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.518+0000 7f7877400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78700aadd0 con 0x7f787006e060 2024-08-17T02:26:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.518+0000 7f7875400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f78700af340 0x7f78700af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.518+0000 7f7875400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f78700af340 0x7f78700af780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57704/0 (socket says 172.21.15.2:57704) 2024-08-17T02:26:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.518+0000 7f7875400640 1 -- 172.21.15.2:0/3319781615 learned_addr learned my addr 172.21.15.2:0/3319781615 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.518+0000 7f7874a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7870155040 0x7f7870158c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35936/0 (socket says 172.21.15.2:35936) 2024-08-17T02:26:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.519+0000 7f786fe00640 1 --2- 172.21.15.2:0/3319781615 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f787006e060 0x7f787006e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.519+0000 7f7875400640 1 -- 172.21.15.2:0/3319781615 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f787006e060 msgr2=0x7f787006e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:50.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.519+0000 7f7875400640 1 --2- 172.21.15.2:0/3319781615 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f787006e060 0x7f787006e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.519+0000 7f7875400640 1 -- 172.21.15.2:0/3319781615 >> v1:172.21.15.2:6789/0 conn(0x7f7870155040 legacy=0x7f7870158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.519+0000 7f7875400640 1 -- 172.21.15.2:0/3319781615 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78701597f0 con 0x7f78700af340 2024-08-17T02:26:50.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.520+0000 7f7875400640 1 --2- 172.21.15.2:0/3319781615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78700af340 0x7f78700af780 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7868009f20 tx=0x7f7868009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8ef9fbc942a60e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.520+0000 7f786f400640 1 -- 172.21.15.2:0/3319781615 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7868031400 con 0x7f78700af340 2024-08-17T02:26:50.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.520+0000 7f786f400640 1 -- 172.21.15.2:0/3319781615 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786802d050 con 0x7f78700af340 2024-08-17T02:26:50.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.520+0000 7f786f400640 1 -- 172.21.15.2:0/3319781615 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78680317d0 con 0x7f78700af340 2024-08-17T02:26:50.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.521+0000 7f7877400640 1 -- 172.21.15.2:0/3319781615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78700af340 msgr2=0x7f78700af780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.521+0000 7f7877400640 1 --2- 172.21.15.2:0/3319781615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78700af340 0x7f78700af780 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7868009f20 tx=0x7f7868009840 comp rx=0 tx=0).stop 2024-08-17T02:26:50.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.521+0000 7f7877400640 1 -- 172.21.15.2:0/3319781615 shutdown_connections 2024-08-17T02:26:50.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.521+0000 7f7877400640 1 --2- 172.21.15.2:0/3319781615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78700af340 0x7f78700af780 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.521+0000 7f7877400640 1 --2- 172.21.15.2:0/3319781615 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f787006e060 0x7f787006e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.521+0000 7f7877400640 1 -- 172.21.15.2:0/3319781615 >> 172.21.15.2:0/3319781615 conn(0x7f7870066e60 msgr2=0x7f7870067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:50.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.521+0000 7f7877400640 1 -- 172.21.15.2:0/3319781615 shutdown_connections 2024-08-17T02:26:50.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.521+0000 7f7877400640 1 -- 172.21.15.2:0/3319781615 wait complete. 2024-08-17T02:26:50.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.522+0000 7f7877400640 1 Processor -- start 2024-08-17T02:26:50.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.522+0000 7f7877400640 1 -- start start 2024-08-17T02:26:50.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.523+0000 7f7877400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f787006e060 0x7f7870166400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.523+0000 7f7877400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78700af340 0x7f7870157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.523+0000 7f7877400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7870155040 0x7f78700a9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.523+0000 7f7877400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78700a5850 con 0x7f787006e060 2024-08-17T02:26:50.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.523+0000 7f7877400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7870141000 con 0x7f7870155040 2024-08-17T02:26:50.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.523+0000 7f7877400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78700a5520 con 0x7f78700af340 2024-08-17T02:26:50.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.523+0000 7f7874a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f787006e060 0x7f7870166400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.524+0000 7f7874a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f787006e060 0x7f7870166400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57708/0 (socket says 172.21.15.2:57708) 2024-08-17T02:26:50.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.524+0000 7f7874a00640 1 -- 172.21.15.2:0/1566670072 learned_addr learned my addr 172.21.15.2:0/1566670072 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:50.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.524+0000 7f786fe00640 1 --2- 172.21.15.2:0/1566670072 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78700af340 0x7f7870157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.524+0000 7f7875400640 1 --2- 172.21.15.2:0/1566670072 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7870155040 0x7f78700a9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.524+0000 7f7874a00640 1 -- 172.21.15.2:0/1566670072 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78700af340 msgr2=0x7f7870157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.524+0000 7f7874a00640 1 --2- 172.21.15.2:0/1566670072 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78700af340 0x7f7870157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.524+0000 7f7874a00640 1 -- 172.21.15.2:0/1566670072 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7870155040 msgr2=0x7f78700a9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.524+0000 7f7874a00640 1 --2- 172.21.15.2:0/1566670072 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7870155040 0x7f78700a9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.524+0000 7f7874a00640 1 -- 172.21.15.2:0/1566670072 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7868009ae0 con 0x7f787006e060 2024-08-17T02:26:50.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.524+0000 7f7874a00640 1 --2- 172.21.15.2:0/1566670072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f787006e060 0x7f7870166400 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f786400c590 tx=0x7f7864007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.525+0000 7f7863e00640 1 -- 172.21.15.2:0/1566670072 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78640058b0 con 0x7f787006e060 2024-08-17T02:26:50.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.525+0000 7f7863e00640 1 -- 172.21.15.2:0/1566670072 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7864005a50 con 0x7f787006e060 2024-08-17T02:26:50.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.525+0000 7f7863e00640 1 -- 172.21.15.2:0/1566670072 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7864005e10 con 0x7f787006e060 2024-08-17T02:26:50.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.525+0000 7f7877400640 1 -- 172.21.15.2:0/1566670072 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7870158430 con 0x7f787006e060 2024-08-17T02:26:50.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.525+0000 7f7877400640 1 -- 172.21.15.2:0/1566670072 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78701589f0 con 0x7f787006e060 2024-08-17T02:26:50.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.526+0000 7f7877400640 1 -- 172.21.15.2:0/1566670072 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7870063fb0 con 0x7f787006e060 2024-08-17T02:26:50.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.527+0000 7f7863e00640 1 -- 172.21.15.2:0/1566670072 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f78640072e0 con 0x7f787006e060 2024-08-17T02:26:50.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.528+0000 7f7863e00640 1 --2- 172.21.15.2:0/1566670072 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7850065150 0x7f7850067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.528+0000 7f7863e00640 1 -- 172.21.15.2:0/1566670072 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f78640817f0 con 0x7f787006e060 2024-08-17T02:26:50.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.528+0000 7f786fe00640 1 --2- 172.21.15.2:0/1566670072 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7850065150 0x7f7850067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.529+0000 7f786fe00640 1 --2- 172.21.15.2:0/1566670072 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7850065150 0x7f7850067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f78700a5430 tx=0x7f785c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.532+0000 7f7863e00640 1 -- 172.21.15.2:0/1566670072 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f786404be40 con 0x7f787006e060 2024-08-17T02:26:50.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:50.750+0000 7f7877400640 1 -- 172.21.15.2:0/1566670072 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000001044477", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7870154bd0 con 0x7f787006e060 2024-08-17T02:26:51.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.344+0000 7f7863e00640 1 -- 172.21.15.2:0/1566670072 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000001044477", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 121+0+0 (secure 0 0 0) 0x7f786404f7e0 con 0x7f787006e060 2024-08-17T02:26:51.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.346+0000 7f7877400640 1 -- 172.21.15.2:0/1566670072 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7850065150 msgr2=0x7f7850067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.346+0000 7f7877400640 1 --2- 172.21.15.2:0/1566670072 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7850065150 0x7f7850067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f78700a5430 tx=0x7f785c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:51.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.346+0000 7f7877400640 1 -- 172.21.15.2:0/1566670072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f787006e060 msgr2=0x7f7870166400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.346+0000 7f7877400640 1 --2- 172.21.15.2:0/1566670072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f787006e060 0x7f7870166400 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f786400c590 tx=0x7f7864007f40 comp rx=0 tx=0).stop 2024-08-17T02:26:51.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.346+0000 7f7877400640 1 -- 172.21.15.2:0/1566670072 shutdown_connections 2024-08-17T02:26:51.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.346+0000 7f7877400640 1 --2- 172.21.15.2:0/1566670072 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7870155040 0x7f78700a9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.346+0000 7f7877400640 1 --2- 172.21.15.2:0/1566670072 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7850065150 0x7f7850067600 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.346+0000 7f7877400640 1 --2- 172.21.15.2:0/1566670072 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78700af340 0x7f7870157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.346+0000 7f7877400640 1 --2- 172.21.15.2:0/1566670072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f787006e060 0x7f7870166400 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.346+0000 7f7877400640 1 -- 172.21.15.2:0/1566670072 >> 172.21.15.2:0/1566670072 conn(0x7f7870066e60 msgr2=0x7f787006d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:51.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.346+0000 7f7877400640 1 -- 172.21.15.2:0/1566670072 shutdown_connections 2024-08-17T02:26:51.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.346+0000 7f7877400640 1 -- 172.21.15.2:0/1566670072 wait complete. 2024-08-17T02:26:51.364 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000001044477.meta cephfs.volume_0000000001044477.meta --yes-i-really-really-mean-it 2024-08-17T02:26:51.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.523+0000 7f4970a00640 1 Processor -- start 2024-08-17T02:26:51.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.523+0000 7f4970a00640 1 -- start start 2024-08-17T02:26:51.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.524+0000 7f4970a00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f496c0b2180 0x7f496c0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.524+0000 7f4970a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f496c0cc9e0 con 0x7f496c158f80 2024-08-17T02:26:51.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.524+0000 7f4970a00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f496c0cbdd0 con 0x7f496c158bb0 2024-08-17T02:26:51.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.524+0000 7f4970a00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496c0cc0b0 con 0x7f496c0b2180 2024-08-17T02:26:51.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.524+0000 7f4969400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f496c158f80 0x7f496c0b1a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35948/0 (socket says 172.21.15.2:35948) 2024-08-17T02:26:51.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.524+0000 7f4969400640 1 -- 172.21.15.2:0/1284479663 learned_addr learned my addr 172.21.15.2:0/1284479663 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:26:51.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.525+0000 7f496a800640 1 --2- 172.21.15.2:0/1284479663 >> v2:172.21.15.145:3300/0 conn(0x7f496c0b2180 0x7f496c0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.525+0000 7f4968a00640 1 -- 172.21.15.2:0/1284479663 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1438457573 0 0) 0x7f496c0cc9e0 con 0x7f496c158f80 2024-08-17T02:26:51.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.525+0000 7f4968a00640 1 -- 172.21.15.2:0/1284479663 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49500034e0 con 0x7f496c158f80 2024-08-17T02:26:51.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.525+0000 7f496a800640 1 -- 172.21.15.2:0/1284479663 >> v1:172.21.15.145:6789/0 conn(0x7f496c158bb0 legacy=0x7f496c0cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.525+0000 7f496a800640 1 -- 172.21.15.2:0/1284479663 >> v1:172.21.15.2:6789/0 conn(0x7f496c158f80 legacy=0x7f496c0b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.525+0000 7f496a800640 1 -- 172.21.15.2:0/1284479663 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496c0cc390 con 0x7f496c0b2180 2024-08-17T02:26:51.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.526+0000 7f496a800640 1 --2- 172.21.15.2:0/1284479663 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f496c0b2180 0x7f496c0cce70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4964009e60 tx=0x7f4964009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91e1f2594a563b8e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:51.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.526+0000 7f4968a00640 1 -- 172.21.15.2:0/1284479663 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4964007550 con 0x7f496c0b2180 2024-08-17T02:26:51.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.526+0000 7f4968a00640 1 -- 172.21.15.2:0/1284479663 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496402d050 con 0x7f496c0b2180 2024-08-17T02:26:51.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.527+0000 7f4968a00640 1 -- 172.21.15.2:0/1284479663 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49640078e0 con 0x7f496c0b2180 2024-08-17T02:26:51.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.527+0000 7f4970a00640 1 -- 172.21.15.2:0/1284479663 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f496c0b2180 msgr2=0x7f496c0cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.527+0000 7f4970a00640 1 --2- 172.21.15.2:0/1284479663 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f496c0b2180 0x7f496c0cce70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4964009e60 tx=0x7f4964009780 comp rx=0 tx=0).stop 2024-08-17T02:26:51.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.527+0000 7f4970a00640 1 -- 172.21.15.2:0/1284479663 shutdown_connections 2024-08-17T02:26:51.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.527+0000 7f4970a00640 1 --2- 172.21.15.2:0/1284479663 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f496c0b2180 0x7f496c0cce70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.527+0000 7f4970a00640 1 -- 172.21.15.2:0/1284479663 >> 172.21.15.2:0/1284479663 conn(0x7f496c06e590 msgr2=0x7f496c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:51.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.527+0000 7f4970a00640 1 -- 172.21.15.2:0/1284479663 shutdown_connections 2024-08-17T02:26:51.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.527+0000 7f4970a00640 1 -- 172.21.15.2:0/1284479663 wait complete. 2024-08-17T02:26:51.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.528+0000 7f4970a00640 1 Processor -- start 2024-08-17T02:26:51.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.529+0000 7f4970a00640 1 -- start start 2024-08-17T02:26:51.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.529+0000 7f4970a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f496c0b2180 0x7f496c1564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.529+0000 7f4970a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f496c158bb0 0x7f496c159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.529+0000 7f4970a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f496c158f80 0x7f496c0c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.529+0000 7f4970a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c15ad50 con 0x7f496c0b2180 2024-08-17T02:26:51.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.529+0000 7f4970a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c15a3a0 con 0x7f496c158bb0 2024-08-17T02:26:51.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.529+0000 7f4970a00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496c1593f0 con 0x7f496c158f80 2024-08-17T02:26:51.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.530+0000 7f4969e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f496c0b2180 0x7f496c1564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.530+0000 7f4969e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f496c0b2180 0x7f496c1564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57714/0 (socket says 172.21.15.2:57714) 2024-08-17T02:26:51.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.530+0000 7f4969e00640 1 -- 172.21.15.2:0/3386829871 learned_addr learned my addr 172.21.15.2:0/3386829871 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:51.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.530+0000 7f496a800640 1 --2- 172.21.15.2:0/3386829871 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f496c158f80 0x7f496c0c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.530+0000 7f4969400640 1 --2- 172.21.15.2:0/3386829871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f496c158bb0 0x7f496c159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.530+0000 7f4969e00640 1 -- 172.21.15.2:0/3386829871 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f496c158f80 msgr2=0x7f496c0c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.530+0000 7f4969e00640 1 --2- 172.21.15.2:0/3386829871 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f496c158f80 0x7f496c0c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.530+0000 7f4969e00640 1 -- 172.21.15.2:0/3386829871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f496c158bb0 msgr2=0x7f496c159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.530+0000 7f4969e00640 1 --2- 172.21.15.2:0/3386829871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f496c158bb0 0x7f496c159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.530+0000 7f4969e00640 1 -- 172.21.15.2:0/3386829871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4964009a20 con 0x7f496c0b2180 2024-08-17T02:26:51.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.530+0000 7f4969400640 1 --2- 172.21.15.2:0/3386829871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f496c158bb0 0x7f496c159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:51.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.530+0000 7f4969e00640 1 --2- 172.21.15.2:0/3386829871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f496c0b2180 0x7f496c1564b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f495c00c560 tx=0x7f495c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:51.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.531+0000 7f4961600640 1 -- 172.21.15.2:0/3386829871 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c011590 con 0x7f496c0b2180 2024-08-17T02:26:51.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.531+0000 7f4961600640 1 -- 172.21.15.2:0/3386829871 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495c011710 con 0x7f496c0b2180 2024-08-17T02:26:51.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.531+0000 7f4961600640 1 -- 172.21.15.2:0/3386829871 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c011ad0 con 0x7f496c0b2180 2024-08-17T02:26:51.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.531+0000 7f4970a00640 1 -- 172.21.15.2:0/3386829871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f496c15be30 con 0x7f496c0b2180 2024-08-17T02:26:51.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.531+0000 7f4970a00640 1 -- 172.21.15.2:0/3386829871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496c159940 con 0x7f496c0b2180 2024-08-17T02:26:51.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.532+0000 7f4970a00640 1 -- 172.21.15.2:0/3386829871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f496c159b90 con 0x7f496c0b2180 2024-08-17T02:26:51.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.533+0000 7f4961600640 1 -- 172.21.15.2:0/3386829871 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f495c01b3b0 con 0x7f496c0b2180 2024-08-17T02:26:51.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.534+0000 7f4961600640 1 --2- 172.21.15.2:0/3386829871 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f494c065180 0x7f494c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.534+0000 7f4961600640 1 -- 172.21.15.2:0/3386829871 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f495c081af0 con 0x7f496c0b2180 2024-08-17T02:26:51.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.534+0000 7f4969400640 1 --2- 172.21.15.2:0/3386829871 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f494c065180 0x7f494c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.535+0000 7f4969400640 1 --2- 172.21.15.2:0/3386829871 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f494c065180 0x7f494c067630 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4958007fd0 tx=0x7f4958009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:51.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.537+0000 7f4961600640 1 -- 172.21.15.2:0/3386829871 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f495c04fa30 con 0x7f496c0b2180 2024-08-17T02:26:51.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:51.721+0000 7f4970a00640 1 -- 172.21.15.2:0/3386829871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000001044477.meta", "pool2": "cephfs.volume_0000000001044477.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f496c063fb0 con 0x7f496c0b2180 2024-08-17T02:26:52.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.499+0000 7f4961600640 1 -- 172.21.15.2:0/3386829871 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000001044477.meta", "pool2": "cephfs.volume_0000000001044477.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000001044477.meta' removed v41) v1 ==== 241+0+0 (secure 0 0 0) 0x7f495c017070 con 0x7f496c0b2180 2024-08-17T02:26:52.500 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs.volume_0000000001044477.meta' removed 2024-08-17T02:26:52.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.502+0000 7f4970a00640 1 -- 172.21.15.2:0/3386829871 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f494c065180 msgr2=0x7f494c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.502+0000 7f4970a00640 1 --2- 172.21.15.2:0/3386829871 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f494c065180 0x7f494c067630 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4958007fd0 tx=0x7f4958009040 comp rx=0 tx=0).stop 2024-08-17T02:26:52.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.502+0000 7f4970a00640 1 -- 172.21.15.2:0/3386829871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f496c0b2180 msgr2=0x7f496c1564b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.502+0000 7f4970a00640 1 --2- 172.21.15.2:0/3386829871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f496c0b2180 0x7f496c1564b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f495c00c560 tx=0x7f495c007ef0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.502+0000 7f4970a00640 1 -- 172.21.15.2:0/3386829871 shutdown_connections 2024-08-17T02:26:52.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.502+0000 7f4970a00640 1 --2- 172.21.15.2:0/3386829871 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f494c065180 0x7f494c067630 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.502+0000 7f4970a00640 1 --2- 172.21.15.2:0/3386829871 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f496c158f80 0x7f496c0c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.502+0000 7f4970a00640 1 --2- 172.21.15.2:0/3386829871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f496c158bb0 0x7f496c159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.502+0000 7f4970a00640 1 --2- 172.21.15.2:0/3386829871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f496c0b2180 0x7f496c1564b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.502+0000 7f4970a00640 1 -- 172.21.15.2:0/3386829871 >> 172.21.15.2:0/3386829871 conn(0x7f496c06e590 msgr2=0x7f496c0b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:52.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.502+0000 7f4970a00640 1 -- 172.21.15.2:0/3386829871 shutdown_connections 2024-08-17T02:26:52.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.502+0000 7f4970a00640 1 -- 172.21.15.2:0/3386829871 wait complete. 2024-08-17T02:26:52.521 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000001044477.data cephfs.volume_0000000001044477.data --yes-i-really-really-mean-it 2024-08-17T02:26:52.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.679+0000 7f17ef600640 1 Processor -- start 2024-08-17T02:26:52.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.679+0000 7f17ef600640 1 -- start start 2024-08-17T02:26:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.680+0000 7f17ef600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f17e80ad660 0x7f17e80abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.681+0000 7f17ef600640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f17e80cc840 0x7f17e81607f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.681+0000 7f17ef600640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e80ae720 con 0x7f17e8156b20 2024-08-17T02:26:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.681+0000 7f17ef600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e80adb10 con 0x7f17e80ad660 2024-08-17T02:26:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.681+0000 7f17ef600640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e80addf0 con 0x7f17e80cc840 2024-08-17T02:26:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.681+0000 7f17e7e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f17e80ad660 0x7f17e80abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.681+0000 7f17e7e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f17e80ad660 0x7f17e80abcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57726/0 (socket says 172.21.15.2:57726) 2024-08-17T02:26:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.681+0000 7f17e7e00640 1 -- 172.21.15.2:0/1022339100 learned_addr learned my addr 172.21.15.2:0/1022339100 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:52.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.681+0000 7f17ed600640 1 --2- 172.21.15.2:0/1022339100 >> v2:172.21.15.145:3300/0 conn(0x7f17e80cc840 0x7f17e81607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.681+0000 7f17e7e00640 1 -- 172.21.15.2:0/1022339100 >> v2:172.21.15.145:3300/0 conn(0x7f17e80cc840 msgr2=0x7f17e81607f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:52.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.681+0000 7f17e7e00640 1 --2- 172.21.15.2:0/1022339100 >> v2:172.21.15.145:3300/0 conn(0x7f17e80cc840 0x7f17e81607f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.681+0000 7f17e7e00640 1 -- 172.21.15.2:0/1022339100 >> v1:172.21.15.145:6789/0 conn(0x7f17e8156b20 legacy=0x7f17e80cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.681+0000 7f17e7e00640 1 -- 172.21.15.2:0/1022339100 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e80ae0d0 con 0x7f17e80ad660 2024-08-17T02:26:52.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.681+0000 7f17ed600640 1 --2- 172.21.15.2:0/1022339100 >> v2:172.21.15.145:3300/0 conn(0x7f17e80cc840 0x7f17e81607f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:52.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.682+0000 7f17e7e00640 1 --2- 172.21.15.2:0/1022339100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17e80ad660 0x7f17e80abcc0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f17e806d1c0 tx=0x7f17d40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cade510967bea9d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.683+0000 7f17e7400640 1 -- 172.21.15.2:0/1022339100 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d4032440 con 0x7f17e80ad660 2024-08-17T02:26:52.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.683+0000 7f17e7400640 1 -- 172.21.15.2:0/1022339100 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d40325a0 con 0x7f17e80ad660 2024-08-17T02:26:52.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.683+0000 7f17e7400640 1 -- 172.21.15.2:0/1022339100 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d4032980 con 0x7f17e80ad660 2024-08-17T02:26:52.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.683+0000 7f17ef600640 1 -- 172.21.15.2:0/1022339100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17e80ad660 msgr2=0x7f17e80abcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.683+0000 7f17ef600640 1 --2- 172.21.15.2:0/1022339100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17e80ad660 0x7f17e80abcc0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f17e806d1c0 tx=0x7f17d40091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.683+0000 7f17ef600640 1 -- 172.21.15.2:0/1022339100 shutdown_connections 2024-08-17T02:26:52.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.683+0000 7f17ef600640 1 --2- 172.21.15.2:0/1022339100 >> v2:172.21.15.145:3300/0 conn(0x7f17e80cc840 0x7f17e81607f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.683+0000 7f17ef600640 1 --2- 172.21.15.2:0/1022339100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17e80ad660 0x7f17e80abcc0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.683+0000 7f17ef600640 1 -- 172.21.15.2:0/1022339100 >> 172.21.15.2:0/1022339100 conn(0x7f17e80af1f0 msgr2=0x7f17e80af5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:52.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.684+0000 7f17ef600640 1 -- 172.21.15.2:0/1022339100 shutdown_connections 2024-08-17T02:26:52.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.684+0000 7f17ef600640 1 -- 172.21.15.2:0/1022339100 wait complete. 2024-08-17T02:26:52.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.685+0000 7f17ef600640 1 Processor -- start 2024-08-17T02:26:52.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.685+0000 7f17ef600640 1 -- start start 2024-08-17T02:26:52.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.686+0000 7f17ef600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17e80ad660 0x7f17e8168f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.686+0000 7f17ef600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17e80cc840 0x7f17e81559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.686+0000 7f17ef600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17e8156b20 0x7f17e814c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.686+0000 7f17ef600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e80a91b0 con 0x7f17e80cc840 2024-08-17T02:26:52.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.686+0000 7f17ef600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e8169600 con 0x7f17e80ad660 2024-08-17T02:26:52.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.686+0000 7f17ef600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e81698e0 con 0x7f17e8156b20 2024-08-17T02:26:52.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.686+0000 7f17e7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17e80cc840 0x7f17e81559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.686+0000 7f17e7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17e80cc840 0x7f17e81559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57736/0 (socket says 172.21.15.2:57736) 2024-08-17T02:26:52.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.686+0000 7f17e7e00640 1 -- 172.21.15.2:0/3825236018 learned_addr learned my addr 172.21.15.2:0/3825236018 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:52.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.687+0000 7f17ed600640 1 --2- 172.21.15.2:0/3825236018 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17e8156b20 0x7f17e814c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.687+0000 7f17ecc00640 1 --2- 172.21.15.2:0/3825236018 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17e80ad660 0x7f17e8168f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.687+0000 7f17e7e00640 1 -- 172.21.15.2:0/3825236018 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17e8156b20 msgr2=0x7f17e814c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.687+0000 7f17e7e00640 1 --2- 172.21.15.2:0/3825236018 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17e8156b20 0x7f17e814c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.687+0000 7f17e7e00640 1 -- 172.21.15.2:0/3825236018 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17e80ad660 msgr2=0x7f17e8168f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.687+0000 7f17e7e00640 1 --2- 172.21.15.2:0/3825236018 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17e80ad660 0x7f17e8168f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.687+0000 7f17e7e00640 1 -- 172.21.15.2:0/3825236018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d4009450 con 0x7f17e80cc840 2024-08-17T02:26:52.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.687+0000 7f17e7e00640 1 --2- 172.21.15.2:0/3825236018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17e80cc840 0x7f17e81559d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f17d4009210 tx=0x7f17d4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.687+0000 7f17dbe00640 1 -- 172.21.15.2:0/3825236018 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d4031c80 con 0x7f17e80cc840 2024-08-17T02:26:52.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.687+0000 7f17dbe00640 1 -- 172.21.15.2:0/3825236018 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d4031e00 con 0x7f17e80cc840 2024-08-17T02:26:52.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.687+0000 7f17dbe00640 1 -- 172.21.15.2:0/3825236018 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d403d670 con 0x7f17e80cc840 2024-08-17T02:26:52.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.687+0000 7f17ef600640 1 -- 172.21.15.2:0/3825236018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e8169bc0 con 0x7f17e80cc840 2024-08-17T02:26:52.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.687+0000 7f17ef600640 1 -- 172.21.15.2:0/3825236018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e8155f10 con 0x7f17e80cc840 2024-08-17T02:26:52.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.688+0000 7f17ef600640 1 -- 172.21.15.2:0/3825236018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e80689e0 con 0x7f17e80cc840 2024-08-17T02:26:52.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.689+0000 7f17dbe00640 1 -- 172.21.15.2:0/3825236018 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f17d4039040 con 0x7f17e80cc840 2024-08-17T02:26:52.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.690+0000 7f17dbe00640 1 --2- 172.21.15.2:0/3825236018 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f17c8065150 0x7f17c8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.690+0000 7f17dbe00640 1 -- 172.21.15.2:0/3825236018 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5448+0+0 (secure 0 0 0) 0x7f17d40a2250 con 0x7f17e80cc840 2024-08-17T02:26:52.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.690+0000 7f17ecc00640 1 --2- 172.21.15.2:0/3825236018 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f17c8065150 0x7f17c8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.691+0000 7f17ecc00640 1 --2- 172.21.15.2:0/3825236018 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f17c8065150 0x7f17c8067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f17dc003720 tx=0x7f17dc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.694+0000 7f17dbe00640 1 -- 172.21.15.2:0/3825236018 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f17d4070370 con 0x7f17e80cc840 2024-08-17T02:26:52.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:52.877+0000 7f17ef600640 1 -- 172.21.15.2:0/3825236018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000001044477.data", "pool2": "cephfs.volume_0000000001044477.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f17e8063fb0 con 0x7f17e80cc840 2024-08-17T02:26:53.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.505+0000 7f17dbe00640 1 -- 172.21.15.2:0/3825236018 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000001044477.data", "pool2": "cephfs.volume_0000000001044477.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000001044477.data' removed v42) v1 ==== 241+0+0 (secure 0 0 0) 0x7f17d4073990 con 0x7f17e80cc840 2024-08-17T02:26:53.506 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs.volume_0000000001044477.data' removed 2024-08-17T02:26:53.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.508+0000 7f17ef600640 1 -- 172.21.15.2:0/3825236018 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f17c8065150 msgr2=0x7f17c8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.508+0000 7f17ef600640 1 --2- 172.21.15.2:0/3825236018 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f17c8065150 0x7f17c8067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f17dc003720 tx=0x7f17dc009040 comp rx=0 tx=0).stop 2024-08-17T02:26:53.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.508+0000 7f17ef600640 1 -- 172.21.15.2:0/3825236018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17e80cc840 msgr2=0x7f17e81559d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.508+0000 7f17ef600640 1 --2- 172.21.15.2:0/3825236018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17e80cc840 0x7f17e81559d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f17d4009210 tx=0x7f17d4032000 comp rx=0 tx=0).stop 2024-08-17T02:26:53.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.508+0000 7f17ef600640 1 -- 172.21.15.2:0/3825236018 shutdown_connections 2024-08-17T02:26:53.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.508+0000 7f17ef600640 1 --2- 172.21.15.2:0/3825236018 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f17c8065150 0x7f17c8067600 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.508+0000 7f17ef600640 1 --2- 172.21.15.2:0/3825236018 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17e8156b20 0x7f17e814c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.508+0000 7f17ef600640 1 --2- 172.21.15.2:0/3825236018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17e80cc840 0x7f17e81559d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.508+0000 7f17ef600640 1 --2- 172.21.15.2:0/3825236018 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17e80ad660 0x7f17e8168f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.508+0000 7f17ef600640 1 -- 172.21.15.2:0/3825236018 >> 172.21.15.2:0/3825236018 conn(0x7f17e80af1f0 msgr2=0x7f17e8157230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:53.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.509+0000 7f17ef600640 1 -- 172.21.15.2:0/3825236018 shutdown_connections 2024-08-17T02:26:53.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.509+0000 7f17ef600640 1 -- 172.21.15.2:0/3825236018 wait complete. 2024-08-17T02:26:53.526 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-17T02:26:53.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.679+0000 7efc7f200640 1 Processor -- start 2024-08-17T02:26:53.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.679+0000 7efc7f200640 1 -- start start 2024-08-17T02:26:53.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.680+0000 7efc7f200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efc78158dd0 0x7efc7806e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.680+0000 7efc7f200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7efc7806ead0 0x7efc780b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.680+0000 7efc7f200640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc7806ef10 con 0x7efc78158a00 2024-08-17T02:26:53.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.680+0000 7efc7f200640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc78159200 con 0x7efc7806ead0 2024-08-17T02:26:53.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.680+0000 7efc7f200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc780cbc50 con 0x7efc78158dd0 2024-08-17T02:26:53.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.680+0000 7efc7d400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efc78158dd0 0x7efc7806e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.680+0000 7efc7d400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efc78158dd0 0x7efc7806e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:39062/0 (socket says 172.21.15.2:39062) 2024-08-17T02:26:53.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.680+0000 7efc7d400640 1 -- 172.21.15.2:0/4165270235 learned_addr learned my addr 172.21.15.2:0/4165270235 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:53.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.680+0000 7efc7e800640 1 --2- 172.21.15.2:0/4165270235 >> v2:172.21.15.145:3300/0 conn(0x7efc7806ead0 0x7efc780b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.681+0000 7efc7d400640 1 -- 172.21.15.2:0/4165270235 >> v2:172.21.15.145:3300/0 conn(0x7efc7806ead0 msgr2=0x7efc780b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:53.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.681+0000 7efc7d400640 1 --2- 172.21.15.2:0/4165270235 >> v2:172.21.15.145:3300/0 conn(0x7efc7806ead0 0x7efc780b3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.681+0000 7efc7d400640 1 -- 172.21.15.2:0/4165270235 >> v1:172.21.15.145:6789/0 conn(0x7efc78158a00 legacy=0x7efc780cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.681+0000 7efc7d400640 1 -- 172.21.15.2:0/4165270235 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc780cbf30 con 0x7efc78158dd0 2024-08-17T02:26:53.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.682+0000 7efc7d400640 1 --2- 172.21.15.2:0/4165270235 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efc78158dd0 0x7efc7806e590 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efc78159340 tx=0x7efc680091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5d3a9d33f19cddf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.682+0000 7efc7ca00640 1 -- 172.21.15.2:0/4165270235 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6802ae40 con 0x7efc78158dd0 2024-08-17T02:26:53.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.682+0000 7efc7ca00640 1 -- 172.21.15.2:0/4165270235 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc68032440 con 0x7efc78158dd0 2024-08-17T02:26:53.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.682+0000 7efc7ca00640 1 -- 172.21.15.2:0/4165270235 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc68032820 con 0x7efc78158dd0 2024-08-17T02:26:53.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.683+0000 7efc7f200640 1 -- 172.21.15.2:0/4165270235 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efc78158dd0 msgr2=0x7efc7806e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.683+0000 7efc7f200640 1 --2- 172.21.15.2:0/4165270235 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efc78158dd0 0x7efc7806e590 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efc78159340 tx=0x7efc680091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.683+0000 7efc7f200640 1 -- 172.21.15.2:0/4165270235 shutdown_connections 2024-08-17T02:26:53.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.683+0000 7efc7f200640 1 --2- 172.21.15.2:0/4165270235 >> v2:172.21.15.145:3300/0 conn(0x7efc7806ead0 0x7efc780b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.683+0000 7efc7f200640 1 --2- 172.21.15.2:0/4165270235 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efc78158dd0 0x7efc7806e590 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.683+0000 7efc7f200640 1 -- 172.21.15.2:0/4165270235 >> 172.21.15.2:0/4165270235 conn(0x7efc780cfb80 msgr2=0x7efc780cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:53.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.683+0000 7efc7f200640 1 -- 172.21.15.2:0/4165270235 shutdown_connections 2024-08-17T02:26:53.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.683+0000 7efc7f200640 1 -- 172.21.15.2:0/4165270235 wait complete. 2024-08-17T02:26:53.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.684+0000 7efc7f200640 1 Processor -- start 2024-08-17T02:26:53.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.685+0000 7efc7f200640 1 -- start start 2024-08-17T02:26:53.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.685+0000 7efc7f200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efc7806ead0 0x7efc780c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.685+0000 7efc7f200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efc78158a00 0x7efc780c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.685+0000 7efc7f200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc78158dd0 0x7efc78156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.685+0000 7efc7f200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7816a730 con 0x7efc78158dd0 2024-08-17T02:26:53.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.685+0000 7efc7f200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc780caef0 con 0x7efc78158a00 2024-08-17T02:26:53.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.685+0000 7efc7f200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc780cb1d0 con 0x7efc7806ead0 2024-08-17T02:26:53.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.686+0000 7efc7e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc78158dd0 0x7efc78156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.686+0000 7efc7e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc78158dd0 0x7efc78156650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57740/0 (socket says 172.21.15.2:57740) 2024-08-17T02:26:53.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.686+0000 7efc7e800640 1 -- 172.21.15.2:0/3607215914 learned_addr learned my addr 172.21.15.2:0/3607215914 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:53.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.686+0000 7efc7d400640 1 --2- 172.21.15.2:0/3607215914 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efc78158a00 0x7efc780c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.686+0000 7efc7de00640 1 --2- 172.21.15.2:0/3607215914 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efc7806ead0 0x7efc780c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.686+0000 7efc7e800640 1 -- 172.21.15.2:0/3607215914 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efc7806ead0 msgr2=0x7efc780c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.686+0000 7efc7e800640 1 --2- 172.21.15.2:0/3607215914 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efc7806ead0 0x7efc780c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.686+0000 7efc7e800640 1 -- 172.21.15.2:0/3607215914 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efc78158a00 msgr2=0x7efc780c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.686+0000 7efc7e800640 1 --2- 172.21.15.2:0/3607215914 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efc78158a00 0x7efc780c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.686+0000 7efc7e800640 1 -- 172.21.15.2:0/3607215914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc68009450 con 0x7efc78158dd0 2024-08-17T02:26:53.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.687+0000 7efc7e800640 1 --2- 172.21.15.2:0/3607215914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc78158dd0 0x7efc78156650 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7efc74009e90 tx=0x7efc7400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.687+0000 7efc71600640 1 -- 172.21.15.2:0/3607215914 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7400ce10 con 0x7efc78158dd0 2024-08-17T02:26:53.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.687+0000 7efc71600640 1 -- 172.21.15.2:0/3607215914 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7400f040 con 0x7efc78158dd0 2024-08-17T02:26:53.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.687+0000 7efc71600640 1 -- 172.21.15.2:0/3607215914 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc740146d0 con 0x7efc78158dd0 2024-08-17T02:26:53.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.687+0000 7efc7f200640 1 -- 172.21.15.2:0/3607215914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc780cb4b0 con 0x7efc78158dd0 2024-08-17T02:26:53.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.687+0000 7efc7f200640 1 -- 172.21.15.2:0/3607215914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc7816ac60 con 0x7efc78158dd0 2024-08-17T02:26:53.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.688+0000 7efc7f200640 1 -- 172.21.15.2:0/3607215914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc7816ae80 con 0x7efc78158dd0 2024-08-17T02:26:53.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.689+0000 7efc71600640 1 -- 172.21.15.2:0/3607215914 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efc74014a80 con 0x7efc78158dd0 2024-08-17T02:26:53.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.690+0000 7efc71600640 1 --2- 172.21.15.2:0/3607215914 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7efc5c065150 0x7efc5c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.690+0000 7efc71600640 1 -- 172.21.15.2:0/3607215914 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7efc74082ff0 con 0x7efc78158dd0 2024-08-17T02:26:53.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.690+0000 7efc7de00640 1 --2- 172.21.15.2:0/3607215914 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7efc5c065150 0x7efc5c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.691+0000 7efc7de00640 1 --2- 172.21.15.2:0/3607215914 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7efc5c065150 0x7efc5c067600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efc780ce870 tx=0x7efc6c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.694+0000 7efc71600640 1 -- 172.21.15.2:0/3607215914 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efc740b4e40 con 0x7efc78158dd0 2024-08-17T02:26:53.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.876+0000 7efc7f200640 1 -- 172.21.15.2:0/3607215914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7efc78070720 con 0x7efc78158dd0 2024-08-17T02:26:53.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.880+0000 7efc71600640 1 -- 172.21.15.2:0/3607215914 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7efc74054e30 con 0x7efc78158dd0 2024-08-17T02:26:53.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.882+0000 7efc7f200640 1 -- 172.21.15.2:0/3607215914 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7efc5c065150 msgr2=0x7efc5c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.882+0000 7efc7f200640 1 --2- 172.21.15.2:0/3607215914 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7efc5c065150 0x7efc5c067600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efc780ce870 tx=0x7efc6c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:53.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.882+0000 7efc7f200640 1 -- 172.21.15.2:0/3607215914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc78158dd0 msgr2=0x7efc78156650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.882+0000 7efc7f200640 1 --2- 172.21.15.2:0/3607215914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc78158dd0 0x7efc78156650 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7efc74009e90 tx=0x7efc7400b040 comp rx=0 tx=0).stop 2024-08-17T02:26:53.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.882+0000 7efc7f200640 1 -- 172.21.15.2:0/3607215914 shutdown_connections 2024-08-17T02:26:53.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.882+0000 7efc7f200640 1 --2- 172.21.15.2:0/3607215914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc78158dd0 0x7efc78156650 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.882+0000 7efc7f200640 1 --2- 172.21.15.2:0/3607215914 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efc78158a00 0x7efc780c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.882+0000 7efc7f200640 1 --2- 172.21.15.2:0/3607215914 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7efc5c065150 0x7efc5c067600 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.882+0000 7efc7f200640 1 --2- 172.21.15.2:0/3607215914 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efc7806ead0 0x7efc780c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.882+0000 7efc7f200640 1 -- 172.21.15.2:0/3607215914 >> 172.21.15.2:0/3607215914 conn(0x7efc780cfb80 msgr2=0x7efc780cc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:53.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.883+0000 7efc7f200640 1 -- 172.21.15.2:0/3607215914 shutdown_connections 2024-08-17T02:26:53.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:53.883+0000 7efc7f200640 1 -- 172.21.15.2:0/3607215914 wait complete. 2024-08-17T02:26:53.900 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:26:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.058+0000 7fa29ee00640 1 Processor -- start 2024-08-17T02:26:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.058+0000 7fa29ee00640 1 -- start start 2024-08-17T02:26:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.059+0000 7fa29ee00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2980ad790 0x7fa2980adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.059+0000 7fa29ee00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa2981559e0 0x7fa2980ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.059+0000 7fa29ee00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2980ca6b0 con 0x7fa2980c9d20 2024-08-17T02:26:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.059+0000 7fa29ee00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2980cb180 con 0x7fa2981559e0 2024-08-17T02:26:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.059+0000 7fa29ee00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2980af530 con 0x7fa2980ad790 2024-08-17T02:26:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.060+0000 7fa29da00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2980ad790 0x7fa2980adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.060+0000 7fa29e400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa2981559e0 0x7fa2980ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.060+0000 7fa29d000640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fa2980c9d20 0x7fa2981552d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:56998/0 (socket says 172.21.15.2:56998) 2024-08-17T02:26:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.060+0000 7fa29da00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2980ad790 0x7fa2980adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:39078/0 (socket says 172.21.15.2:39078) 2024-08-17T02:26:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.060+0000 7fa29d000640 1 -- 172.21.15.2:0/290525524 learned_addr learned my addr 172.21.15.2:0/290525524 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:26:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.060+0000 7fa29e400640 1 -- 172.21.15.2:0/290525524 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2980ad790 msgr2=0x7fa2980adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.060+0000 7fa29e400640 1 --2- 172.21.15.2:0/290525524 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2980ad790 0x7fa2980adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.060+0000 7fa29e400640 1 -- 172.21.15.2:0/290525524 >> v1:172.21.15.145:6789/0 conn(0x7fa2980c9d20 legacy=0x7fa2981552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.060+0000 7fa29e400640 1 -- 172.21.15.2:0/290525524 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2980ca8e0 con 0x7fa2981559e0 2024-08-17T02:26:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.060+0000 7fa29da00640 1 --2- 172.21.15.2:0/290525524 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2980ad790 0x7fa2980adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:54.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.061+0000 7fa29e400640 1 --2- 172.21.15.2:0/290525524 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2981559e0 0x7fa2980ca170 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa290009e60 tx=0x7fa290009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b5c371218d7c729 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.061+0000 7fa297e00640 1 -- 172.21.15.2:0/290525524 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa290007550 con 0x7fa2981559e0 2024-08-17T02:26:54.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.062+0000 7fa297e00640 1 -- 172.21.15.2:0/290525524 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29002d050 con 0x7fa2981559e0 2024-08-17T02:26:54.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.062+0000 7fa297e00640 1 -- 172.21.15.2:0/290525524 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa290007920 con 0x7fa2981559e0 2024-08-17T02:26:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.062+0000 7fa29ee00640 1 -- 172.21.15.2:0/290525524 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2981559e0 msgr2=0x7fa2980ca170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.062+0000 7fa29ee00640 1 --2- 172.21.15.2:0/290525524 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2981559e0 0x7fa2980ca170 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa290009e60 tx=0x7fa290009780 comp rx=0 tx=0).stop 2024-08-17T02:26:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.062+0000 7fa29ee00640 1 -- 172.21.15.2:0/290525524 shutdown_connections 2024-08-17T02:26:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.062+0000 7fa29ee00640 1 --2- 172.21.15.2:0/290525524 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2981559e0 0x7fa2980ca170 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.062+0000 7fa29ee00640 1 --2- 172.21.15.2:0/290525524 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2980ad790 0x7fa2980adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.062+0000 7fa29ee00640 1 -- 172.21.15.2:0/290525524 >> 172.21.15.2:0/290525524 conn(0x7fa298062af0 msgr2=0x7fa298062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.062+0000 7fa29ee00640 1 -- 172.21.15.2:0/290525524 shutdown_connections 2024-08-17T02:26:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.062+0000 7fa29ee00640 1 -- 172.21.15.2:0/290525524 wait complete. 2024-08-17T02:26:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.064+0000 7fa29ee00640 1 Processor -- start 2024-08-17T02:26:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.064+0000 7fa29ee00640 1 -- start start 2024-08-17T02:26:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.065+0000 7fa29ee00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2980ad790 0x7fa2980c1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.065+0000 7fa29ee00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2980c9d20 0x7fa298149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.065+0000 7fa29ee00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2981559e0 0x7fa2980aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.065+0000 7fa29ee00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa298157ac0 con 0x7fa2981559e0 2024-08-17T02:26:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.065+0000 7fa29ee00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa298156e80 con 0x7fa2980c9d20 2024-08-17T02:26:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.065+0000 7fa29ee00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa298157160 con 0x7fa2980ad790 2024-08-17T02:26:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.065+0000 7fa29e400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2981559e0 0x7fa2980aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.065+0000 7fa29e400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2981559e0 0x7fa2980aa9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57750/0 (socket says 172.21.15.2:57750) 2024-08-17T02:26:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.065+0000 7fa29e400640 1 -- 172.21.15.2:0/3032881581 learned_addr learned my addr 172.21.15.2:0/3032881581 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.065+0000 7fa29da00640 1 --2- 172.21.15.2:0/3032881581 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2980ad790 0x7fa2980c1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.065+0000 7fa29d000640 1 --2- 172.21.15.2:0/3032881581 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2980c9d20 0x7fa298149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.065+0000 7fa29e400640 1 -- 172.21.15.2:0/3032881581 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2980ad790 msgr2=0x7fa2980c1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.065+0000 7fa29e400640 1 --2- 172.21.15.2:0/3032881581 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2980ad790 0x7fa2980c1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.065+0000 7fa29e400640 1 -- 172.21.15.2:0/3032881581 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2980c9d20 msgr2=0x7fa298149390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.065+0000 7fa29e400640 1 --2- 172.21.15.2:0/3032881581 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2980c9d20 0x7fa298149390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.065+0000 7fa29e400640 1 -- 172.21.15.2:0/3032881581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c009390 con 0x7fa2981559e0 2024-08-17T02:26:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.066+0000 7fa29e400640 1 --2- 172.21.15.2:0/3032881581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2981559e0 0x7fa2980aa9a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa2900099f0 tx=0x7fa290037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.066+0000 7fa294c00640 1 -- 172.21.15.2:0/3032881581 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa290031b90 con 0x7fa2981559e0 2024-08-17T02:26:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.066+0000 7fa294c00640 1 -- 172.21.15.2:0/3032881581 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa290031cf0 con 0x7fa2981559e0 2024-08-17T02:26:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.066+0000 7fa294c00640 1 -- 172.21.15.2:0/3032881581 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2900456b0 con 0x7fa2981559e0 2024-08-17T02:26:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.066+0000 7fa29ee00640 1 -- 172.21.15.2:0/3032881581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa290009a20 con 0x7fa2981559e0 2024-08-17T02:26:54.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.066+0000 7fa29ee00640 1 -- 172.21.15.2:0/3032881581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa298157750 con 0x7fa2981559e0 2024-08-17T02:26:54.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.067+0000 7fa29ee00640 1 -- 172.21.15.2:0/3032881581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa298157c70 con 0x7fa2981559e0 2024-08-17T02:26:54.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.068+0000 7fa294c00640 1 -- 172.21.15.2:0/3032881581 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa290045a60 con 0x7fa2981559e0 2024-08-17T02:26:54.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.069+0000 7fa294c00640 1 --2- 172.21.15.2:0/3032881581 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa278065180 0x7fa278067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.069+0000 7fa294c00640 1 -- 172.21.15.2:0/3032881581 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fa2900a3e70 con 0x7fa2981559e0 2024-08-17T02:26:54.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.070+0000 7fa29da00640 1 --2- 172.21.15.2:0/3032881581 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa278065180 0x7fa278067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.070+0000 7fa29da00640 1 --2- 172.21.15.2:0/3032881581 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa278065180 0x7fa278067630 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa28c009360 tx=0x7fa28c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.073+0000 7fa294c00640 1 -- 172.21.15.2:0/3032881581 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa298157c70 con 0x7fa2981559e0 2024-08-17T02:26:54.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.321+0000 7fa29ee00640 1 -- 172.21.15.2:0/3032881581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7fa298157c70 con 0x7fa2981559e0 2024-08-17T02:26:54.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.507+0000 7fa294c00640 1 -- 172.21.15.2:0/3032881581 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v157) v1 ==== 135+0+0 (secure 0 0 0) 0x7fa298157c70 con 0x7fa2981559e0 2024-08-17T02:26:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.509+0000 7fa29ee00640 1 -- 172.21.15.2:0/3032881581 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa278065180 msgr2=0x7fa278067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.509+0000 7fa29ee00640 1 --2- 172.21.15.2:0/3032881581 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa278065180 0x7fa278067630 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa28c009360 tx=0x7fa28c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.509+0000 7fa29ee00640 1 -- 172.21.15.2:0/3032881581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2981559e0 msgr2=0x7fa2980aa9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.509+0000 7fa29ee00640 1 --2- 172.21.15.2:0/3032881581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2981559e0 0x7fa2980aa9a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa2900099f0 tx=0x7fa290037000 comp rx=0 tx=0).stop 2024-08-17T02:26:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.510+0000 7fa29ee00640 1 -- 172.21.15.2:0/3032881581 shutdown_connections 2024-08-17T02:26:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.510+0000 7fa29ee00640 1 --2- 172.21.15.2:0/3032881581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2981559e0 0x7fa2980aa9a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.510+0000 7fa29ee00640 1 --2- 172.21.15.2:0/3032881581 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2980c9d20 0x7fa298149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.510+0000 7fa29ee00640 1 --2- 172.21.15.2:0/3032881581 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fa278065180 0x7fa278067630 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.510+0000 7fa29ee00640 1 --2- 172.21.15.2:0/3032881581 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2980ad790 0x7fa2980c1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.510+0000 7fa29ee00640 1 -- 172.21.15.2:0/3032881581 >> 172.21.15.2:0/3032881581 conn(0x7fa298062af0 msgr2=0x7fa2980b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:54.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.510+0000 7fa29ee00640 1 -- 172.21.15.2:0/3032881581 shutdown_connections 2024-08-17T02:26:54.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:54.510+0000 7fa29ee00640 1 -- 172.21.15.2:0/3032881581 wait complete. 2024-08-17T02:26:54.530 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ERROR 2024-08-17T02:26:54.530 INFO:tasks.cephfs_test_runner: 2024-08-17T02:26:54.530 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:26:54.530 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:26:54.530 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:26:54.530 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:26:54.531 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:26:54.531 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:26:54.531 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:26:54.531 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:26:54.531 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:26:54.531 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:26:54.531 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:26:54.531 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:26:54.531 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:26:54.531 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:26:54.531 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:26:54.531 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:26:54.531 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:26:54.531 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:26:54.531 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:26:54.532 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:26:54.532 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:26:54.532 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:26:54.532 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:26:54.532 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000001044477 --yes-i-really-mean-it' 2024-08-17T02:26:54.532 INFO:tasks.cephfs_test_runner: 2024-08-17T02:26:54.532 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:26:54.532 INFO:tasks.cephfs_test_runner:Ran 1 test in 169.653s 2024-08-17T02:26:54.532 INFO:tasks.cephfs_test_runner: 2024-08-17T02:26:54.532 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-08-17T02:26:54.532 INFO:tasks.cephfs_test_runner: 2024-08-17T02:26:54.532 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:26:54.532 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:26:54.533 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:26:54.533 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:26:54.533 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:26:54.533 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:26:54.533 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:26:54.533 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:26:54.533 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:26:54.533 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:26:54.533 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:26:54.533 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:26:54.533 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:26:54.533 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:26:54.533 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:26:54.533 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:26:54.533 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:26:54.533 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:26:54.534 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:26:54.534 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:26:54.534 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:26:54.534 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:26:54.534 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:26:54.534 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000001044477 --yes-i-really-mean-it' 2024-08-17T02:26:54.534 INFO:tasks.cephfs_test_runner: 2024-08-17T02:26:54.534 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:26:54.762 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=95ab7280fd344fbab551a358ad68736b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:26:54.764 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-08-17T02:26:54.771 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-17T02:26:54.780 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-17T02:26:54.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:54.781 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-08-17T02:26:54.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:26:54.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:26:54.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:54.821 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:26:54.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:54.919 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:26:55.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:55.172 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-08-17T02:26:55.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:55.466 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-08-17T02:26:55.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:55.502 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-08-17T02:26:55.603 INFO:teuthology.orchestra.run.smithi002.stderr:Cannot find device "ceph-brx" 2024-08-17T02:26:55.605 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:55.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:55.606 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list 2024-08-17T02:26:55.645 INFO:teuthology.orchestra.run.smithi145.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:26:55.645 INFO:teuthology.orchestra.run.smithi145.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:26:55.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:55.646 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:26:55.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:55.747 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:26:56.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:56.008 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link delete ceph-brx 2024-08-17T02:26:56.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:56.320 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list 2024-08-17T02:26:56.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:56.356 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link delete ceph-brx 2024-08-17T02:26:56.455 INFO:teuthology.orchestra.run.smithi145.stderr:Cannot find device "ceph-brx" 2024-08-17T02:26:56.458 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:56.458 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-17T02:26:56.471 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-08-17T02:26:56.471 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:56.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.633+0000 7f8c6c600640 1 Processor -- start 2024-08-17T02:26:56.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.633+0000 7f8c6c600640 1 -- start start 2024-08-17T02:26:56.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.634+0000 7f8c6c600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c641590b0 0x7f8c640b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.634+0000 7f8c6c600640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8c640acf10 0x7f8c64159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.634+0000 7f8c6c600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6415a4e0 con 0x7f8c640afca0 2024-08-17T02:26:56.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.634+0000 7f8c6c600640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c640b0980 con 0x7f8c640acf10 2024-08-17T02:26:56.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.634+0000 7f8c6c600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c640c92b0 con 0x7f8c641590b0 2024-08-17T02:26:56.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.635+0000 7f8c69c00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8c640afca0 0x7f8c641589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48598/0 (socket says 172.21.15.2:48598) 2024-08-17T02:26:56.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.635+0000 7f8c69c00640 1 -- 172.21.15.2:0/4227506607 learned_addr learned my addr 172.21.15.2:0/4227506607 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:26:56.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.635+0000 7f8c63e00640 1 -- 172.21.15.2:0/4227506607 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250947573 0 0) 0x7f8c58001110 con 0x7f8c640afca0 2024-08-17T02:26:56.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.635+0000 7f8c63e00640 1 -- 172.21.15.2:0/4227506607 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c4c0034e0 con 0x7f8c640afca0 2024-08-17T02:26:56.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.635+0000 7f8c6a600640 1 --2- 172.21.15.2:0/4227506607 >> v2:172.21.15.145:3300/0 conn(0x7f8c640acf10 0x7f8c64159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.635+0000 7f8c69200640 1 --2- 172.21.15.2:0/4227506607 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c641590b0 0x7f8c640b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.635+0000 7f8c63e00640 1 -- 172.21.15.2:0/4227506607 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4208043670 0 0) 0x7f8c4c0034e0 con 0x7f8c640afca0 2024-08-17T02:26:56.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.635+0000 7f8c63e00640 1 -- 172.21.15.2:0/4227506607 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c641590b0 msgr2=0x7f8c640b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:56.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.635+0000 7f8c63e00640 1 --2- 172.21.15.2:0/4227506607 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c641590b0 0x7f8c640b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.635+0000 7f8c63e00640 1 -- 172.21.15.2:0/4227506607 >> v2:172.21.15.145:3300/0 conn(0x7f8c640acf10 msgr2=0x7f8c64159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:56.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.635+0000 7f8c63e00640 1 --2- 172.21.15.2:0/4227506607 >> v2:172.21.15.145:3300/0 conn(0x7f8c640acf10 0x7f8c64159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.635+0000 7f8c63e00640 1 -- 172.21.15.2:0/4227506607 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c640ad480 con 0x7f8c640afca0 2024-08-17T02:26:56.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.635+0000 7f8c63e00640 1 -- 172.21.15.2:0/4227506607 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7f8c58001600 con 0x7f8c640afca0 2024-08-17T02:26:56.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.635+0000 7f8c63e00640 1 -- 172.21.15.2:0/4227506607 >> v1:172.21.15.2:6789/0 conn(0x7f8c640afca0 legacy=0x7f8c641589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.636+0000 7f8c63e00640 1 --2- 172.21.15.2:0/4227506607 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c641590b0 0x7f8c4c003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.636+0000 7f8c63e00640 1 --2- 172.21.15.2:0/4227506607 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c4c004020 0x7f8c4c004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.636+0000 7f8c63e00640 1 --2- 172.21.15.2:0/4227506607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c4c004cc0 0x7f8c4c005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.636+0000 7f8c63e00640 1 -- 172.21.15.2:0/4227506607 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c640c92b0 con 0x7f8c4c004cc0 2024-08-17T02:26:56.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.636+0000 7f8c63e00640 1 -- 172.21.15.2:0/4227506607 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4c00ba80 con 0x7f8c4c004020 2024-08-17T02:26:56.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.636+0000 7f8c63e00640 1 -- 172.21.15.2:0/4227506607 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4c00bc10 con 0x7f8c641590b0 2024-08-17T02:26:56.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.636+0000 7f8c6a600640 1 --2- 172.21.15.2:0/4227506607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c4c004cc0 0x7f8c4c005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.636+0000 7f8c69c00640 1 --2- 172.21.15.2:0/4227506607 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c641590b0 0x7f8c4c003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.636+0000 7f8c69200640 1 --2- 172.21.15.2:0/4227506607 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c4c004020 0x7f8c4c004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.636+0000 7f8c6a600640 1 -- 172.21.15.2:0/4227506607 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c641590b0 msgr2=0x7f8c4c003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:56.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.636+0000 7f8c6a600640 1 --2- 172.21.15.2:0/4227506607 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c641590b0 0x7f8c4c003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.636+0000 7f8c6a600640 1 -- 172.21.15.2:0/4227506607 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c4c004020 msgr2=0x7f8c4c004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:56.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.636+0000 7f8c6a600640 1 --2- 172.21.15.2:0/4227506607 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c4c004020 0x7f8c4c004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.636+0000 7f8c6a600640 1 -- 172.21.15.2:0/4227506607 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4c0034e0 con 0x7f8c4c004cc0 2024-08-17T02:26:56.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.636+0000 7f8c69c00640 1 --2- 172.21.15.2:0/4227506607 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c641590b0 0x7f8c4c003a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:56.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.637+0000 7f8c6a600640 1 --2- 172.21.15.2:0/4227506607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c4c004cc0 0x7f8c4c005130 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c0094d0 tx=0x7f8c5c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d336c59c162fb5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.638+0000 7f8c63e00640 1 -- 172.21.15.2:0/4227506607 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c02d070 con 0x7f8c4c004cc0 2024-08-17T02:26:56.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.638+0000 7f8c63e00640 1 -- 172.21.15.2:0/4227506607 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5c00f040 con 0x7f8c4c004cc0 2024-08-17T02:26:56.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.638+0000 7f8c63e00640 1 -- 172.21.15.2:0/4227506607 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c031640 con 0x7f8c4c004cc0 2024-08-17T02:26:56.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.638+0000 7f8c6c600640 1 -- 172.21.15.2:0/4227506607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c4c004cc0 msgr2=0x7f8c4c005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.638+0000 7f8c6c600640 1 --2- 172.21.15.2:0/4227506607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c4c004cc0 0x7f8c4c005130 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c0094d0 tx=0x7f8c5c00b040 comp rx=0 tx=0).stop 2024-08-17T02:26:56.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.638+0000 7f8c6a600640 1 -- 172.21.15.2:0/4227506607 reap_dead start 2024-08-17T02:26:56.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.638+0000 7f8c6c600640 1 -- 172.21.15.2:0/4227506607 shutdown_connections 2024-08-17T02:26:56.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.638+0000 7f8c6c600640 1 -- 172.21.15.2:0/4227506607 >> 172.21.15.2:0/4227506607 conn(0x7f8c64066e60 msgr2=0x7f8c64067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:56.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.638+0000 7f8c6c600640 1 -- 172.21.15.2:0/4227506607 shutdown_connections 2024-08-17T02:26:56.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.638+0000 7f8c6c600640 1 -- 172.21.15.2:0/4227506607 wait complete. 2024-08-17T02:26:56.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.640+0000 7f8c6c600640 1 Processor -- start 2024-08-17T02:26:56.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.640+0000 7f8c6c600640 1 -- start start 2024-08-17T02:26:56.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.641+0000 7f8c6c600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c4c004cc0 0x7f8c640c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.641+0000 7f8c6c600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c6415caa0 0x7f8c6415b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.641+0000 7f8c6c600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6415f3c0 0x7f8c6415f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.641+0000 7f8c6c600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6415d790 con 0x7f8c6415f3c0 2024-08-17T02:26:56.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.641+0000 7f8c6c600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6415d460 con 0x7f8c4c004cc0 2024-08-17T02:26:56.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.641+0000 7f8c6c600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6415fd80 con 0x7f8c6415caa0 2024-08-17T02:26:56.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.641+0000 7f8c6a600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6415f3c0 0x7f8c6415f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.641+0000 7f8c6a600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6415f3c0 0x7f8c6415f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37032/0 (socket says 172.21.15.2:37032) 2024-08-17T02:26:56.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.641+0000 7f8c6a600640 1 -- 172.21.15.2:0/1758840934 learned_addr learned my addr 172.21.15.2:0/1758840934 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:56.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.641+0000 7f8c69c00640 1 --2- 172.21.15.2:0/1758840934 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c4c004cc0 0x7f8c640c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.641+0000 7f8c69200640 1 --2- 172.21.15.2:0/1758840934 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c6415caa0 0x7f8c6415b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.642+0000 7f8c6a600640 1 -- 172.21.15.2:0/1758840934 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c6415caa0 msgr2=0x7f8c6415b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.642+0000 7f8c6a600640 1 --2- 172.21.15.2:0/1758840934 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c6415caa0 0x7f8c6415b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.642+0000 7f8c6a600640 1 -- 172.21.15.2:0/1758840934 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c4c004cc0 msgr2=0x7f8c640c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.642+0000 7f8c6a600640 1 --2- 172.21.15.2:0/1758840934 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c4c004cc0 0x7f8c640c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.642+0000 7f8c6a600640 1 -- 172.21.15.2:0/1758840934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6415b990 con 0x7f8c6415f3c0 2024-08-17T02:26:56.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.642+0000 7f8c69c00640 1 --2- 172.21.15.2:0/1758840934 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c4c004cc0 0x7f8c640c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:56.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.642+0000 7f8c6a600640 1 --2- 172.21.15.2:0/1758840934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6415f3c0 0x7f8c6415f840 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c0094d0 tx=0x7f8c5c036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.642+0000 7f8c60c00640 1 -- 172.21.15.2:0/1758840934 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c03d630 con 0x7f8c6415f3c0 2024-08-17T02:26:56.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.642+0000 7f8c60c00640 1 -- 172.21.15.2:0/1758840934 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5c03d790 con 0x7f8c6415f3c0 2024-08-17T02:26:56.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.642+0000 7f8c60c00640 1 -- 172.21.15.2:0/1758840934 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c03db10 con 0x7f8c6415f3c0 2024-08-17T02:26:56.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.642+0000 7f8c6c600640 1 -- 172.21.15.2:0/1758840934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6415bc70 con 0x7f8c6415f3c0 2024-08-17T02:26:56.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.642+0000 7f8c6c600640 1 -- 172.21.15.2:0/1758840934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6415b580 con 0x7f8c6415f3c0 2024-08-17T02:26:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.643+0000 7f8c6c600640 1 -- 172.21.15.2:0/1758840934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6415d940 con 0x7f8c6415f3c0 2024-08-17T02:26:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.644+0000 7f8c60c00640 1 -- 172.21.15.2:0/1758840934 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8c5c043070 con 0x7f8c6415f3c0 2024-08-17T02:26:56.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.645+0000 7f8c60c00640 1 --2- 172.21.15.2:0/1758840934 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8c44065180 0x7f8c44067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.645+0000 7f8c60c00640 1 -- 172.21.15.2:0/1758840934 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f8c5c0a2c70 con 0x7f8c6415f3c0 2024-08-17T02:26:56.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.646+0000 7f8c69c00640 1 --2- 172.21.15.2:0/1758840934 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8c44065180 0x7f8c44067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.646+0000 7f8c69c00640 1 --2- 172.21.15.2:0/1758840934 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8c44065180 0x7f8c44067630 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8c580074f0 tx=0x7f8c58009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.649+0000 7f8c60c00640 1 -- 172.21.15.2:0/1758840934 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8c6415d940 con 0x7f8c6415f3c0 2024-08-17T02:26:56.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.834+0000 7f8c6c600640 1 -- 172.21.15.2:0/1758840934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c6415b740 con 0x7f8c6415f3c0 2024-08-17T02:26:56.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.835+0000 7f8c60c00640 1 -- 172.21.15.2:0/1758840934 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+12345 (secure 0 0 0) 0x7f8c5c0710a0 con 0x7f8c6415f3c0 2024-08-17T02:26:56.837 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:26:56.837 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":42,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:26:53.499511+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.145:6837/1729489536":"2024-08-18T02:26:50.339378+0000","172.21.15.145:6835/1729489536":"2024-08-18T02:26:50.339378+0000","172.21.15.2:6835/3013258535":"2024-08-18T02:26:43.461593+0000","172.21.15.2:6833/3013258535":"2024-08-18T02:26:43.461593+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:56.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.837+0000 7f8c6c600640 1 -- 172.21.15.2:0/1758840934 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8c44065180 msgr2=0x7f8c44067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.837+0000 7f8c6c600640 1 --2- 172.21.15.2:0/1758840934 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8c44065180 0x7f8c44067630 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8c580074f0 tx=0x7f8c58009040 comp rx=0 tx=0).stop 2024-08-17T02:26:56.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.837+0000 7f8c6c600640 1 -- 172.21.15.2:0/1758840934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6415f3c0 msgr2=0x7f8c6415f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.837+0000 7f8c6c600640 1 --2- 172.21.15.2:0/1758840934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6415f3c0 0x7f8c6415f840 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c0094d0 tx=0x7f8c5c036000 comp rx=0 tx=0).stop 2024-08-17T02:26:56.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.838+0000 7f8c6c600640 1 -- 172.21.15.2:0/1758840934 shutdown_connections 2024-08-17T02:26:56.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.838+0000 7f8c6c600640 1 --2- 172.21.15.2:0/1758840934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6415f3c0 0x7f8c6415f840 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.838+0000 7f8c6c600640 1 --2- 172.21.15.2:0/1758840934 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8c44065180 0x7f8c44067630 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.838+0000 7f8c6c600640 1 --2- 172.21.15.2:0/1758840934 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c6415caa0 0x7f8c6415b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.838+0000 7f8c6c600640 1 --2- 172.21.15.2:0/1758840934 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c4c004cc0 0x7f8c640c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.838+0000 7f8c6c600640 1 -- 172.21.15.2:0/1758840934 >> 172.21.15.2:0/1758840934 conn(0x7f8c64066e60 msgr2=0x7f8c640c9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:56.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.838+0000 7f8c6c600640 1 -- 172.21.15.2:0/1758840934 shutdown_connections 2024-08-17T02:26:56.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:56.838+0000 7f8c6c600640 1 -- 172.21.15.2:0/1758840934 wait complete. 2024-08-17T02:26:56.854 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:26:56.854 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:57.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.006+0000 7f5d8e600640 1 Processor -- start 2024-08-17T02:26:57.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.006+0000 7f5d8e600640 1 -- start start 2024-08-17T02:26:57.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.007+0000 7f5d8e600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5d88069840 0x7f5d880cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.007+0000 7f5d8e600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d8815c9d0 con 0x7f5d880cbe10 2024-08-17T02:26:57.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.007+0000 7f5d8e600640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d8815a200 con 0x7f5d880cd550 2024-08-17T02:26:57.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.007+0000 7f5d8e600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d880b0830 con 0x7f5d88069840 2024-08-17T02:26:57.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.007+0000 7f5d8d200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5d88069840 0x7f5d880cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.007+0000 7f5d8dc00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5d880cbe10 0x7f5d880ca340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48602/0 (socket says 172.21.15.2:48602) 2024-08-17T02:26:57.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.007+0000 7f5d8dc00640 1 -- 172.21.15.2:0/2708608754 learned_addr learned my addr 172.21.15.2:0/2708608754 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:26:57.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.008+0000 7f5d8d200640 1 -- 172.21.15.2:0/2708608754 >> v1:172.21.15.145:6789/0 conn(0x7f5d880cd550 legacy=0x7f5d8815ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.008+0000 7f5d8d200640 1 -- 172.21.15.2:0/2708608754 >> v1:172.21.15.2:6789/0 conn(0x7f5d880cbe10 legacy=0x7f5d880ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.008+0000 7f5d8d200640 1 -- 172.21.15.2:0/2708608754 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d880b0b10 con 0x7f5d88069840 2024-08-17T02:26:57.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.008+0000 7f5d87400640 1 -- 172.21.15.2:0/2708608754 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1574475785 0 0) 0x7f5d8815c9d0 con 0x7f5d880cbe10 2024-08-17T02:26:57.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.009+0000 7f5d8d200640 1 --2- 172.21.15.2:0/2708608754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d88069840 0x7f5d880cb8d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c009850 tx=0x7f5d7c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0632fde5e67ba9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.009+0000 7f5d87400640 1 -- 172.21.15.2:0/2708608754 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c02ae20 con 0x7f5d88069840 2024-08-17T02:26:57.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.009+0000 7f5d87400640 1 -- 172.21.15.2:0/2708608754 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7c032440 con 0x7f5d88069840 2024-08-17T02:26:57.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.009+0000 7f5d87400640 1 -- 172.21.15.2:0/2708608754 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c0327e0 con 0x7f5d88069840 2024-08-17T02:26:57.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.010+0000 7f5d8e600640 1 -- 172.21.15.2:0/2708608754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d88069840 msgr2=0x7f5d880cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.010+0000 7f5d8e600640 1 --2- 172.21.15.2:0/2708608754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d88069840 0x7f5d880cb8d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c009850 tx=0x7f5d7c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.010+0000 7f5d8e600640 1 -- 172.21.15.2:0/2708608754 shutdown_connections 2024-08-17T02:26:57.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.010+0000 7f5d8e600640 1 --2- 172.21.15.2:0/2708608754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d88069840 0x7f5d880cb8d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.010+0000 7f5d8e600640 1 -- 172.21.15.2:0/2708608754 >> 172.21.15.2:0/2708608754 conn(0x7f5d88066e60 msgr2=0x7f5d88067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.010+0000 7f5d8e600640 1 -- 172.21.15.2:0/2708608754 shutdown_connections 2024-08-17T02:26:57.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.010+0000 7f5d8e600640 1 -- 172.21.15.2:0/2708608754 wait complete. 2024-08-17T02:26:57.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.011+0000 7f5d8e600640 1 Processor -- start 2024-08-17T02:26:57.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.012+0000 7f5d8e600640 1 -- start start 2024-08-17T02:26:57.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.012+0000 7f5d8e600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d88069840 0x7f5d88154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.013+0000 7f5d8e600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5d880cbe10 0x7f5d8816c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.013+0000 7f5d8e600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5d88169a90 0x7f5d88158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.013+0000 7f5d8e600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8815d5a0 con 0x7f5d88069840 2024-08-17T02:26:57.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.013+0000 7f5d8e600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8816cdb0 con 0x7f5d88169a90 2024-08-17T02:26:57.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.013+0000 7f5d8e600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8816d090 con 0x7f5d880cbe10 2024-08-17T02:26:57.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.013+0000 7f5d8d200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d88069840 0x7f5d88154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.013+0000 7f5d8d200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d88069840 0x7f5d88154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37038/0 (socket says 172.21.15.2:37038) 2024-08-17T02:26:57.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.013+0000 7f5d8d200640 1 -- 172.21.15.2:0/3624915858 learned_addr learned my addr 172.21.15.2:0/3624915858 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:57.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.013+0000 7f5d8dc00640 1 --2- 172.21.15.2:0/3624915858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5d88169a90 0x7f5d88158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.013+0000 7f5d87e00640 1 --2- 172.21.15.2:0/3624915858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5d880cbe10 0x7f5d8816c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.013+0000 7f5d8d200640 1 -- 172.21.15.2:0/3624915858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5d880cbe10 msgr2=0x7f5d8816c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.013+0000 7f5d8d200640 1 --2- 172.21.15.2:0/3624915858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5d880cbe10 0x7f5d8816c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.013+0000 7f5d8d200640 1 -- 172.21.15.2:0/3624915858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5d88169a90 msgr2=0x7f5d88158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.013+0000 7f5d8d200640 1 --2- 172.21.15.2:0/3624915858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5d88169a90 0x7f5d88158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.013+0000 7f5d8d200640 1 -- 172.21.15.2:0/3624915858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7c009390 con 0x7f5d88069840 2024-08-17T02:26:57.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.014+0000 7f5d8d200640 1 --2- 172.21.15.2:0/3624915858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d88069840 0x7f5d88154650 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c009850 tx=0x7f5d7c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.014+0000 7f5d7be00640 1 -- 172.21.15.2:0/3624915858 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c031b30 con 0x7f5d88069840 2024-08-17T02:26:57.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.014+0000 7f5d7be00640 1 -- 172.21.15.2:0/3624915858 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7c031c90 con 0x7f5d88069840 2024-08-17T02:26:57.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.014+0000 7f5d7be00640 1 -- 172.21.15.2:0/3624915858 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c03c660 con 0x7f5d88069840 2024-08-17T02:26:57.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.014+0000 7f5d8e600640 1 -- 172.21.15.2:0/3624915858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d8815d230 con 0x7f5d88069840 2024-08-17T02:26:57.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.014+0000 7f5d8e600640 1 -- 172.21.15.2:0/3624915858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d88169f50 con 0x7f5d88069840 2024-08-17T02:26:57.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.015+0000 7f5d8e600640 1 -- 172.21.15.2:0/3624915858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d8815d090 con 0x7f5d88069840 2024-08-17T02:26:57.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.016+0000 7f5d7be00640 1 -- 172.21.15.2:0/3624915858 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5d7c039050 con 0x7f5d88069840 2024-08-17T02:26:57.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.017+0000 7f5d7be00640 1 --2- 172.21.15.2:0/3624915858 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5d68065150 0x7f5d68067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.017+0000 7f5d7be00640 1 -- 172.21.15.2:0/3624915858 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f5d7c0a2760 con 0x7f5d88069840 2024-08-17T02:26:57.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.017+0000 7f5d87e00640 1 --2- 172.21.15.2:0/3624915858 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5d68065150 0x7f5d68067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.018+0000 7f5d87e00640 1 --2- 172.21.15.2:0/3624915858 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5d68065150 0x7f5d68067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5d88156990 tx=0x7f5d74009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.021+0000 7f5d7be00640 1 -- 172.21.15.2:0/3624915858 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5d8815d090 con 0x7f5d88069840 2024-08-17T02:26:57.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.203+0000 7f5d8e600640 1 -- 172.21.15.2:0/3624915858 --> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5d8815d6e0 con 0x7f5d68065150 2024-08-17T02:26:57.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.206+0000 7f5d7be00640 1 -- 172.21.15.2:0/3624915858 <== mgr.4108 v2:172.21.15.145:6832/36841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50839 (secure 0 0 0) 0x7f5d74003cd0 con 0x7f5d68065150 2024-08-17T02:26:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:26:57.208 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-17T02:26:57.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.208+0000 7f5d8e600640 1 -- 172.21.15.2:0/3624915858 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5d68065150 msgr2=0x7f5d68067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.208+0000 7f5d8e600640 1 --2- 172.21.15.2:0/3624915858 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5d68065150 0x7f5d68067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5d88156990 tx=0x7f5d74009040 comp rx=0 tx=0).stop 2024-08-17T02:26:57.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.208+0000 7f5d8e600640 1 -- 172.21.15.2:0/3624915858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d88069840 msgr2=0x7f5d88154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.208+0000 7f5d8e600640 1 --2- 172.21.15.2:0/3624915858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d88069840 0x7f5d88154650 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c009850 tx=0x7f5d7c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:57.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.208+0000 7f5d8e600640 1 -- 172.21.15.2:0/3624915858 shutdown_connections 2024-08-17T02:26:57.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.208+0000 7f5d8e600640 1 --2- 172.21.15.2:0/3624915858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5d88169a90 0x7f5d88158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.208+0000 7f5d8e600640 1 --2- 172.21.15.2:0/3624915858 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f5d68065150 0x7f5d68067600 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.208+0000 7f5d8e600640 1 --2- 172.21.15.2:0/3624915858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5d880cbe10 0x7f5d8816c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.208+0000 7f5d8e600640 1 --2- 172.21.15.2:0/3624915858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d88069840 0x7f5d88154650 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.208+0000 7f5d8e600640 1 -- 172.21.15.2:0/3624915858 >> 172.21.15.2:0/3624915858 conn(0x7f5d88066e60 msgr2=0x7f5d880ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.208+0000 7f5d8e600640 1 -- 172.21.15.2:0/3624915858 shutdown_connections 2024-08-17T02:26:57.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.208+0000 7f5d8e600640 1 -- 172.21.15.2:0/3624915858 wait complete. 2024-08-17T02:26:57.226 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-08-17T02:26:56.106374+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2400576,"kb_used_data":5064,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574144,"statfs":{"total":773094113280,"available":770635923456,"internally_reserved":0,"allocated":5185536,"data_stored":2826128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001187"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-08-17T02:26:52.501953+0000","last_change":"2024-08-17T02:23:27.953699+0000","last_active":"2024-08-17T02:26:52.501953+0000","last_peered":"2024-08-17T02:26:52.501953+0000","last_clean":"2024-08-17T02:26:52.501953+0000","last_became_active":"2024-08-17T02:23:27.952879+0000","last_became_peered":"2024-08-17T02:23:27.952879+0000","last_unstale":"2024-08-17T02:26:52.501953+0000","last_undegraded":"2024-08-17T02:26:52.501953+0000","last_fullsized":"2024-08-17T02:26:52.501953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:26.811202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:26.811202+0000","last_clean_scrub_stamp":"2024-08-17T02:23:26.811202+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:48.565059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298428,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073412,"statfs":{"total":96636764160,"available":96331173888,"internally_reserved":0,"allocated":1093632,"data_stored":796042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68700000000000006,"15min":0.66900000000000004},"min":{"1min":0.55900000000000005,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86099999999999999,"5min":1.8,"15min":1.8},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.66800000000000004,"15min":0.61499999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.024,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.80700000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.70499999999999996,"15min":0.66100000000000003},"min":{"1min":0.66300000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98699999999999999,"5min":1.022,"15min":1.022},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.74299999999999999,"15min":0.69699999999999995},"min":{"1min":0.53200000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96899999999999997,"5min":2.8039999999999998,"15min":2.8039999999999998},"last":0.97499999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.65900000000000003,"15min":0.623},"min":{"1min":0.53800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.93100000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.69999999999999996,"15min":0.67000000000000004},"min":{"1min":0.64900000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.84099999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.66400000000000003,"15min":0.626},"min":{"1min":0.63500000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.94099999999999995,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76300000000000001,"15min":0.754},"min":{"1min":0.624,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.95299999999999996,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.61099999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.60299999999999998,"15min":0.59399999999999997},"min":{"1min":0.42299999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80500000000000005,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.41499999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81100000000000005,"5min":0.88,"15min":0.88},"last":0.69499999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65400000000000003,"15min":0.66300000000000003},"min":{"1min":0.44900000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.98099999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68799999999999994,"15min":0.67200000000000004},"min":{"1min":0.47399999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.86799999999999999,"5min":2.7090000000000001,"15min":2.7090000000000001},"last":0.76000000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.75700000000000001,"15min":0.745},"min":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.878,"5min":2.742,"15min":2.742},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69199999999999995,"15min":0.68600000000000005},"min":{"1min":0.56999999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88800000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.78200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297852,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073988,"statfs":{"total":96636764160,"available":96331763712,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66500000000000004,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89900000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68700000000000006,"15min":0.68300000000000005},"min":{"1min":0.52700000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.94899999999999995,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.82399999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70499999999999996,"15min":0.69999999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.877,"5min":1.268,"15min":1.268},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68899999999999995,"15min":0.68100000000000005},"min":{"1min":0.49399999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86199999999999999,"5min":1.383,"15min":1.383},"last":0.56299999999999994}]},{"osd":2,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.55900000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96799999999999997,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.75700000000000001,"15min":0.74099999999999999},"min":{"1min":0.57599999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.01,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.61599999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.56699999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.96899999999999997,"5min":1.528,"15min":1.528},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78500000000000003,"15min":0.79900000000000004},"min":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.94199999999999995,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.79300000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63200000000000001,"15min":0.64200000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.65800000000000003,"15min":0.67100000000000004},"min":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90700000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.72599999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.67400000000000004,"15min":0.69799999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.84999999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.751},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68200000000000005,"15min":0.68899999999999995},"min":{"1min":0.52700000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88800000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.80700000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72699999999999998,"15min":0.74299999999999999},"min":{"1min":0.502,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.83499999999999996,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.76000000000000001,"15min":0.77900000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97699999999999998,"5min":1.014,"15min":1.014},"last":0.878}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297848,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073992,"statfs":{"total":96636764160,"available":96331767808,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.69599999999999995,"15min":0.66100000000000003},"min":{"1min":0.65200000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.52000000000000002,"5min":0.495,"15min":0.495},"max":{"1min":0.996,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.86799999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.72499999999999998,"15min":0.70099999999999996},"min":{"1min":0.68899999999999995,"5min":0.497,"15min":0.497},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72199999999999998,"15min":0.70199999999999996},"min":{"1min":0.55000000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96199999999999997,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.89900000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.73699999999999999,"15min":0.72099999999999997},"min":{"1min":0.57899999999999996,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.77100000000000002,"15min":0.75700000000000001},"min":{"1min":0.72099999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.88400000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71799999999999997,"15min":0.70999999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.91400000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.78000000000000003,"15min":0.77200000000000002},"min":{"1min":0.66900000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.60299999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.47499999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85499999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.754},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63900000000000001,"15min":0.65000000000000002},"min":{"1min":0.45100000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.81100000000000005,"5min":0.874,"15min":0.874},"last":0.81799999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65400000000000003,"15min":0.68000000000000005},"min":{"1min":0.51400000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91500000000000004,"5min":1.03,"15min":1.03},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69699999999999995,"15min":0.72199999999999998},"min":{"1min":0.54300000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89100000000000001,"5min":1.026,"15min":1.026},"last":0.91300000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69499999999999995,"15min":0.70999999999999996},"min":{"1min":0.55000000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.79400000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.746,"15min":0.78000000000000003},"min":{"1min":0.55800000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98899999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.92000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297844,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71799999999999997,"15min":0.71299999999999997},"min":{"1min":0.52500000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86899999999999999,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77500000000000002,"15min":0.78800000000000003},"min":{"1min":0.58099999999999996,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91200000000000003,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.86499999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.753,"15min":0.747},"min":{"1min":0.65500000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89100000000000001,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73899999999999999,"15min":0.73599999999999999},"min":{"1min":0.58299999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.90200000000000002,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.62}]},{"osd":2,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67700000000000005,"15min":0.67900000000000005},"min":{"1min":0.56299999999999994,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.78600000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71199999999999997,"15min":0.70899999999999996},"min":{"1min":0.61699999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.86299999999999999,"5min":1.022,"15min":1.022},"last":0.77200000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.66500000000000004},"min":{"1min":0.53300000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85199999999999998,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72899999999999998,"15min":0.72699999999999998},"min":{"1min":0.54200000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.85699999999999998,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.72999999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.61499999999999999,"15min":0.629},"min":{"1min":0.41299999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75900000000000001,"5min":1.069,"15min":1.069},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.48899999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.872,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.66400000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.64000000000000001,"15min":0.66000000000000003},"min":{"1min":0.45500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.72199999999999998,"5min":1.012,"15min":1.012},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.72799999999999998,"15min":0.746},"min":{"1min":0.47599999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.85799999999999998,"5min":1.325,"15min":1.325},"last":0.98499999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.69299999999999995,"15min":0.69799999999999995},"min":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.83299999999999996,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.871,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.92200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302004,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069836,"statfs":{"total":96636764160,"available":96327512064,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.44800000000000001,"15min":0.45800000000000002},"min":{"1min":0.33900000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.56899999999999995,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.502,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.35999999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67700000000000005,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.309}]},{"osd":1,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67400000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.38},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.45800000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73399999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.42299999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.438,"5min":0.377,"15min":0.377},"max":{"1min":0.67600000000000005,"5min":0.875,"15min":0.875},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.47399999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.443}]},{"osd":4,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.60499999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81999999999999995,"15min":0.84399999999999997},"min":{"1min":0.67600000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.079,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.751}]},{"osd":5,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81699999999999995,"15min":0.83699999999999997},"min":{"1min":0.63100000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.625},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.85599999999999998},"min":{"1min":0.62,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.145,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.74399999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.84399999999999997,"15min":0.86499999999999999},"min":{"1min":0.68300000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.147,"5min":1.353,"15min":1.353},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.84199999999999997,"15min":0.84999999999999998},"min":{"1min":0.63700000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.67800000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85099999999999998,"15min":0.879},"min":{"1min":0.66400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2010000000000001,"5min":1.28,"15min":1.28},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.85999999999999999,"15min":0.875},"min":{"1min":0.68400000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.165,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.69399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302008,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069832,"statfs":{"total":96636764160,"available":96327507968,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.61899999999999999,"15min":0.70899999999999996},"min":{"1min":0.33900000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.59199999999999997,"5min":6.9820000000000002,"15min":6.9820000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.61199999999999999,"15min":0.67100000000000004},"min":{"1min":0.34599999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67400000000000004,"5min":5.1269999999999998,"15min":5.1269999999999998},"last":0.41599999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.73899999999999999,"15min":0.82899999999999996},"min":{"1min":0.42899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73399999999999999,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.69499999999999995,"15min":0.747},"min":{"1min":0.438,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.73899999999999999,"5min":4.9589999999999996,"15min":4.9589999999999996},"last":0.52400000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51600000000000001,"15min":0.53000000000000003},"min":{"1min":0.35599999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.66800000000000004,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.498},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.76800000000000002,"15min":0.86199999999999999},"min":{"1min":0.41999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.70099999999999996,"5min":7.0419999999999998,"15min":7.0419999999999998},"last":0.50600000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.93100000000000005,"15min":1.0129999999999999},"min":{"1min":0.57899999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.083,"5min":7.0880000000000001,"15min":7.0880000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.86499999999999999,"15min":0.91500000000000004},"min":{"1min":0.57699999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.03,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.72899999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.83999999999999997,"15min":0.88},"min":{"1min":0.56499999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.99299999999999999,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.99299999999999999,"15min":1.069},"min":{"1min":0.70699999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.0149999999999999,"5min":7.133,"15min":7.133},"last":0.69999999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.88100000000000001,"15min":0.93899999999999995},"min":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.107,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.878,"15min":0.92500000000000004},"min":{"1min":0.55900000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1479999999999999,"5min":4.0570000000000004,"15min":4.0570000000000004},"last":0.77800000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.95599999999999996,"15min":1.01},"min":{"1min":0.60799999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2170000000000001,"5min":4.726,"15min":4.726},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.92100000000000004,"15min":0.96899999999999997},"min":{"1min":0.61399999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0720000000000001,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.751}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302004,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069836,"statfs":{"total":96636764160,"available":96327512064,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.59099999999999997,"15min":0.66500000000000004},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.55700000000000005,"5min":4.4420000000000002,"15min":4.4420000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.68500000000000005,"15min":0.755},"min":{"1min":0.37,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69499999999999995,"5min":4.8019999999999996,"15min":4.8019999999999996},"last":0.44800000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.66900000000000004,"15min":0.72099999999999997},"min":{"1min":0.41999999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76700000000000002,"5min":4.5949999999999998,"15min":4.5949999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.63,"15min":0.67600000000000005},"min":{"1min":0.35599999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.78600000000000003,"5min":4.3799999999999999,"15min":4.3799999999999999},"last":0.51800000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.68100000000000005,"15min":0.71699999999999997},"min":{"1min":0.42399999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84199999999999997,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.73699999999999999,"15min":0.81399999999999995},"min":{"1min":0.42899999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70999999999999996,"5min":4.7629999999999999,"15min":4.7629999999999999},"last":0.505}]},{"osd":4,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.96199999999999997,"15min":1.034},"min":{"1min":0.60699999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.95299999999999996,"5min":4.6369999999999996,"15min":4.6369999999999996},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":1.0740000000000001,"15min":1.1899999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.026,"5min":4.5149999999999997,"15min":4.5149999999999997},"last":0.72799999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":1.0760000000000001,"15min":1.1870000000000001},"min":{"1min":0.67000000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.044,"5min":4.5270000000000001,"15min":4.5270000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.95199999999999996,"15min":1.01},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0489999999999999,"5min":4.4909999999999997,"15min":4.4909999999999997},"last":0.79000000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.98999999999999999,"15min":1.0600000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.0720000000000001,"5min":4.6879999999999997,"15min":4.6879999999999997},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.84099999999999997,"5min":1.093,"15min":1.2010000000000001},"min":{"1min":0.71499999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.008,"5min":4.5640000000000001,"15min":4.5640000000000001},"last":0.76700000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.94899999999999995,"15min":1.0049999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.97899999999999998,"5min":4.4580000000000002,"15min":4.4580000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.82999999999999996,"5min":1.0049999999999999,"15min":1.0800000000000001},"min":{"1min":0.65300000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0629999999999999,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.80600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302588,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069252,"statfs":{"total":96636764160,"available":96326914048,"internally_reserved":0,"allocated":1093632,"data_stored":796042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45100000000000001,"15min":0.443},"min":{"1min":0.34599999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60099999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.373},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51700000000000002,"15min":0.501},"min":{"1min":0.42099999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.45800000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34499999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.495,"15min":0.47999999999999998},"min":{"1min":0.35899999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.75700000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.52500000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.378,"5min":0.37,"15min":0.37},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.495,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.44600000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.111,"5min":1.151,"15min":1.151},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.79400000000000004,"15min":0.79300000000000004},"min":{"1min":0.61499999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97499999999999998,"5min":1.159,"15min":1.159},"last":0.83199999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79900000000000004,"15min":0.80000000000000004},"min":{"1min":0.58299999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0660000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.60999999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0269999999999999,"5min":1.131,"15min":1.131},"last":0.877}]},{"osd":6,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.85099999999999998,"15min":0.84899999999999998},"min":{"1min":0.69399999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0760000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.86499999999999999,"15min":0.876},"min":{"1min":0.67000000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1619999999999999,"5min":1.575,"15min":1.575},"last":0.94399999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83699999999999997,"15min":0.84699999999999998},"min":{"1min":0.625,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0629999999999999,"5min":1.268,"15min":1.268},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.70899999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1830000000000001,"5min":1.204,"15min":1.204},"last":0.81000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:57.228 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:57.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.378+0000 7f996d000640 1 Processor -- start 2024-08-17T02:26:57.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.378+0000 7f996d000640 1 -- start start 2024-08-17T02:26:57.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.379+0000 7f996d000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f99680af1f0 0x7f99680ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.379+0000 7f996d000640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9968069d40 0x7f99680cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.379+0000 7f996d000640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99680b14e0 con 0x7f9968159100 2024-08-17T02:26:57.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.379+0000 7f996d000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9968069210 con 0x7f99680af1f0 2024-08-17T02:26:57.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.379+0000 7f996d000640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99680694f0 con 0x7f9968069d40 2024-08-17T02:26:57.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.379+0000 7f9965400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f99680af1f0 0x7f99680ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.379+0000 7f9965400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f99680af1f0 0x7f99680ccc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37044/0 (socket says 172.21.15.2:37044) 2024-08-17T02:26:57.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.379+0000 7f9965400640 1 -- 172.21.15.2:0/238044902 learned_addr learned my addr 172.21.15.2:0/238044902 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:57.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.380+0000 7f9966800640 1 --2- 172.21.15.2:0/238044902 >> v2:172.21.15.145:3300/0 conn(0x7f9968069d40 0x7f99680cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.380+0000 7f9965400640 1 -- 172.21.15.2:0/238044902 >> v2:172.21.15.145:3300/0 conn(0x7f9968069d40 msgr2=0x7f99680cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:57.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.380+0000 7f9965400640 1 --2- 172.21.15.2:0/238044902 >> v2:172.21.15.145:3300/0 conn(0x7f9968069d40 0x7f99680cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.380+0000 7f9965400640 1 -- 172.21.15.2:0/238044902 >> v1:172.21.15.145:6789/0 conn(0x7f9968159100 legacy=0x7f99680aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.380+0000 7f9965400640 1 -- 172.21.15.2:0/238044902 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99680697d0 con 0x7f99680af1f0 2024-08-17T02:26:57.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.381+0000 7f9965400640 1 --2- 172.21.15.2:0/238044902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99680af1f0 0x7f99680ccc30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f996806f450 tx=0x7f99540091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f091347257d3897f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.381+0000 7f9964a00640 1 -- 172.21.15.2:0/238044902 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995402add0 con 0x7f99680af1f0 2024-08-17T02:26:57.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.381+0000 7f9964a00640 1 -- 172.21.15.2:0/238044902 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9954032440 con 0x7f99680af1f0 2024-08-17T02:26:57.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.381+0000 7f9964a00640 1 -- 172.21.15.2:0/238044902 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9954032820 con 0x7f99680af1f0 2024-08-17T02:26:57.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.382+0000 7f996d000640 1 -- 172.21.15.2:0/238044902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99680af1f0 msgr2=0x7f99680ccc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.382+0000 7f996d000640 1 --2- 172.21.15.2:0/238044902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99680af1f0 0x7f99680ccc30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f996806f450 tx=0x7f99540091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.382+0000 7f996d000640 1 -- 172.21.15.2:0/238044902 shutdown_connections 2024-08-17T02:26:57.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.382+0000 7f996d000640 1 --2- 172.21.15.2:0/238044902 >> v2:172.21.15.145:3300/0 conn(0x7f9968069d40 0x7f99680cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.382+0000 7f996d000640 1 --2- 172.21.15.2:0/238044902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99680af1f0 0x7f99680ccc30 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.382+0000 7f996d000640 1 -- 172.21.15.2:0/238044902 >> 172.21.15.2:0/238044902 conn(0x7f99680ce5e0 msgr2=0x7f9968095d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.382+0000 7f996d000640 1 -- 172.21.15.2:0/238044902 shutdown_connections 2024-08-17T02:26:57.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.382+0000 7f996d000640 1 -- 172.21.15.2:0/238044902 wait complete. 2024-08-17T02:26:57.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.383+0000 7f996d000640 1 Processor -- start 2024-08-17T02:26:57.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.383+0000 7f996d000640 1 -- start start 2024-08-17T02:26:57.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.384+0000 7f996d000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9968069d40 0x7f996815af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.384+0000 7f996d000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99680af1f0 0x7f9968098ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.384+0000 7f996d000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9968159100 0x7f99680cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.384+0000 7f996d000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99680991e0 con 0x7f99680af1f0 2024-08-17T02:26:57.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.384+0000 7f996d000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99681565b0 con 0x7f9968069d40 2024-08-17T02:26:57.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.384+0000 7f996d000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99680993d0 con 0x7f9968159100 2024-08-17T02:26:57.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.385+0000 7f9965400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99680af1f0 0x7f9968098ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.385+0000 7f9965400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99680af1f0 0x7f9968098ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37046/0 (socket says 172.21.15.2:37046) 2024-08-17T02:26:57.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.385+0000 7f9965400640 1 -- 172.21.15.2:0/679768532 learned_addr learned my addr 172.21.15.2:0/679768532 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:57.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.385+0000 7f9966800640 1 --2- 172.21.15.2:0/679768532 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9968159100 0x7f99680cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.385+0000 7f9965e00640 1 --2- 172.21.15.2:0/679768532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9968069d40 0x7f996815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.385+0000 7f9965400640 1 -- 172.21.15.2:0/679768532 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9968159100 msgr2=0x7f99680cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.385+0000 7f9965400640 1 --2- 172.21.15.2:0/679768532 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9968159100 0x7f99680cd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.385+0000 7f9965400640 1 -- 172.21.15.2:0/679768532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9968069d40 msgr2=0x7f996815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.385+0000 7f9965400640 1 --2- 172.21.15.2:0/679768532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9968069d40 0x7f996815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.385+0000 7f9965400640 1 -- 172.21.15.2:0/679768532 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9954009450 con 0x7f99680af1f0 2024-08-17T02:26:57.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.385+0000 7f9965400640 1 --2- 172.21.15.2:0/679768532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99680af1f0 0x7f9968098ca0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9954009210 tx=0x7f9954032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.386+0000 7f995d600640 1 -- 172.21.15.2:0/679768532 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9954031bb0 con 0x7f99680af1f0 2024-08-17T02:26:57.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.386+0000 7f995d600640 1 -- 172.21.15.2:0/679768532 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9954031d30 con 0x7f99680af1f0 2024-08-17T02:26:57.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.386+0000 7f996d000640 1 -- 172.21.15.2:0/679768532 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99680996b0 con 0x7f99680af1f0 2024-08-17T02:26:57.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.386+0000 7f995d600640 1 -- 172.21.15.2:0/679768532 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9954031ea0 con 0x7f99680af1f0 2024-08-17T02:26:57.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.386+0000 7f996d000640 1 -- 172.21.15.2:0/679768532 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9968099a40 con 0x7f99680af1f0 2024-08-17T02:26:57.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.387+0000 7f996d000640 1 -- 172.21.15.2:0/679768532 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9968063fb0 con 0x7f99680af1f0 2024-08-17T02:26:57.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.388+0000 7f995d600640 1 -- 172.21.15.2:0/679768532 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9954039040 con 0x7f99680af1f0 2024-08-17T02:26:57.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.389+0000 7f995d600640 1 --2- 172.21.15.2:0/679768532 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9948065150 0x7f9948067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.389+0000 7f995d600640 1 -- 172.21.15.2:0/679768532 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f99540a2340 con 0x7f99680af1f0 2024-08-17T02:26:57.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.389+0000 7f9965e00640 1 --2- 172.21.15.2:0/679768532 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9948065150 0x7f9948067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.390+0000 7f9965e00640 1 --2- 172.21.15.2:0/679768532 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9948065150 0x7f9948067600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9958007fd0 tx=0x7f9958007e30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.393+0000 7f995d600640 1 -- 172.21.15.2:0/679768532 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9954070770 con 0x7f99680af1f0 2024-08-17T02:26:57.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.573+0000 7f996d000640 1 -- 172.21.15.2:0/679768532 --> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99680b39a0 con 0x7f9948065150 2024-08-17T02:26:57.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.575+0000 7f995d600640 1 -- 172.21.15.2:0/679768532 <== mgr.4108 v2:172.21.15.145:6832/36841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50839 (secure 0 0 0) 0x7f99680b39a0 con 0x7f9948065150 2024-08-17T02:26:57.577 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:26:57.577 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-17T02:26:57.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.577+0000 7f996d000640 1 -- 172.21.15.2:0/679768532 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9948065150 msgr2=0x7f9948067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.577+0000 7f996d000640 1 --2- 172.21.15.2:0/679768532 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9948065150 0x7f9948067600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9958007fd0 tx=0x7f9958007e30 comp rx=0 tx=0).stop 2024-08-17T02:26:57.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.577+0000 7f996d000640 1 -- 172.21.15.2:0/679768532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99680af1f0 msgr2=0x7f9968098ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.577+0000 7f996d000640 1 --2- 172.21.15.2:0/679768532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99680af1f0 0x7f9968098ca0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9954009210 tx=0x7f9954032000 comp rx=0 tx=0).stop 2024-08-17T02:26:57.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.577+0000 7f996d000640 1 -- 172.21.15.2:0/679768532 shutdown_connections 2024-08-17T02:26:57.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.577+0000 7f996d000640 1 --2- 172.21.15.2:0/679768532 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9948065150 0x7f9948067600 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.577+0000 7f996d000640 1 --2- 172.21.15.2:0/679768532 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9968159100 0x7f99680cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.577+0000 7f996d000640 1 --2- 172.21.15.2:0/679768532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99680af1f0 0x7f9968098ca0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.577+0000 7f996d000640 1 --2- 172.21.15.2:0/679768532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9968069d40 0x7f996815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.577+0000 7f996d000640 1 -- 172.21.15.2:0/679768532 >> 172.21.15.2:0/679768532 conn(0x7f99680ce5e0 msgr2=0x7f99680b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.577+0000 7f996d000640 1 -- 172.21.15.2:0/679768532 shutdown_connections 2024-08-17T02:26:57.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.577+0000 7f996d000640 1 -- 172.21.15.2:0/679768532 wait complete. 2024-08-17T02:26:57.594 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-08-17T02:26:56.106374+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2400576,"kb_used_data":5064,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574144,"statfs":{"total":773094113280,"available":770635923456,"internally_reserved":0,"allocated":5185536,"data_stored":2826128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001187"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-08-17T02:26:52.501953+0000","last_change":"2024-08-17T02:23:27.953699+0000","last_active":"2024-08-17T02:26:52.501953+0000","last_peered":"2024-08-17T02:26:52.501953+0000","last_clean":"2024-08-17T02:26:52.501953+0000","last_became_active":"2024-08-17T02:23:27.952879+0000","last_became_peered":"2024-08-17T02:23:27.952879+0000","last_unstale":"2024-08-17T02:26:52.501953+0000","last_undegraded":"2024-08-17T02:26:52.501953+0000","last_fullsized":"2024-08-17T02:26:52.501953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:26.811202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:26.811202+0000","last_clean_scrub_stamp":"2024-08-17T02:23:26.811202+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:48.565059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298428,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073412,"statfs":{"total":96636764160,"available":96331173888,"internally_reserved":0,"allocated":1093632,"data_stored":796042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68700000000000006,"15min":0.66900000000000004},"min":{"1min":0.55900000000000005,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86099999999999999,"5min":1.8,"15min":1.8},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.66800000000000004,"15min":0.61499999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.024,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.80700000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.70499999999999996,"15min":0.66100000000000003},"min":{"1min":0.66300000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98699999999999999,"5min":1.022,"15min":1.022},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.74299999999999999,"15min":0.69699999999999995},"min":{"1min":0.53200000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96899999999999997,"5min":2.8039999999999998,"15min":2.8039999999999998},"last":0.97499999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.65900000000000003,"15min":0.623},"min":{"1min":0.53800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.93100000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.69999999999999996,"15min":0.67000000000000004},"min":{"1min":0.64900000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.84099999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.66400000000000003,"15min":0.626},"min":{"1min":0.63500000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.94099999999999995,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76300000000000001,"15min":0.754},"min":{"1min":0.624,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.95299999999999996,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.61099999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.60299999999999998,"15min":0.59399999999999997},"min":{"1min":0.42299999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80500000000000005,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.41499999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81100000000000005,"5min":0.88,"15min":0.88},"last":0.69499999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65400000000000003,"15min":0.66300000000000003},"min":{"1min":0.44900000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.98099999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68799999999999994,"15min":0.67200000000000004},"min":{"1min":0.47399999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.86799999999999999,"5min":2.7090000000000001,"15min":2.7090000000000001},"last":0.76000000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.75700000000000001,"15min":0.745},"min":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.878,"5min":2.742,"15min":2.742},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69199999999999995,"15min":0.68600000000000005},"min":{"1min":0.56999999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88800000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.78200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297852,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073988,"statfs":{"total":96636764160,"available":96331763712,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66500000000000004,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89900000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68700000000000006,"15min":0.68300000000000005},"min":{"1min":0.52700000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.94899999999999995,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.82399999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70499999999999996,"15min":0.69999999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.877,"5min":1.268,"15min":1.268},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68899999999999995,"15min":0.68100000000000005},"min":{"1min":0.49399999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86199999999999999,"5min":1.383,"15min":1.383},"last":0.56299999999999994}]},{"osd":2,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.55900000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96799999999999997,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.75700000000000001,"15min":0.74099999999999999},"min":{"1min":0.57599999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.01,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.61599999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.56699999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.96899999999999997,"5min":1.528,"15min":1.528},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78500000000000003,"15min":0.79900000000000004},"min":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.94199999999999995,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.79300000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63200000000000001,"15min":0.64200000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.65800000000000003,"15min":0.67100000000000004},"min":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90700000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.72599999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.67400000000000004,"15min":0.69799999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.84999999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.751},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68200000000000005,"15min":0.68899999999999995},"min":{"1min":0.52700000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88800000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.80700000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72699999999999998,"15min":0.74299999999999999},"min":{"1min":0.502,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.83499999999999996,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.76000000000000001,"15min":0.77900000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97699999999999998,"5min":1.014,"15min":1.014},"last":0.878}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297848,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073992,"statfs":{"total":96636764160,"available":96331767808,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.69599999999999995,"15min":0.66100000000000003},"min":{"1min":0.65200000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.52000000000000002,"5min":0.495,"15min":0.495},"max":{"1min":0.996,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.86799999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.72499999999999998,"15min":0.70099999999999996},"min":{"1min":0.68899999999999995,"5min":0.497,"15min":0.497},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72199999999999998,"15min":0.70199999999999996},"min":{"1min":0.55000000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96199999999999997,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.89900000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.73699999999999999,"15min":0.72099999999999997},"min":{"1min":0.57899999999999996,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.77100000000000002,"15min":0.75700000000000001},"min":{"1min":0.72099999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.88400000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71799999999999997,"15min":0.70999999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.91400000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.78000000000000003,"15min":0.77200000000000002},"min":{"1min":0.66900000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.60299999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.47499999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85499999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.754},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63900000000000001,"15min":0.65000000000000002},"min":{"1min":0.45100000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.81100000000000005,"5min":0.874,"15min":0.874},"last":0.81799999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65400000000000003,"15min":0.68000000000000005},"min":{"1min":0.51400000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91500000000000004,"5min":1.03,"15min":1.03},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69699999999999995,"15min":0.72199999999999998},"min":{"1min":0.54300000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89100000000000001,"5min":1.026,"15min":1.026},"last":0.91300000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69499999999999995,"15min":0.70999999999999996},"min":{"1min":0.55000000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.79400000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.746,"15min":0.78000000000000003},"min":{"1min":0.55800000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98899999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.92000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297844,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71799999999999997,"15min":0.71299999999999997},"min":{"1min":0.52500000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86899999999999999,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77500000000000002,"15min":0.78800000000000003},"min":{"1min":0.58099999999999996,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91200000000000003,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.86499999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.753,"15min":0.747},"min":{"1min":0.65500000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89100000000000001,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73899999999999999,"15min":0.73599999999999999},"min":{"1min":0.58299999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.90200000000000002,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.62}]},{"osd":2,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67700000000000005,"15min":0.67900000000000005},"min":{"1min":0.56299999999999994,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.78600000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71199999999999997,"15min":0.70899999999999996},"min":{"1min":0.61699999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.86299999999999999,"5min":1.022,"15min":1.022},"last":0.77200000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.66500000000000004},"min":{"1min":0.53300000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85199999999999998,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72899999999999998,"15min":0.72699999999999998},"min":{"1min":0.54200000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.85699999999999998,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.72999999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.61499999999999999,"15min":0.629},"min":{"1min":0.41299999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75900000000000001,"5min":1.069,"15min":1.069},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.48899999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.872,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.66400000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.64000000000000001,"15min":0.66000000000000003},"min":{"1min":0.45500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.72199999999999998,"5min":1.012,"15min":1.012},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.72799999999999998,"15min":0.746},"min":{"1min":0.47599999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.85799999999999998,"5min":1.325,"15min":1.325},"last":0.98499999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.69299999999999995,"15min":0.69799999999999995},"min":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.83299999999999996,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.871,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.92200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302004,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069836,"statfs":{"total":96636764160,"available":96327512064,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.44800000000000001,"15min":0.45800000000000002},"min":{"1min":0.33900000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.56899999999999995,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.502,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.35999999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67700000000000005,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.309}]},{"osd":1,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67400000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.38},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.45800000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73399999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.42299999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.438,"5min":0.377,"15min":0.377},"max":{"1min":0.67600000000000005,"5min":0.875,"15min":0.875},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.47399999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.443}]},{"osd":4,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.60499999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81999999999999995,"15min":0.84399999999999997},"min":{"1min":0.67600000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.079,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.751}]},{"osd":5,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81699999999999995,"15min":0.83699999999999997},"min":{"1min":0.63100000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.625},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.85599999999999998},"min":{"1min":0.62,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.145,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.74399999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.84399999999999997,"15min":0.86499999999999999},"min":{"1min":0.68300000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.147,"5min":1.353,"15min":1.353},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.84199999999999997,"15min":0.84999999999999998},"min":{"1min":0.63700000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.67800000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85099999999999998,"15min":0.879},"min":{"1min":0.66400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2010000000000001,"5min":1.28,"15min":1.28},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.85999999999999999,"15min":0.875},"min":{"1min":0.68400000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.165,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.69399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302008,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069832,"statfs":{"total":96636764160,"available":96327507968,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.61899999999999999,"15min":0.70899999999999996},"min":{"1min":0.33900000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.59199999999999997,"5min":6.9820000000000002,"15min":6.9820000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.61199999999999999,"15min":0.67100000000000004},"min":{"1min":0.34599999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67400000000000004,"5min":5.1269999999999998,"15min":5.1269999999999998},"last":0.41599999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.73899999999999999,"15min":0.82899999999999996},"min":{"1min":0.42899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73399999999999999,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.69499999999999995,"15min":0.747},"min":{"1min":0.438,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.73899999999999999,"5min":4.9589999999999996,"15min":4.9589999999999996},"last":0.52400000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51600000000000001,"15min":0.53000000000000003},"min":{"1min":0.35599999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.66800000000000004,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.498},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.76800000000000002,"15min":0.86199999999999999},"min":{"1min":0.41999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.70099999999999996,"5min":7.0419999999999998,"15min":7.0419999999999998},"last":0.50600000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.93100000000000005,"15min":1.0129999999999999},"min":{"1min":0.57899999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.083,"5min":7.0880000000000001,"15min":7.0880000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.86499999999999999,"15min":0.91500000000000004},"min":{"1min":0.57699999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.03,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.72899999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.83999999999999997,"15min":0.88},"min":{"1min":0.56499999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.99299999999999999,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.99299999999999999,"15min":1.069},"min":{"1min":0.70699999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.0149999999999999,"5min":7.133,"15min":7.133},"last":0.69999999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.88100000000000001,"15min":0.93899999999999995},"min":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.107,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.878,"15min":0.92500000000000004},"min":{"1min":0.55900000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1479999999999999,"5min":4.0570000000000004,"15min":4.0570000000000004},"last":0.77800000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.95599999999999996,"15min":1.01},"min":{"1min":0.60799999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2170000000000001,"5min":4.726,"15min":4.726},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.92100000000000004,"15min":0.96899999999999997},"min":{"1min":0.61399999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0720000000000001,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.751}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302004,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069836,"statfs":{"total":96636764160,"available":96327512064,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.59099999999999997,"15min":0.66500000000000004},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.55700000000000005,"5min":4.4420000000000002,"15min":4.4420000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.68500000000000005,"15min":0.755},"min":{"1min":0.37,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69499999999999995,"5min":4.8019999999999996,"15min":4.8019999999999996},"last":0.44800000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.66900000000000004,"15min":0.72099999999999997},"min":{"1min":0.41999999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76700000000000002,"5min":4.5949999999999998,"15min":4.5949999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.63,"15min":0.67600000000000005},"min":{"1min":0.35599999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.78600000000000003,"5min":4.3799999999999999,"15min":4.3799999999999999},"last":0.51800000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.68100000000000005,"15min":0.71699999999999997},"min":{"1min":0.42399999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84199999999999997,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.73699999999999999,"15min":0.81399999999999995},"min":{"1min":0.42899999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70999999999999996,"5min":4.7629999999999999,"15min":4.7629999999999999},"last":0.505}]},{"osd":4,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.96199999999999997,"15min":1.034},"min":{"1min":0.60699999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.95299999999999996,"5min":4.6369999999999996,"15min":4.6369999999999996},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":1.0740000000000001,"15min":1.1899999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.026,"5min":4.5149999999999997,"15min":4.5149999999999997},"last":0.72799999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":1.0760000000000001,"15min":1.1870000000000001},"min":{"1min":0.67000000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.044,"5min":4.5270000000000001,"15min":4.5270000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.95199999999999996,"15min":1.01},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0489999999999999,"5min":4.4909999999999997,"15min":4.4909999999999997},"last":0.79000000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.98999999999999999,"15min":1.0600000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.0720000000000001,"5min":4.6879999999999997,"15min":4.6879999999999997},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.84099999999999997,"5min":1.093,"15min":1.2010000000000001},"min":{"1min":0.71499999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.008,"5min":4.5640000000000001,"15min":4.5640000000000001},"last":0.76700000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.94899999999999995,"15min":1.0049999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.97899999999999998,"5min":4.4580000000000002,"15min":4.4580000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.82999999999999996,"5min":1.0049999999999999,"15min":1.0800000000000001},"min":{"1min":0.65300000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0629999999999999,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.80600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302588,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069252,"statfs":{"total":96636764160,"available":96326914048,"internally_reserved":0,"allocated":1093632,"data_stored":796042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45100000000000001,"15min":0.443},"min":{"1min":0.34599999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60099999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.373},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51700000000000002,"15min":0.501},"min":{"1min":0.42099999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.45800000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34499999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.495,"15min":0.47999999999999998},"min":{"1min":0.35899999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.75700000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.52500000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.378,"5min":0.37,"15min":0.37},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.495,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.44600000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.111,"5min":1.151,"15min":1.151},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.79400000000000004,"15min":0.79300000000000004},"min":{"1min":0.61499999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97499999999999998,"5min":1.159,"15min":1.159},"last":0.83199999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79900000000000004,"15min":0.80000000000000004},"min":{"1min":0.58299999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0660000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.60999999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0269999999999999,"5min":1.131,"15min":1.131},"last":0.877}]},{"osd":6,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.85099999999999998,"15min":0.84899999999999998},"min":{"1min":0.69399999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0760000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.86499999999999999,"15min":0.876},"min":{"1min":0.67000000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1619999999999999,"5min":1.575,"15min":1.575},"last":0.94399999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83699999999999997,"15min":0.84699999999999998},"min":{"1min":0.625,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0629999999999999,"5min":1.268,"15min":1.268},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.70899999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1830000000000001,"5min":1.204,"15min":1.204},"last":0.81000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:57.596 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:26:57.596 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:57.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.746+0000 7f9f9f000640 1 Processor -- start 2024-08-17T02:26:57.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.747+0000 7f9f9f000640 1 -- start start 2024-08-17T02:26:57.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.748+0000 7f9f9f000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9f980ad790 0x7f9f980adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.748+0000 7f9f9f000640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9f981559e0 0x7f9f980ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.748+0000 7f9f9f000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f980ca6b0 con 0x7f9f980c9d20 2024-08-17T02:26:57.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.748+0000 7f9f9f000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f980cb180 con 0x7f9f980ad790 2024-08-17T02:26:57.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.748+0000 7f9f9f000640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f980af530 con 0x7f9f981559e0 2024-08-17T02:26:57.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.748+0000 7f9f9dc00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9f980ad790 0x7f9f980adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.748+0000 7f9f9d200640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9f980c9d20 0x7f9f981552d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48612/0 (socket says 172.21.15.2:48612) 2024-08-17T02:26:57.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.748+0000 7f9f9d200640 1 -- 172.21.15.2:0/1962061894 learned_addr learned my addr 172.21.15.2:0/1962061894 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:26:57.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.748+0000 7f9f9e600640 1 --2- 172.21.15.2:0/1962061894 >> v2:172.21.15.145:3300/0 conn(0x7f9f981559e0 0x7f9f980ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.749+0000 7f9f9dc00640 1 -- 172.21.15.2:0/1962061894 >> v2:172.21.15.145:3300/0 conn(0x7f9f981559e0 msgr2=0x7f9f980ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:57.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.749+0000 7f9f9dc00640 1 --2- 172.21.15.2:0/1962061894 >> v2:172.21.15.145:3300/0 conn(0x7f9f981559e0 0x7f9f980ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.749+0000 7f9f9dc00640 1 -- 172.21.15.2:0/1962061894 >> v1:172.21.15.2:6789/0 conn(0x7f9f980c9d20 legacy=0x7f9f981552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.749+0000 7f9f9dc00640 1 -- 172.21.15.2:0/1962061894 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f980ca8e0 con 0x7f9f980ad790 2024-08-17T02:26:57.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.750+0000 7f9f9dc00640 1 --2- 172.21.15.2:0/1962061894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f980ad790 0x7f9f980adb60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9f980af4a0 tx=0x7f9f8c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e24d1bc6df96cbe server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.750+0000 7f9f97e00640 1 -- 172.21.15.2:0/1962061894 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c02ad20 con 0x7f9f980ad790 2024-08-17T02:26:57.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.750+0000 7f9f97e00640 1 -- 172.21.15.2:0/1962061894 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8c02ae80 con 0x7f9f980ad790 2024-08-17T02:26:57.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.750+0000 7f9f97e00640 1 -- 172.21.15.2:0/1962061894 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c032670 con 0x7f9f980ad790 2024-08-17T02:26:57.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.750+0000 7f9f9f000640 1 -- 172.21.15.2:0/1962061894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f980ad790 msgr2=0x7f9f980adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.750+0000 7f9f9f000640 1 --2- 172.21.15.2:0/1962061894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f980ad790 0x7f9f980adb60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9f980af4a0 tx=0x7f9f8c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.750+0000 7f9f9f000640 1 -- 172.21.15.2:0/1962061894 shutdown_connections 2024-08-17T02:26:57.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.750+0000 7f9f9f000640 1 --2- 172.21.15.2:0/1962061894 >> v2:172.21.15.145:3300/0 conn(0x7f9f981559e0 0x7f9f980ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.750+0000 7f9f9f000640 1 --2- 172.21.15.2:0/1962061894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f980ad790 0x7f9f980adb60 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.750+0000 7f9f9f000640 1 -- 172.21.15.2:0/1962061894 >> 172.21.15.2:0/1962061894 conn(0x7f9f98062af0 msgr2=0x7f9f98062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.751+0000 7f9f9f000640 1 -- 172.21.15.2:0/1962061894 shutdown_connections 2024-08-17T02:26:57.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.751+0000 7f9f9f000640 1 -- 172.21.15.2:0/1962061894 wait complete. 2024-08-17T02:26:57.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.752+0000 7f9f9f000640 1 Processor -- start 2024-08-17T02:26:57.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.752+0000 7f9f9f000640 1 -- start start 2024-08-17T02:26:57.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.753+0000 7f9f9f000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f980ad790 0x7f9f98151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.753+0000 7f9f9f000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9f980c9d20 0x7f9f9815ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.753+0000 7f9f9f000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f981559e0 0x7f9f980a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.753+0000 7f9f9f000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f980a89b0 con 0x7f9f980ad790 2024-08-17T02:26:57.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.753+0000 7f9f9f000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9815b5d0 con 0x7f9f981559e0 2024-08-17T02:26:57.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.753+0000 7f9f9f000640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9815b8b0 con 0x7f9f980c9d20 2024-08-17T02:26:57.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.753+0000 7f9f9dc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f980ad790 0x7f9f98151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.753+0000 7f9f9dc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f980ad790 0x7f9f98151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37054/0 (socket says 172.21.15.2:37054) 2024-08-17T02:26:57.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.753+0000 7f9f9dc00640 1 -- 172.21.15.2:0/56723440 learned_addr learned my addr 172.21.15.2:0/56723440 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:57.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.753+0000 7f9f9d200640 1 --2- 172.21.15.2:0/56723440 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9f980c9d20 0x7f9f9815ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.753+0000 7f9f9e600640 1 --2- 172.21.15.2:0/56723440 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f981559e0 0x7f9f980a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.754+0000 7f9f9dc00640 1 -- 172.21.15.2:0/56723440 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9f980c9d20 msgr2=0x7f9f9815ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.754+0000 7f9f9dc00640 1 --2- 172.21.15.2:0/56723440 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9f980c9d20 0x7f9f9815ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.754+0000 7f9f9dc00640 1 -- 172.21.15.2:0/56723440 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f981559e0 msgr2=0x7f9f980a6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.754+0000 7f9f9dc00640 1 --2- 172.21.15.2:0/56723440 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f981559e0 0x7f9f980a6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.754+0000 7f9f9dc00640 1 -- 172.21.15.2:0/56723440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c009390 con 0x7f9f980ad790 2024-08-17T02:26:57.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.754+0000 7f9f9dc00640 1 --2- 172.21.15.2:0/56723440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f980ad790 0x7f9f98151d50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009360 tx=0x7f9f8c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.754+0000 7f9f94c00640 1 -- 172.21.15.2:0/56723440 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c031780 con 0x7f9f980ad790 2024-08-17T02:26:57.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.754+0000 7f9f94c00640 1 -- 172.21.15.2:0/56723440 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8c0318e0 con 0x7f9f980ad790 2024-08-17T02:26:57.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.754+0000 7f9f94c00640 1 -- 172.21.15.2:0/56723440 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c031ca0 con 0x7f9f980ad790 2024-08-17T02:26:57.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.754+0000 7f9f9f000640 1 -- 172.21.15.2:0/56723440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9815bb90 con 0x7f9f980ad790 2024-08-17T02:26:57.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.755+0000 7f9f9f000640 1 -- 172.21.15.2:0/56723440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9815d0e0 con 0x7f9f980ad790 2024-08-17T02:26:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.756+0000 7f9f9f000640 1 -- 172.21.15.2:0/56723440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f980a84a0 con 0x7f9f980ad790 2024-08-17T02:26:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.756+0000 7f9f94c00640 1 -- 172.21.15.2:0/56723440 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9f8c043030 con 0x7f9f980ad790 2024-08-17T02:26:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.757+0000 7f9f94c00640 1 --2- 172.21.15.2:0/56723440 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9f78065150 0x7f9f78067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.757+0000 7f9f94c00640 1 -- 172.21.15.2:0/56723440 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f9f8c041070 con 0x7f9f980ad790 2024-08-17T02:26:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.757+0000 7f9f9d200640 1 --2- 172.21.15.2:0/56723440 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9f78065150 0x7f9f78067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.758+0000 7f9f9d200640 1 --2- 172.21.15.2:0/56723440 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9f78065150 0x7f9f78067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9f980ca530 tx=0x7f9f84007e20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.761+0000 7f9f94c00640 1 -- 172.21.15.2:0/56723440 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9f980a84a0 con 0x7f9f980ad790 2024-08-17T02:26:57.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.939+0000 7f9f9f000640 1 -- 172.21.15.2:0/56723440 --> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9f980a8af0 con 0x7f9f78065150 2024-08-17T02:26:57.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.942+0000 7f9f94c00640 1 -- 172.21.15.2:0/56723440 <== mgr.4108 v2:172.21.15.145:6832/36841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50839 (secure 0 0 0) 0x7f9f84007510 con 0x7f9f78065150 2024-08-17T02:26:57.944 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:26:57.944 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-17T02:26:57.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.944+0000 7f9f9f000640 1 -- 172.21.15.2:0/56723440 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9f78065150 msgr2=0x7f9f78067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.944+0000 7f9f9f000640 1 --2- 172.21.15.2:0/56723440 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9f78065150 0x7f9f78067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9f980ca530 tx=0x7f9f84007e20 comp rx=0 tx=0).stop 2024-08-17T02:26:57.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.944+0000 7f9f9f000640 1 -- 172.21.15.2:0/56723440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f980ad790 msgr2=0x7f9f98151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.944+0000 7f9f9f000640 1 --2- 172.21.15.2:0/56723440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f980ad790 0x7f9f98151d50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009360 tx=0x7f9f8c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:57.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.944+0000 7f9f9f000640 1 -- 172.21.15.2:0/56723440 shutdown_connections 2024-08-17T02:26:57.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.944+0000 7f9f9f000640 1 --2- 172.21.15.2:0/56723440 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f981559e0 0x7f9f980a6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.944+0000 7f9f9f000640 1 --2- 172.21.15.2:0/56723440 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f9f78065150 0x7f9f78067600 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.944+0000 7f9f9f000640 1 --2- 172.21.15.2:0/56723440 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9f980c9d20 0x7f9f9815ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.944+0000 7f9f9f000640 1 --2- 172.21.15.2:0/56723440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f980ad790 0x7f9f98151d50 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.944+0000 7f9f9f000640 1 -- 172.21.15.2:0/56723440 >> 172.21.15.2:0/56723440 conn(0x7f9f98062af0 msgr2=0x7f9f98155ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.944+0000 7f9f9f000640 1 -- 172.21.15.2:0/56723440 shutdown_connections 2024-08-17T02:26:57.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:57.944+0000 7f9f9f000640 1 -- 172.21.15.2:0/56723440 wait complete. 2024-08-17T02:26:57.960 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-08-17T02:26:56.106374+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2400576,"kb_used_data":5064,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574144,"statfs":{"total":773094113280,"available":770635923456,"internally_reserved":0,"allocated":5185536,"data_stored":2826128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001187"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-08-17T02:26:52.501953+0000","last_change":"2024-08-17T02:23:27.953699+0000","last_active":"2024-08-17T02:26:52.501953+0000","last_peered":"2024-08-17T02:26:52.501953+0000","last_clean":"2024-08-17T02:26:52.501953+0000","last_became_active":"2024-08-17T02:23:27.952879+0000","last_became_peered":"2024-08-17T02:23:27.952879+0000","last_unstale":"2024-08-17T02:26:52.501953+0000","last_undegraded":"2024-08-17T02:26:52.501953+0000","last_fullsized":"2024-08-17T02:26:52.501953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:26.811202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:26.811202+0000","last_clean_scrub_stamp":"2024-08-17T02:23:26.811202+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:48.565059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298428,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073412,"statfs":{"total":96636764160,"available":96331173888,"internally_reserved":0,"allocated":1093632,"data_stored":796042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68700000000000006,"15min":0.66900000000000004},"min":{"1min":0.55900000000000005,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86099999999999999,"5min":1.8,"15min":1.8},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.66800000000000004,"15min":0.61499999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.024,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.80700000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.70499999999999996,"15min":0.66100000000000003},"min":{"1min":0.66300000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98699999999999999,"5min":1.022,"15min":1.022},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.74299999999999999,"15min":0.69699999999999995},"min":{"1min":0.53200000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96899999999999997,"5min":2.8039999999999998,"15min":2.8039999999999998},"last":0.97499999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.65900000000000003,"15min":0.623},"min":{"1min":0.53800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.93100000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.69999999999999996,"15min":0.67000000000000004},"min":{"1min":0.64900000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.84099999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.66400000000000003,"15min":0.626},"min":{"1min":0.63500000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.94099999999999995,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76300000000000001,"15min":0.754},"min":{"1min":0.624,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.95299999999999996,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.61099999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.60299999999999998,"15min":0.59399999999999997},"min":{"1min":0.42299999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80500000000000005,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.41499999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81100000000000005,"5min":0.88,"15min":0.88},"last":0.69499999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65400000000000003,"15min":0.66300000000000003},"min":{"1min":0.44900000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.98099999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68799999999999994,"15min":0.67200000000000004},"min":{"1min":0.47399999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.86799999999999999,"5min":2.7090000000000001,"15min":2.7090000000000001},"last":0.76000000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.75700000000000001,"15min":0.745},"min":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.878,"5min":2.742,"15min":2.742},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69199999999999995,"15min":0.68600000000000005},"min":{"1min":0.56999999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88800000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.78200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297852,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073988,"statfs":{"total":96636764160,"available":96331763712,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66500000000000004,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89900000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68700000000000006,"15min":0.68300000000000005},"min":{"1min":0.52700000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.94899999999999995,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.82399999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70499999999999996,"15min":0.69999999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.877,"5min":1.268,"15min":1.268},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68899999999999995,"15min":0.68100000000000005},"min":{"1min":0.49399999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86199999999999999,"5min":1.383,"15min":1.383},"last":0.56299999999999994}]},{"osd":2,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.55900000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96799999999999997,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.75700000000000001,"15min":0.74099999999999999},"min":{"1min":0.57599999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.01,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.61599999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.56699999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.96899999999999997,"5min":1.528,"15min":1.528},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78500000000000003,"15min":0.79900000000000004},"min":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.94199999999999995,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.79300000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63200000000000001,"15min":0.64200000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.65800000000000003,"15min":0.67100000000000004},"min":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90700000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.72599999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.67400000000000004,"15min":0.69799999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.84999999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.751},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68200000000000005,"15min":0.68899999999999995},"min":{"1min":0.52700000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88800000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.80700000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72699999999999998,"15min":0.74299999999999999},"min":{"1min":0.502,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.83499999999999996,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.76000000000000001,"15min":0.77900000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97699999999999998,"5min":1.014,"15min":1.014},"last":0.878}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297848,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073992,"statfs":{"total":96636764160,"available":96331767808,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.69599999999999995,"15min":0.66100000000000003},"min":{"1min":0.65200000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.52000000000000002,"5min":0.495,"15min":0.495},"max":{"1min":0.996,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.86799999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.72499999999999998,"15min":0.70099999999999996},"min":{"1min":0.68899999999999995,"5min":0.497,"15min":0.497},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72199999999999998,"15min":0.70199999999999996},"min":{"1min":0.55000000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96199999999999997,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.89900000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.73699999999999999,"15min":0.72099999999999997},"min":{"1min":0.57899999999999996,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.77100000000000002,"15min":0.75700000000000001},"min":{"1min":0.72099999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.88400000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71799999999999997,"15min":0.70999999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.91400000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.78000000000000003,"15min":0.77200000000000002},"min":{"1min":0.66900000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.60299999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.47499999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85499999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.754},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63900000000000001,"15min":0.65000000000000002},"min":{"1min":0.45100000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.81100000000000005,"5min":0.874,"15min":0.874},"last":0.81799999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65400000000000003,"15min":0.68000000000000005},"min":{"1min":0.51400000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91500000000000004,"5min":1.03,"15min":1.03},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69699999999999995,"15min":0.72199999999999998},"min":{"1min":0.54300000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89100000000000001,"5min":1.026,"15min":1.026},"last":0.91300000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69499999999999995,"15min":0.70999999999999996},"min":{"1min":0.55000000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.79400000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.746,"15min":0.78000000000000003},"min":{"1min":0.55800000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98899999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.92000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297844,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71799999999999997,"15min":0.71299999999999997},"min":{"1min":0.52500000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86899999999999999,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77500000000000002,"15min":0.78800000000000003},"min":{"1min":0.58099999999999996,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91200000000000003,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.86499999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.753,"15min":0.747},"min":{"1min":0.65500000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89100000000000001,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73899999999999999,"15min":0.73599999999999999},"min":{"1min":0.58299999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.90200000000000002,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.62}]},{"osd":2,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67700000000000005,"15min":0.67900000000000005},"min":{"1min":0.56299999999999994,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.78600000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71199999999999997,"15min":0.70899999999999996},"min":{"1min":0.61699999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.86299999999999999,"5min":1.022,"15min":1.022},"last":0.77200000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.66500000000000004},"min":{"1min":0.53300000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85199999999999998,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72899999999999998,"15min":0.72699999999999998},"min":{"1min":0.54200000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.85699999999999998,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.72999999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.61499999999999999,"15min":0.629},"min":{"1min":0.41299999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75900000000000001,"5min":1.069,"15min":1.069},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.48899999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.872,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.66400000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.64000000000000001,"15min":0.66000000000000003},"min":{"1min":0.45500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.72199999999999998,"5min":1.012,"15min":1.012},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.72799999999999998,"15min":0.746},"min":{"1min":0.47599999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.85799999999999998,"5min":1.325,"15min":1.325},"last":0.98499999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.69299999999999995,"15min":0.69799999999999995},"min":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.83299999999999996,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.871,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.92200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302004,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069836,"statfs":{"total":96636764160,"available":96327512064,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.44800000000000001,"15min":0.45800000000000002},"min":{"1min":0.33900000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.56899999999999995,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.502,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.35999999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67700000000000005,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.309}]},{"osd":1,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67400000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.38},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.45800000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73399999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.42299999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.438,"5min":0.377,"15min":0.377},"max":{"1min":0.67600000000000005,"5min":0.875,"15min":0.875},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.47399999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.443}]},{"osd":4,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.60499999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81999999999999995,"15min":0.84399999999999997},"min":{"1min":0.67600000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.079,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.751}]},{"osd":5,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81699999999999995,"15min":0.83699999999999997},"min":{"1min":0.63100000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.625},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.85599999999999998},"min":{"1min":0.62,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.145,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.74399999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.84399999999999997,"15min":0.86499999999999999},"min":{"1min":0.68300000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.147,"5min":1.353,"15min":1.353},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.84199999999999997,"15min":0.84999999999999998},"min":{"1min":0.63700000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.67800000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85099999999999998,"15min":0.879},"min":{"1min":0.66400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2010000000000001,"5min":1.28,"15min":1.28},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.85999999999999999,"15min":0.875},"min":{"1min":0.68400000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.165,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.69399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302008,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069832,"statfs":{"total":96636764160,"available":96327507968,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.61899999999999999,"15min":0.70899999999999996},"min":{"1min":0.33900000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.59199999999999997,"5min":6.9820000000000002,"15min":6.9820000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.61199999999999999,"15min":0.67100000000000004},"min":{"1min":0.34599999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67400000000000004,"5min":5.1269999999999998,"15min":5.1269999999999998},"last":0.41599999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.73899999999999999,"15min":0.82899999999999996},"min":{"1min":0.42899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73399999999999999,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.69499999999999995,"15min":0.747},"min":{"1min":0.438,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.73899999999999999,"5min":4.9589999999999996,"15min":4.9589999999999996},"last":0.52400000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51600000000000001,"15min":0.53000000000000003},"min":{"1min":0.35599999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.66800000000000004,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.498},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.76800000000000002,"15min":0.86199999999999999},"min":{"1min":0.41999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.70099999999999996,"5min":7.0419999999999998,"15min":7.0419999999999998},"last":0.50600000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.93100000000000005,"15min":1.0129999999999999},"min":{"1min":0.57899999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.083,"5min":7.0880000000000001,"15min":7.0880000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.86499999999999999,"15min":0.91500000000000004},"min":{"1min":0.57699999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.03,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.72899999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.83999999999999997,"15min":0.88},"min":{"1min":0.56499999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.99299999999999999,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.99299999999999999,"15min":1.069},"min":{"1min":0.70699999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.0149999999999999,"5min":7.133,"15min":7.133},"last":0.69999999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.88100000000000001,"15min":0.93899999999999995},"min":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.107,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.878,"15min":0.92500000000000004},"min":{"1min":0.55900000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1479999999999999,"5min":4.0570000000000004,"15min":4.0570000000000004},"last":0.77800000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.95599999999999996,"15min":1.01},"min":{"1min":0.60799999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2170000000000001,"5min":4.726,"15min":4.726},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.92100000000000004,"15min":0.96899999999999997},"min":{"1min":0.61399999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0720000000000001,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.751}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302004,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069836,"statfs":{"total":96636764160,"available":96327512064,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.59099999999999997,"15min":0.66500000000000004},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.55700000000000005,"5min":4.4420000000000002,"15min":4.4420000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.68500000000000005,"15min":0.755},"min":{"1min":0.37,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69499999999999995,"5min":4.8019999999999996,"15min":4.8019999999999996},"last":0.44800000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.66900000000000004,"15min":0.72099999999999997},"min":{"1min":0.41999999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76700000000000002,"5min":4.5949999999999998,"15min":4.5949999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.63,"15min":0.67600000000000005},"min":{"1min":0.35599999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.78600000000000003,"5min":4.3799999999999999,"15min":4.3799999999999999},"last":0.51800000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.68100000000000005,"15min":0.71699999999999997},"min":{"1min":0.42399999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84199999999999997,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.73699999999999999,"15min":0.81399999999999995},"min":{"1min":0.42899999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70999999999999996,"5min":4.7629999999999999,"15min":4.7629999999999999},"last":0.505}]},{"osd":4,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.96199999999999997,"15min":1.034},"min":{"1min":0.60699999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.95299999999999996,"5min":4.6369999999999996,"15min":4.6369999999999996},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":1.0740000000000001,"15min":1.1899999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.026,"5min":4.5149999999999997,"15min":4.5149999999999997},"last":0.72799999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":1.0760000000000001,"15min":1.1870000000000001},"min":{"1min":0.67000000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.044,"5min":4.5270000000000001,"15min":4.5270000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.95199999999999996,"15min":1.01},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0489999999999999,"5min":4.4909999999999997,"15min":4.4909999999999997},"last":0.79000000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.98999999999999999,"15min":1.0600000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.0720000000000001,"5min":4.6879999999999997,"15min":4.6879999999999997},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.84099999999999997,"5min":1.093,"15min":1.2010000000000001},"min":{"1min":0.71499999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.008,"5min":4.5640000000000001,"15min":4.5640000000000001},"last":0.76700000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.94899999999999995,"15min":1.0049999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.97899999999999998,"5min":4.4580000000000002,"15min":4.4580000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.82999999999999996,"5min":1.0049999999999999,"15min":1.0800000000000001},"min":{"1min":0.65300000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0629999999999999,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.80600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302588,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069252,"statfs":{"total":96636764160,"available":96326914048,"internally_reserved":0,"allocated":1093632,"data_stored":796042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45100000000000001,"15min":0.443},"min":{"1min":0.34599999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60099999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.373},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51700000000000002,"15min":0.501},"min":{"1min":0.42099999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.45800000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34499999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.495,"15min":0.47999999999999998},"min":{"1min":0.35899999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.75700000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.52500000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.378,"5min":0.37,"15min":0.37},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.495,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.44600000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.111,"5min":1.151,"15min":1.151},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.79400000000000004,"15min":0.79300000000000004},"min":{"1min":0.61499999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97499999999999998,"5min":1.159,"15min":1.159},"last":0.83199999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79900000000000004,"15min":0.80000000000000004},"min":{"1min":0.58299999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0660000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.60999999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0269999999999999,"5min":1.131,"15min":1.131},"last":0.877}]},{"osd":6,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.85099999999999998,"15min":0.84899999999999998},"min":{"1min":0.69399999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0760000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.86499999999999999,"15min":0.876},"min":{"1min":0.67000000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1619999999999999,"5min":1.575,"15min":1.575},"last":0.94399999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83699999999999997,"15min":0.84699999999999998},"min":{"1min":0.625,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0629999999999999,"5min":1.268,"15min":1.268},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.70899999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1830000000000001,"5min":1.204,"15min":1.204},"last":0.81000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:57.962 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:58.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.111+0000 7fbfa8c00640 1 Processor -- start 2024-08-17T02:26:58.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.111+0000 7fbfa8c00640 1 -- start start 2024-08-17T02:26:58.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.112+0000 7fbfa8c00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbfa40ad960 0x7fbfa415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.112+0000 7fbfa8c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbfa40add30 0x7fbfa4156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.113+0000 7fbfa8c00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa415b5e0 con 0x7fbfa40ca050 2024-08-17T02:26:58.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.113+0000 7fbfa8c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa40cb160 con 0x7fbfa40add30 2024-08-17T02:26:58.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.113+0000 7fbfa8c00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa40b0d10 con 0x7fbfa40ad960 2024-08-17T02:26:58.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.113+0000 7fbfa2800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbfa40add30 0x7fbfa4156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.113+0000 7fbfa2800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbfa40add30 0x7fbfa4156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37062/0 (socket says 172.21.15.2:37062) 2024-08-17T02:26:58.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.113+0000 7fbfa2800640 1 -- 172.21.15.2:0/805120313 learned_addr learned my addr 172.21.15.2:0/805120313 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:58.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.113+0000 7fbfa1e00640 1 --2- 172.21.15.2:0/805120313 >> v2:172.21.15.145:3300/0 conn(0x7fbfa40ad960 0x7fbfa415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.113+0000 7fbfa2800640 1 -- 172.21.15.2:0/805120313 >> v2:172.21.15.145:3300/0 conn(0x7fbfa40ad960 msgr2=0x7fbfa415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:58.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.113+0000 7fbfa2800640 1 --2- 172.21.15.2:0/805120313 >> v2:172.21.15.145:3300/0 conn(0x7fbfa40ad960 0x7fbfa415b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.113+0000 7fbfa2800640 1 -- 172.21.15.2:0/805120313 >> v1:172.21.15.145:6789/0 conn(0x7fbfa40ca050 legacy=0x7fbfa4156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.113+0000 7fbfa2800640 1 -- 172.21.15.2:0/805120313 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa40ca550 con 0x7fbfa40add30 2024-08-17T02:26:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.114+0000 7fbfa2800640 1 --2- 172.21.15.2:0/805120313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfa40add30 0x7fbfa4156b30 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40cc910 tx=0x7fbf9c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587d0a951090af6f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.114+0000 7fbfa1400640 1 -- 172.21.15.2:0/805120313 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c032480 con 0x7fbfa40add30 2024-08-17T02:26:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.115+0000 7fbfa1400640 1 -- 172.21.15.2:0/805120313 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9c0325e0 con 0x7fbfa40add30 2024-08-17T02:26:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.115+0000 7fbfa1400640 1 -- 172.21.15.2:0/805120313 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c0329c0 con 0x7fbfa40add30 2024-08-17T02:26:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.115+0000 7fbfa8c00640 1 -- 172.21.15.2:0/805120313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfa40add30 msgr2=0x7fbfa4156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.115+0000 7fbfa8c00640 1 --2- 172.21.15.2:0/805120313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfa40add30 0x7fbfa4156b30 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40cc910 tx=0x7fbf9c009840 comp rx=0 tx=0).stop 2024-08-17T02:26:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.115+0000 7fbfa8c00640 1 -- 172.21.15.2:0/805120313 shutdown_connections 2024-08-17T02:26:58.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.115+0000 7fbfa8c00640 1 --2- 172.21.15.2:0/805120313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfa40add30 0x7fbfa4156b30 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.115+0000 7fbfa8c00640 1 --2- 172.21.15.2:0/805120313 >> v2:172.21.15.145:3300/0 conn(0x7fbfa40ad960 0x7fbfa415b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.115+0000 7fbfa8c00640 1 -- 172.21.15.2:0/805120313 >> 172.21.15.2:0/805120313 conn(0x7fbfa4066e60 msgr2=0x7fbfa4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.115+0000 7fbfa8c00640 1 -- 172.21.15.2:0/805120313 shutdown_connections 2024-08-17T02:26:58.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.115+0000 7fbfa8c00640 1 -- 172.21.15.2:0/805120313 wait complete. 2024-08-17T02:26:58.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.117+0000 7fbfa8c00640 1 Processor -- start 2024-08-17T02:26:58.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.117+0000 7fbfa8c00640 1 -- start start 2024-08-17T02:26:58.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.118+0000 7fbfa8c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfa40ad960 0x7fbfa4169ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.118+0000 7fbfa8c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbfa40add30 0x7fbfa414aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.118+0000 7fbfa8c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbfa40ca050 0x7fbfa4151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.118+0000 7fbfa8c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa4169ff0 con 0x7fbfa40ad960 2024-08-17T02:26:58.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.118+0000 7fbfa8c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa414bc80 con 0x7fbfa40ca050 2024-08-17T02:26:58.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.118+0000 7fbfa8c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa4150280 con 0x7fbfa40add30 2024-08-17T02:26:58.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.118+0000 7fbfa1e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfa40ad960 0x7fbfa4169ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.118+0000 7fbfa1e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfa40ad960 0x7fbfa4169ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37064/0 (socket says 172.21.15.2:37064) 2024-08-17T02:26:58.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.118+0000 7fbfa1e00640 1 -- 172.21.15.2:0/314661890 learned_addr learned my addr 172.21.15.2:0/314661890 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:58.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.118+0000 7fbfa2800640 1 --2- 172.21.15.2:0/314661890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbfa40ca050 0x7fbfa4151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.118+0000 7fbf9be00640 1 --2- 172.21.15.2:0/314661890 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbfa40add30 0x7fbfa414aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.118+0000 7fbfa1e00640 1 -- 172.21.15.2:0/314661890 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbfa40add30 msgr2=0x7fbfa414aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.118+0000 7fbfa1e00640 1 --2- 172.21.15.2:0/314661890 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbfa40add30 0x7fbfa414aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.118+0000 7fbfa1e00640 1 -- 172.21.15.2:0/314661890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbfa40ca050 msgr2=0x7fbfa4151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.118+0000 7fbfa1e00640 1 --2- 172.21.15.2:0/314661890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbfa40ca050 0x7fbfa4151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.118+0000 7fbfa1e00640 1 -- 172.21.15.2:0/314661890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9c009ae0 con 0x7fbfa40ad960 2024-08-17T02:26:58.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.119+0000 7fbfa1e00640 1 --2- 172.21.15.2:0/314661890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfa40ad960 0x7fbfa4169ab0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbf9400d890 tx=0x7fbf94008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.119+0000 7fbf99600640 1 -- 172.21.15.2:0/314661890 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9400de20 con 0x7fbfa40ad960 2024-08-17T02:26:58.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.119+0000 7fbf99600640 1 -- 172.21.15.2:0/314661890 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf940098b0 con 0x7fbfa40ad960 2024-08-17T02:26:58.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.119+0000 7fbf99600640 1 -- 172.21.15.2:0/314661890 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf94009c70 con 0x7fbfa40ad960 2024-08-17T02:26:58.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.119+0000 7fbfa8c00640 1 -- 172.21.15.2:0/314661890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa414f4f0 con 0x7fbfa40ad960 2024-08-17T02:26:58.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.119+0000 7fbfa8c00640 1 -- 172.21.15.2:0/314661890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa406b950 con 0x7fbfa40ad960 2024-08-17T02:26:58.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.120+0000 7fbfa8c00640 1 -- 172.21.15.2:0/314661890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa4063fb0 con 0x7fbfa40ad960 2024-08-17T02:26:58.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.121+0000 7fbf99600640 1 -- 172.21.15.2:0/314661890 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbf94014410 con 0x7fbfa40ad960 2024-08-17T02:26:58.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.122+0000 7fbf99600640 1 --2- 172.21.15.2:0/314661890 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbf80065180 0x7fbf80067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.122+0000 7fbf99600640 1 -- 172.21.15.2:0/314661890 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fbf94082b20 con 0x7fbfa40ad960 2024-08-17T02:26:58.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.122+0000 7fbf9be00640 1 --2- 172.21.15.2:0/314661890 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbf80065180 0x7fbf80067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.123+0000 7fbf9be00640 1 --2- 172.21.15.2:0/314661890 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbf80065180 0x7fbf80067630 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbfa414f1c0 tx=0x7fbf8c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.126+0000 7fbf99600640 1 -- 172.21.15.2:0/314661890 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbf94050ea0 con 0x7fbfa40ad960 2024-08-17T02:26:58.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.309+0000 7fbfa8c00640 1 -- 172.21.15.2:0/314661890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfa406d120 con 0x7fbfa40ad960 2024-08-17T02:26:58.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.310+0000 7fbf99600640 1 -- 172.21.15.2:0/314661890 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+12345 (secure 0 0 0) 0x7fbf94018090 con 0x7fbfa40ad960 2024-08-17T02:26:58.312 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:26:58.312 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":42,"fsid":"66491975-1283-4d8c-92e2-26a46f113139","created":"2024-08-17T02:23:13.571363+0000","modified":"2024-08-17T02:26:53.499511+0000","last_up_change":"2024-08-17T02:23:24.806576+0000","last_in_change":"2024-08-17T02:23:16.362200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:26.107978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"1d2e3b7b-8b8e-438d-b18c-ba8feb8b5d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":37010},{"type":"v1","addr":"172.21.15.2:6809","nonce":37010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":37010},{"type":"v1","addr":"172.21.15.2:6811","nonce":37010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":37010},{"type":"v1","addr":"172.21.15.2:6816","nonce":37010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":37010},{"type":"v1","addr":"172.21.15.2:6813","nonce":37010}]},"public_addr":"172.21.15.2:6809/37010","cluster_addr":"172.21.15.2:6811/37010","heartbeat_back_addr":"172.21.15.2:6816/37010","heartbeat_front_addr":"172.21.15.2:6813/37010","state":["exists","up"]},{"osd":1,"uuid":"9cd868cf-f5f3-413d-adb0-dfb0e23cd952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":37012},{"type":"v1","addr":"172.21.15.2:6801","nonce":37012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":37012},{"type":"v1","addr":"172.21.15.2:6803","nonce":37012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":37012},{"type":"v1","addr":"172.21.15.2:6808","nonce":37012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":37012},{"type":"v1","addr":"172.21.15.2:6805","nonce":37012}]},"public_addr":"172.21.15.2:6801/37012","cluster_addr":"172.21.15.2:6803/37012","heartbeat_back_addr":"172.21.15.2:6808/37012","heartbeat_front_addr":"172.21.15.2:6805/37012","state":["exists","up"]},{"osd":2,"uuid":"6cea5b6d-f990-40ef-a6b1-6f3735eb551c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":37013},{"type":"v1","addr":"172.21.15.2:6817","nonce":37013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":37013},{"type":"v1","addr":"172.21.15.2:6819","nonce":37013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":37013},{"type":"v1","addr":"172.21.15.2:6823","nonce":37013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":37013},{"type":"v1","addr":"172.21.15.2:6821","nonce":37013}]},"public_addr":"172.21.15.2:6817/37013","cluster_addr":"172.21.15.2:6819/37013","heartbeat_back_addr":"172.21.15.2:6823/37013","heartbeat_front_addr":"172.21.15.2:6821/37013","state":["exists","up"]},{"osd":3,"uuid":"2948af0c-73f1-40fa-93e9-8a96979ad50c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":37033},{"type":"v1","addr":"172.21.15.2:6825","nonce":37033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":37033},{"type":"v1","addr":"172.21.15.2:6827","nonce":37033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":37033},{"type":"v1","addr":"172.21.15.2:6831","nonce":37033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":37033},{"type":"v1","addr":"172.21.15.2:6829","nonce":37033}]},"public_addr":"172.21.15.2:6825/37033","cluster_addr":"172.21.15.2:6827/37033","heartbeat_back_addr":"172.21.15.2:6831/37033","heartbeat_front_addr":"172.21.15.2:6829/37033","state":["exists","up"]},{"osd":4,"uuid":"ce4e1edd-5bd5-45b6-9392-7d6755500a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":37421},{"type":"v1","addr":"172.21.15.145:6801","nonce":37421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":37421},{"type":"v1","addr":"172.21.15.145:6803","nonce":37421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":37421},{"type":"v1","addr":"172.21.15.145:6807","nonce":37421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":37421},{"type":"v1","addr":"172.21.15.145:6805","nonce":37421}]},"public_addr":"172.21.15.145:6801/37421","cluster_addr":"172.21.15.145:6803/37421","heartbeat_back_addr":"172.21.15.145:6807/37421","heartbeat_front_addr":"172.21.15.145:6805/37421","state":["exists","up"]},{"osd":5,"uuid":"8e161cb6-0c9b-44c3-b22e-a4db65f167df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":37439},{"type":"v1","addr":"172.21.15.145:6825","nonce":37439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":37439},{"type":"v1","addr":"172.21.15.145:6827","nonce":37439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":37439},{"type":"v1","addr":"172.21.15.145:6831","nonce":37439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":37439},{"type":"v1","addr":"172.21.15.145:6829","nonce":37439}]},"public_addr":"172.21.15.145:6825/37439","cluster_addr":"172.21.15.145:6827/37439","heartbeat_back_addr":"172.21.15.145:6831/37439","heartbeat_front_addr":"172.21.15.145:6829/37439","state":["exists","up"]},{"osd":6,"uuid":"c1f132ba-54e2-47f8-a725-881b32fec209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":37423},{"type":"v1","addr":"172.21.15.145:6809","nonce":37423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":37423},{"type":"v1","addr":"172.21.15.145:6811","nonce":37423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":37423},{"type":"v1","addr":"172.21.15.145:6819","nonce":37423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":37423},{"type":"v1","addr":"172.21.15.145:6814","nonce":37423}]},"public_addr":"172.21.15.145:6809/37423","cluster_addr":"172.21.15.145:6811/37423","heartbeat_back_addr":"172.21.15.145:6819/37423","heartbeat_front_addr":"172.21.15.145:6814/37423","state":["exists","up"]},{"osd":7,"uuid":"b0d61fc9-84ed-4d82-961c-2240773be302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":37424},{"type":"v1","addr":"172.21.15.145:6815","nonce":37424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":37424},{"type":"v1","addr":"172.21.15.145:6818","nonce":37424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":37424},{"type":"v1","addr":"172.21.15.145:6823","nonce":37424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":37424},{"type":"v1","addr":"172.21.15.145:6821","nonce":37424}]},"public_addr":"172.21.15.145:6815/37424","cluster_addr":"172.21.15.145:6818/37424","heartbeat_back_addr":"172.21.15.145:6823/37424","heartbeat_front_addr":"172.21.15.145:6821/37424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.856287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.667176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.628588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.713004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.725589+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.935069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.905312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:21.683645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.145:6837/1729489536":"2024-08-18T02:26:50.339378+0000","172.21.15.145:6835/1729489536":"2024-08-18T02:26:50.339378+0000","172.21.15.2:6835/3013258535":"2024-08-18T02:26:43.461593+0000","172.21.15.2:6833/3013258535":"2024-08-18T02:26:43.461593+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:58.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.312+0000 7fbfa8c00640 1 -- 172.21.15.2:0/314661890 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbf80065180 msgr2=0x7fbf80067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.312+0000 7fbfa8c00640 1 --2- 172.21.15.2:0/314661890 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbf80065180 0x7fbf80067630 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbfa414f1c0 tx=0x7fbf8c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:58.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.312+0000 7fbfa8c00640 1 -- 172.21.15.2:0/314661890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfa40ad960 msgr2=0x7fbfa4169ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.312+0000 7fbfa8c00640 1 --2- 172.21.15.2:0/314661890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfa40ad960 0x7fbfa4169ab0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbf9400d890 tx=0x7fbf94008040 comp rx=0 tx=0).stop 2024-08-17T02:26:58.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.312+0000 7fbfa8c00640 1 -- 172.21.15.2:0/314661890 shutdown_connections 2024-08-17T02:26:58.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.312+0000 7fbfa8c00640 1 --2- 172.21.15.2:0/314661890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbfa40ca050 0x7fbfa4151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.312+0000 7fbfa8c00640 1 --2- 172.21.15.2:0/314661890 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbf80065180 0x7fbf80067630 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.312+0000 7fbfa8c00640 1 --2- 172.21.15.2:0/314661890 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbfa40add30 0x7fbfa414aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.312+0000 7fbfa8c00640 1 --2- 172.21.15.2:0/314661890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfa40ad960 0x7fbfa4169ab0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.312+0000 7fbfa8c00640 1 -- 172.21.15.2:0/314661890 >> 172.21.15.2:0/314661890 conn(0x7fbfa4066e60 msgr2=0x7fbfa4154620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.313+0000 7fbfa8c00640 1 -- 172.21.15.2:0/314661890 shutdown_connections 2024-08-17T02:26:58.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:58.313+0000 7fbfa8c00640 1 -- 172.21.15.2:0/314661890 wait complete. 2024-08-17T02:26:59.329 INFO:tasks.ceph:Scrubbing osd.0 2024-08-17T02:26:59.330 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:26:59.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.495+0000 7f88bc200640 1 Processor -- start 2024-08-17T02:26:59.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.495+0000 7f88bc200640 1 -- start start 2024-08-17T02:26:59.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.497+0000 7f88bc200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88b40ac000 0x7f88b4156a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.497+0000 7f88bc200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f88b40afa00 0x7f88b40afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.497+0000 7f88bc200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b4159ad0 con 0x7f88b40ad020 2024-08-17T02:26:59.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.497+0000 7f88bc200640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b40b0380 con 0x7f88b40afa00 2024-08-17T02:26:59.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.497+0000 7f88bc200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b4156f40 con 0x7f88b40ac000 2024-08-17T02:26:59.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.497+0000 7f88b8e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f88b40ad020 0x7f88b4159f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48620/0 (socket says 172.21.15.2:48620) 2024-08-17T02:26:59.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.497+0000 7f88b8e00640 1 -- 172.21.15.2:0/957619422 learned_addr learned my addr 172.21.15.2:0/957619422 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:26:59.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.497+0000 7f88b9800640 1 --2- 172.21.15.2:0/957619422 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88b40ac000 0x7f88b4156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.497+0000 7f88ba200640 1 --2- 172.21.15.2:0/957619422 >> v2:172.21.15.145:3300/0 conn(0x7f88b40afa00 0x7f88b40afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.497+0000 7f88b3e00640 1 -- 172.21.15.2:0/957619422 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993644155 0 0) 0x7f88b4159ad0 con 0x7f88b40ad020 2024-08-17T02:26:59.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.498+0000 7f88b3e00640 1 -- 172.21.15.2:0/957619422 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f889c0034e0 con 0x7f88b40ad020 2024-08-17T02:26:59.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.498+0000 7f88b9800640 1 -- 172.21.15.2:0/957619422 >> v2:172.21.15.145:3300/0 conn(0x7f88b40afa00 msgr2=0x7f88b40afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:59.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.498+0000 7f88b9800640 1 --2- 172.21.15.2:0/957619422 >> v2:172.21.15.145:3300/0 conn(0x7f88b40afa00 0x7f88b40afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.498+0000 7f88b9800640 1 -- 172.21.15.2:0/957619422 >> v1:172.21.15.2:6789/0 conn(0x7f88b40ad020 legacy=0x7f88b4159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.498+0000 7f88b9800640 1 -- 172.21.15.2:0/957619422 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b40ad590 con 0x7f88b40ac000 2024-08-17T02:26:59.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.498+0000 7f88ba200640 1 --2- 172.21.15.2:0/957619422 >> v2:172.21.15.145:3300/0 conn(0x7f88b40afa00 0x7f88b40afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:59.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.499+0000 7f88b9800640 1 --2- 172.21.15.2:0/957619422 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88b40ac000 0x7f88b4156a00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009850 tx=0x7f88a80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ded9b5d953005273 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.499+0000 7f88b3e00640 1 -- 172.21.15.2:0/957619422 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a802ad00 con 0x7f88b40ac000 2024-08-17T02:26:59.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.499+0000 7f88b3e00640 1 -- 172.21.15.2:0/957619422 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a802ae60 con 0x7f88b40ac000 2024-08-17T02:26:59.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.499+0000 7f88b3e00640 1 -- 172.21.15.2:0/957619422 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a8032670 con 0x7f88b40ac000 2024-08-17T02:26:59.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.500+0000 7f88bc200640 1 -- 172.21.15.2:0/957619422 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88b40ac000 msgr2=0x7f88b4156a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.500+0000 7f88bc200640 1 --2- 172.21.15.2:0/957619422 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88b40ac000 0x7f88b4156a00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009850 tx=0x7f88a80090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.500+0000 7f88bc200640 1 -- 172.21.15.2:0/957619422 shutdown_connections 2024-08-17T02:26:59.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.500+0000 7f88bc200640 1 --2- 172.21.15.2:0/957619422 >> v2:172.21.15.145:3300/0 conn(0x7f88b40afa00 0x7f88b40afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.500+0000 7f88bc200640 1 --2- 172.21.15.2:0/957619422 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88b40ac000 0x7f88b4156a00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.500+0000 7f88bc200640 1 -- 172.21.15.2:0/957619422 >> 172.21.15.2:0/957619422 conn(0x7f88b4066e60 msgr2=0x7f88b4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.500+0000 7f88bc200640 1 -- 172.21.15.2:0/957619422 shutdown_connections 2024-08-17T02:26:59.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.500+0000 7f88bc200640 1 -- 172.21.15.2:0/957619422 wait complete. 2024-08-17T02:26:59.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.501+0000 7f88bc200640 1 Processor -- start 2024-08-17T02:26:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.502+0000 7f88bc200640 1 -- start start 2024-08-17T02:26:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.502+0000 7f88bc200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88b40ac000 0x7f88b41697b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.502+0000 7f88bc200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88b40ad020 0x7f88b4148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.502+0000 7f88bc200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88b40afa00 0x7f88b4158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.502+0000 7f88bc200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b4163240 con 0x7f88b40afa00 2024-08-17T02:26:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.502+0000 7f88bc200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b4169cf0 con 0x7f88b40ad020 2024-08-17T02:26:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.502+0000 7f88bc200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b4157ef0 con 0x7f88b40ac000 2024-08-17T02:26:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.503+0000 7f88ba200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88b40afa00 0x7f88b4158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.503+0000 7f88ba200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88b40afa00 0x7f88b4158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37078/0 (socket says 172.21.15.2:37078) 2024-08-17T02:26:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.503+0000 7f88ba200640 1 -- 172.21.15.2:0/2887245101 learned_addr learned my addr 172.21.15.2:0/2887245101 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.503+0000 7f88b9800640 1 --2- 172.21.15.2:0/2887245101 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88b40ac000 0x7f88b41697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.503+0000 7f88b8e00640 1 --2- 172.21.15.2:0/2887245101 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88b40ad020 0x7f88b4148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.503+0000 7f88ba200640 1 -- 172.21.15.2:0/2887245101 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88b40ac000 msgr2=0x7f88b41697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.503+0000 7f88ba200640 1 --2- 172.21.15.2:0/2887245101 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88b40ac000 0x7f88b41697b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.503+0000 7f88ba200640 1 -- 172.21.15.2:0/2887245101 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88b40ad020 msgr2=0x7f88b4148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.503+0000 7f88ba200640 1 --2- 172.21.15.2:0/2887245101 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88b40ad020 0x7f88b4148f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.503+0000 7f88ba200640 1 -- 172.21.15.2:0/2887245101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac009a20 con 0x7f88b40afa00 2024-08-17T02:26:59.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.503+0000 7f88ba200640 1 --2- 172.21.15.2:0/2887245101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88b40afa00 0x7f88b4158df0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f88ac009fc0 tx=0x7f88ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.504+0000 7f88b0c00640 1 -- 172.21.15.2:0/2887245101 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac00ce10 con 0x7f88b40afa00 2024-08-17T02:26:59.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.504+0000 7f88b0c00640 1 -- 172.21.15.2:0/2887245101 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ac00f040 con 0x7f88b40afa00 2024-08-17T02:26:59.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.504+0000 7f88b0c00640 1 -- 172.21.15.2:0/2887245101 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac0146d0 con 0x7f88b40afa00 2024-08-17T02:26:59.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.504+0000 7f88bc200640 1 -- 172.21.15.2:0/2887245101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a8009390 con 0x7f88b40afa00 2024-08-17T02:26:59.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.504+0000 7f88bc200640 1 -- 172.21.15.2:0/2887245101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b4158330 con 0x7f88b40afa00 2024-08-17T02:26:59.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.505+0000 7f88bc200640 1 -- 172.21.15.2:0/2887245101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f88b4063fb0 con 0x7f88b40afa00 2024-08-17T02:26:59.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.506+0000 7f88b0c00640 1 -- 172.21.15.2:0/2887245101 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f88ac003020 con 0x7f88b40afa00 2024-08-17T02:26:59.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.506+0000 7f88b0c00640 1 --2- 172.21.15.2:0/2887245101 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8894065150 0x7f8894067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.507+0000 7f88b0c00640 1 -- 172.21.15.2:0/2887245101 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f88ac082b60 con 0x7f88b40afa00 2024-08-17T02:26:59.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.507+0000 7f88b0c00640 1 --2- 172.21.15.2:0/2887245101 >> [v2:172.21.15.2:6807/37010,v1:172.21.15.2:6809/37010] conn(0x7f889406b040 0x7f889406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.507+0000 7f88b0c00640 1 -- 172.21.15.2:0/2887245101 --> [v2:172.21.15.2:6807/37010,v1:172.21.15.2:6809/37010] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f889406db00 con 0x7f889406b040 2024-08-17T02:26:59.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.507+0000 7f88b0c00640 1 -- 172.21.15.2:0/2887245101 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88ac087240 con 0x7f88b40afa00 2024-08-17T02:26:59.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.507+0000 7f88b8e00640 1 --2- 172.21.15.2:0/2887245101 >> [v2:172.21.15.2:6807/37010,v1:172.21.15.2:6809/37010] conn(0x7f889406b040 0x7f889406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.507+0000 7f88b9800640 1 --2- 172.21.15.2:0/2887245101 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8894065150 0x7f8894067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.508+0000 7f88b8e00640 1 --2- 172.21.15.2:0/2887245101 >> [v2:172.21.15.2:6807/37010,v1:172.21.15.2:6809/37010] conn(0x7f889406b040 0x7f889406d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.508+0000 7f88b9800640 1 --2- 172.21.15.2:0/2887245101 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8894065150 0x7f8894067600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f88a8034000 tx=0x7f88a8032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.508+0000 7f88b0c00640 1 -- 172.21.15.2:0/2887245101 <== osd.0 v2:172.21.15.2:6807/37010 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f889406db00 con 0x7f889406b040 2024-08-17T02:26:59.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.521+0000 7f88bc200640 1 -- 172.21.15.2:0/2887245101 --> [v2:172.21.15.2:6807/37010,v1:172.21.15.2:6809/37010] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f88b4067c10 con 0x7f889406b040 2024-08-17T02:26:59.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.522+0000 7f88b0c00640 1 -- 172.21.15.2:0/2887245101 <== osd.0 v2:172.21.15.2:6807/37010 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f88b4067c10 con 0x7f889406b040 2024-08-17T02:26:59.523 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-17T02:26:59.523 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:26:59.523 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-17T02:26:59.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.522+0000 7f88bc200640 1 -- 172.21.15.2:0/2887245101 >> [v2:172.21.15.2:6807/37010,v1:172.21.15.2:6809/37010] conn(0x7f889406b040 msgr2=0x7f889406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.522+0000 7f88bc200640 1 --2- 172.21.15.2:0/2887245101 >> [v2:172.21.15.2:6807/37010,v1:172.21.15.2:6809/37010] conn(0x7f889406b040 0x7f889406d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.522+0000 7f88bc200640 1 -- 172.21.15.2:0/2887245101 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8894065150 msgr2=0x7f8894067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.522+0000 7f88bc200640 1 --2- 172.21.15.2:0/2887245101 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8894065150 0x7f8894067600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f88a8034000 tx=0x7f88a8032000 comp rx=0 tx=0).stop 2024-08-17T02:26:59.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.522+0000 7f88bc200640 1 -- 172.21.15.2:0/2887245101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88b40afa00 msgr2=0x7f88b4158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.522+0000 7f88bc200640 1 --2- 172.21.15.2:0/2887245101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88b40afa00 0x7f88b4158df0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f88ac009fc0 tx=0x7f88ac00b040 comp rx=0 tx=0).stop 2024-08-17T02:26:59.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.522+0000 7f88ba200640 1 -- 172.21.15.2:0/2887245101 reap_dead start 2024-08-17T02:26:59.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.522+0000 7f88bc200640 1 -- 172.21.15.2:0/2887245101 shutdown_connections 2024-08-17T02:26:59.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.522+0000 7f88bc200640 1 -- 172.21.15.2:0/2887245101 >> 172.21.15.2:0/2887245101 conn(0x7f88b4066e60 msgr2=0x7f88b40aef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.523+0000 7f88bc200640 1 -- 172.21.15.2:0/2887245101 shutdown_connections 2024-08-17T02:26:59.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.523+0000 7f88bc200640 1 -- 172.21.15.2:0/2887245101 wait complete. 2024-08-17T02:26:59.537 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-17T02:26:59.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.689+0000 7fc57cc00640 1 Processor -- start 2024-08-17T02:26:59.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.689+0000 7fc57cc00640 1 -- start start 2024-08-17T02:26:59.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.690+0000 7fc57cc00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc5780aade0 0x7fc578160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.690+0000 7fc57cc00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5780ad9f0 con 0x7fc578155d90 2024-08-17T02:26:59.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.690+0000 7fc57cc00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5780adc90 con 0x7fc5781559c0 2024-08-17T02:26:59.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.690+0000 7fc57cc00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5780ae1d0 con 0x7fc5780aade0 2024-08-17T02:26:59.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.690+0000 7fc576800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc5780aade0 0x7fc578160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.691+0000 7fc56d400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc578155d90 0x7fc5780a96c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48630/0 (socket says 172.21.15.2:48630) 2024-08-17T02:26:59.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.691+0000 7fc56d400640 1 -- 172.21.15.2:0/1281997981 learned_addr learned my addr 172.21.15.2:0/1281997981 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:26:59.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.691+0000 7fc576800640 1 -- 172.21.15.2:0/1281997981 >> v1:172.21.15.145:6789/0 conn(0x7fc5781559c0 legacy=0x7fc5780acf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.691+0000 7fc576800640 1 -- 172.21.15.2:0/1281997981 >> v1:172.21.15.2:6789/0 conn(0x7fc578155d90 legacy=0x7fc5780a96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.691+0000 7fc576800640 1 -- 172.21.15.2:0/1281997981 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5780adf30 con 0x7fc5780aade0 2024-08-17T02:26:59.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.691+0000 7fc575400640 1 -- 172.21.15.2:0/1281997981 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668232328 0 0) 0x7fc5780ad9f0 con 0x7fc578155d90 2024-08-17T02:26:59.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.692+0000 7fc576800640 1 --2- 172.21.15.2:0/1281997981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5780aade0 0x7fc578160780 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc570009e60 tx=0x7fc570009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b52dba9cc757fb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.692+0000 7fc575400640 1 -- 172.21.15.2:0/1281997981 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc570007550 con 0x7fc5780aade0 2024-08-17T02:26:59.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.692+0000 7fc575400640 1 -- 172.21.15.2:0/1281997981 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57002d050 con 0x7fc5780aade0 2024-08-17T02:26:59.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.692+0000 7fc575400640 1 -- 172.21.15.2:0/1281997981 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc570007900 con 0x7fc5780aade0 2024-08-17T02:26:59.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.693+0000 7fc57cc00640 1 -- 172.21.15.2:0/1281997981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5780aade0 msgr2=0x7fc578160780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.693+0000 7fc57cc00640 1 --2- 172.21.15.2:0/1281997981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5780aade0 0x7fc578160780 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc570009e60 tx=0x7fc570009780 comp rx=0 tx=0).stop 2024-08-17T02:26:59.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.693+0000 7fc57cc00640 1 -- 172.21.15.2:0/1281997981 shutdown_connections 2024-08-17T02:26:59.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.693+0000 7fc57cc00640 1 --2- 172.21.15.2:0/1281997981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5780aade0 0x7fc578160780 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.693+0000 7fc57cc00640 1 -- 172.21.15.2:0/1281997981 >> 172.21.15.2:0/1281997981 conn(0x7fc578095a70 msgr2=0x7fc578095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.693+0000 7fc57cc00640 1 -- 172.21.15.2:0/1281997981 shutdown_connections 2024-08-17T02:26:59.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.693+0000 7fc57cc00640 1 -- 172.21.15.2:0/1281997981 wait complete. 2024-08-17T02:26:59.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.694+0000 7fc57cc00640 1 Processor -- start 2024-08-17T02:26:59.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.695+0000 7fc57cc00640 1 -- start start 2024-08-17T02:26:59.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.695+0000 7fc57cc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5780aade0 0x7fc578147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.695+0000 7fc57cc00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5781559c0 0x7fc578158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.695+0000 7fc57cc00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc578155d90 0x7fc5780980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.695+0000 7fc57cc00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc578147c10 con 0x7fc5780aade0 2024-08-17T02:26:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.695+0000 7fc57cc00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5781499c0 con 0x7fc5781559c0 2024-08-17T02:26:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.695+0000 7fc57cc00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5781490d0 con 0x7fc578155d90 2024-08-17T02:26:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.696+0000 7fc575e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5780aade0 0x7fc578147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.696+0000 7fc575e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5780aade0 0x7fc578147030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37094/0 (socket says 172.21.15.2:37094) 2024-08-17T02:26:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.696+0000 7fc575e00640 1 -- 172.21.15.2:0/1998950515 learned_addr learned my addr 172.21.15.2:0/1998950515 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:26:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.696+0000 7fc56d400640 1 --2- 172.21.15.2:0/1998950515 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5781559c0 0x7fc578158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.696+0000 7fc576800640 1 --2- 172.21.15.2:0/1998950515 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc578155d90 0x7fc5780980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.696+0000 7fc575e00640 1 -- 172.21.15.2:0/1998950515 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc578155d90 msgr2=0x7fc5780980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.696+0000 7fc575e00640 1 --2- 172.21.15.2:0/1998950515 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc578155d90 0x7fc5780980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.696+0000 7fc575e00640 1 -- 172.21.15.2:0/1998950515 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5781559c0 msgr2=0x7fc578158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.696+0000 7fc575e00640 1 --2- 172.21.15.2:0/1998950515 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5781559c0 0x7fc578158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.696+0000 7fc575e00640 1 -- 172.21.15.2:0/1998950515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc570009a20 con 0x7fc5780aade0 2024-08-17T02:26:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.697+0000 7fc575e00640 1 --2- 172.21.15.2:0/1998950515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5780aade0 0x7fc578147030 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc56800c560 tx=0x7fc568007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.697+0000 7fc56e000640 1 -- 172.21.15.2:0/1998950515 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc568011590 con 0x7fc5780aade0 2024-08-17T02:26:59.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.697+0000 7fc56e000640 1 -- 172.21.15.2:0/1998950515 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc568011710 con 0x7fc5780aade0 2024-08-17T02:26:59.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.697+0000 7fc56e000640 1 -- 172.21.15.2:0/1998950515 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc568011ad0 con 0x7fc5780aade0 2024-08-17T02:26:59.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.697+0000 7fc57cc00640 1 -- 172.21.15.2:0/1998950515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc578147930 con 0x7fc5780aade0 2024-08-17T02:26:59.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.697+0000 7fc57cc00640 1 -- 172.21.15.2:0/1998950515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc578147570 con 0x7fc5780aade0 2024-08-17T02:26:59.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.698+0000 7fc57cc00640 1 -- 172.21.15.2:0/1998950515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc578063fb0 con 0x7fc5780aade0 2024-08-17T02:26:59.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.699+0000 7fc56e000640 1 -- 172.21.15.2:0/1998950515 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc56801b3b0 con 0x7fc5780aade0 2024-08-17T02:26:59.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.700+0000 7fc56e000640 1 --2- 172.21.15.2:0/1998950515 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc554065150 0x7fc554067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.700+0000 7fc56e000640 1 -- 172.21.15.2:0/1998950515 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fc568081740 con 0x7fc5780aade0 2024-08-17T02:26:59.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.700+0000 7fc56d400640 1 --2- 172.21.15.2:0/1998950515 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc554065150 0x7fc554067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.701+0000 7fc56d400640 1 --2- 172.21.15.2:0/1998950515 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc554065150 0x7fc554067600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc5780c8b70 tx=0x7fc560007ea0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.704+0000 7fc56e000640 1 -- 172.21.15.2:0/1998950515 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc56804fab0 con 0x7fc5780aade0 2024-08-17T02:26:59.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.885+0000 7fc57cc00640 1 -- 172.21.15.2:0/1998950515 --> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fc578149b00 con 0x7fc554065150 2024-08-17T02:26:59.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.886+0000 7fc56e000640 1 -- 172.21.15.2:0/1998950515 <== mgr.4108 v2:172.21.15.145:6832/36841 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc560007640 con 0x7fc554065150 2024-08-17T02:26:59.887 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 0 to deep-scrub 2024-08-17T02:26:59.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.888+0000 7fc57cc00640 1 -- 172.21.15.2:0/1998950515 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc554065150 msgr2=0x7fc554067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.888+0000 7fc57cc00640 1 --2- 172.21.15.2:0/1998950515 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc554065150 0x7fc554067600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc5780c8b70 tx=0x7fc560007ea0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.888+0000 7fc57cc00640 1 -- 172.21.15.2:0/1998950515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5780aade0 msgr2=0x7fc578147030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.888+0000 7fc57cc00640 1 --2- 172.21.15.2:0/1998950515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5780aade0 0x7fc578147030 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc56800c560 tx=0x7fc568007ef0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.888+0000 7fc57cc00640 1 -- 172.21.15.2:0/1998950515 shutdown_connections 2024-08-17T02:26:59.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.888+0000 7fc57cc00640 1 --2- 172.21.15.2:0/1998950515 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc554065150 0x7fc554067600 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.888+0000 7fc57cc00640 1 --2- 172.21.15.2:0/1998950515 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc578155d90 0x7fc5780980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.888+0000 7fc57cc00640 1 --2- 172.21.15.2:0/1998950515 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5781559c0 0x7fc578158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.888+0000 7fc57cc00640 1 --2- 172.21.15.2:0/1998950515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5780aade0 0x7fc578147030 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.888+0000 7fc57cc00640 1 -- 172.21.15.2:0/1998950515 >> 172.21.15.2:0/1998950515 conn(0x7fc578095a70 msgr2=0x7fc5780b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.888+0000 7fc57cc00640 1 -- 172.21.15.2:0/1998950515 shutdown_connections 2024-08-17T02:26:59.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:26:59.888+0000 7fc57cc00640 1 -- 172.21.15.2:0/1998950515 wait complete. 2024-08-17T02:26:59.904 INFO:tasks.ceph:Scrubbing osd.1 2024-08-17T02:26:59.905 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:27:00.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.059+0000 7f8955e00640 1 Processor -- start 2024-08-17T02:27:00.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.059+0000 7f8955e00640 1 -- start start 2024-08-17T02:27:00.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.060+0000 7f8955e00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8950156a90 0x7f89500ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.060+0000 7f8955e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f89500adba0 0x7f89500ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.060+0000 7f8955e00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89501582b0 con 0x7f89500aed30 2024-08-17T02:27:00.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.060+0000 7f8955e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89500c9f80 con 0x7f89500adba0 2024-08-17T02:27:00.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.060+0000 7f8955e00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89500ca110 con 0x7f8950156a90 2024-08-17T02:27:00.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.061+0000 7f8947e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f89500adba0 0x7f89500ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.061+0000 7f8947e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f89500adba0 0x7f89500ae7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37108/0 (socket says 172.21.15.2:37108) 2024-08-17T02:27:00.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.061+0000 7f8947e00640 1 -- 172.21.15.2:0/655158953 learned_addr learned my addr 172.21.15.2:0/655158953 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:00.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.061+0000 7f894ea00640 1 --2- 172.21.15.2:0/655158953 >> v2:172.21.15.145:3300/0 conn(0x7f8950156a90 0x7f89500ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.061+0000 7f8947e00640 1 -- 172.21.15.2:0/655158953 >> v2:172.21.15.145:3300/0 conn(0x7f8950156a90 msgr2=0x7f89500ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:00.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.061+0000 7f8947e00640 1 --2- 172.21.15.2:0/655158953 >> v2:172.21.15.145:3300/0 conn(0x7f8950156a90 0x7f89500ad660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.061+0000 7f8947e00640 1 -- 172.21.15.2:0/655158953 >> v1:172.21.15.145:6789/0 conn(0x7f89500aed30 legacy=0x7f895006d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:00.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.061+0000 7f8947e00640 1 -- 172.21.15.2:0/655158953 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89500adff0 con 0x7f89500adba0 2024-08-17T02:27:00.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.062+0000 7f8947e00640 1 --2- 172.21.15.2:0/655158953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89500adba0 0x7f89500ae7f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f895006d250 tx=0x7f89380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78cd669c071542c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.063+0000 7f894e000640 1 -- 172.21.15.2:0/655158953 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893802ae80 con 0x7f89500adba0 2024-08-17T02:27:00.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.063+0000 7f894e000640 1 -- 172.21.15.2:0/655158953 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8938032440 con 0x7f89500adba0 2024-08-17T02:27:00.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.063+0000 7f894e000640 1 -- 172.21.15.2:0/655158953 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8938032800 con 0x7f89500adba0 2024-08-17T02:27:00.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.063+0000 7f8955e00640 1 -- 172.21.15.2:0/655158953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89500adba0 msgr2=0x7f89500ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.063+0000 7f8955e00640 1 --2- 172.21.15.2:0/655158953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89500adba0 0x7f89500ae7f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f895006d250 tx=0x7f89380091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.063+0000 7f8955e00640 1 -- 172.21.15.2:0/655158953 shutdown_connections 2024-08-17T02:27:00.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.063+0000 7f8955e00640 1 --2- 172.21.15.2:0/655158953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89500adba0 0x7f89500ae7f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.063+0000 7f8955e00640 1 --2- 172.21.15.2:0/655158953 >> v2:172.21.15.145:3300/0 conn(0x7f8950156a90 0x7f89500ad660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.063+0000 7f8955e00640 1 -- 172.21.15.2:0/655158953 >> 172.21.15.2:0/655158953 conn(0x7f8950066e60 msgr2=0x7f8950067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.063+0000 7f8955e00640 1 -- 172.21.15.2:0/655158953 shutdown_connections 2024-08-17T02:27:00.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.063+0000 7f8955e00640 1 -- 172.21.15.2:0/655158953 wait complete. 2024-08-17T02:27:00.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.065+0000 7f8955e00640 1 Processor -- start 2024-08-17T02:27:00.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.065+0000 7f8955e00640 1 -- start start 2024-08-17T02:27:00.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.066+0000 7f8955e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f89500adba0 0x7f89500c0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.066+0000 7f8955e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f89500aed30 0x7f89500ac800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.066+0000 7f8955e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8950156a90 0x7f8950147360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.066+0000 7f8955e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8950153a00 con 0x7f8950156a90 2024-08-17T02:27:00.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.066+0000 7f8955e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89500acd40 con 0x7f89500aed30 2024-08-17T02:27:00.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.066+0000 7f8955e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89500acfe0 con 0x7f89500adba0 2024-08-17T02:27:00.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.066+0000 7f894f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8950156a90 0x7f8950147360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.066+0000 7f894f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8950156a90 0x7f8950147360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37118/0 (socket says 172.21.15.2:37118) 2024-08-17T02:27:00.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.066+0000 7f894f400640 1 -- 172.21.15.2:0/2656208991 learned_addr learned my addr 172.21.15.2:0/2656208991 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:00.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.066+0000 7f894ea00640 1 --2- 172.21.15.2:0/2656208991 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f89500adba0 0x7f89500c0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.066+0000 7f8947e00640 1 --2- 172.21.15.2:0/2656208991 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f89500aed30 0x7f89500ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.066+0000 7f894f400640 1 -- 172.21.15.2:0/2656208991 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f89500adba0 msgr2=0x7f89500c0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.066+0000 7f894f400640 1 --2- 172.21.15.2:0/2656208991 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f89500adba0 0x7f89500c0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.066+0000 7f894f400640 1 -- 172.21.15.2:0/2656208991 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f89500aed30 msgr2=0x7f89500ac800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.066+0000 7f894f400640 1 --2- 172.21.15.2:0/2656208991 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f89500aed30 0x7f89500ac800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.066+0000 7f894f400640 1 -- 172.21.15.2:0/2656208991 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8938009450 con 0x7f8950156a90 2024-08-17T02:27:00.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.066+0000 7f894ea00640 1 --2- 172.21.15.2:0/2656208991 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f89500adba0 0x7f89500c0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:00.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.066+0000 7f8947e00640 1 --2- 172.21.15.2:0/2656208991 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f89500aed30 0x7f89500ac800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:00.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.067+0000 7f894f400640 1 --2- 172.21.15.2:0/2656208991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8950156a90 0x7f8950147360 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f894800c860 tx=0x7f8948001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.067+0000 7f8946000640 1 -- 172.21.15.2:0/2656208991 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894800ce50 con 0x7f8950156a90 2024-08-17T02:27:00.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.067+0000 7f8946000640 1 -- 172.21.15.2:0/2656208991 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894800a850 con 0x7f8950156a90 2024-08-17T02:27:00.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.067+0000 7f8946000640 1 -- 172.21.15.2:0/2656208991 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894800ac10 con 0x7f8950156a90 2024-08-17T02:27:00.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.067+0000 7f8955e00640 1 -- 172.21.15.2:0/2656208991 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89500ad2c0 con 0x7f8950156a90 2024-08-17T02:27:00.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.067+0000 7f8955e00640 1 -- 172.21.15.2:0/2656208991 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89501478a0 con 0x7f8950156a90 2024-08-17T02:27:00.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.068+0000 7f8955e00640 1 -- 172.21.15.2:0/2656208991 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f89501537f0 con 0x7f8950156a90 2024-08-17T02:27:00.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.069+0000 7f8946000640 1 -- 172.21.15.2:0/2656208991 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8948012630 con 0x7f8950156a90 2024-08-17T02:27:00.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.070+0000 7f8946000640 1 --2- 172.21.15.2:0/2656208991 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f892c065150 0x7f892c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.070+0000 7f8946000640 1 -- 172.21.15.2:0/2656208991 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f89480824d0 con 0x7f8950156a90 2024-08-17T02:27:00.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.070+0000 7f8946000640 1 --2- 172.21.15.2:0/2656208991 >> [v2:172.21.15.2:6800/37012,v1:172.21.15.2:6801/37012] conn(0x7f892c06b040 0x7f892c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.070+0000 7f8946000640 1 -- 172.21.15.2:0/2656208991 --> [v2:172.21.15.2:6800/37012,v1:172.21.15.2:6801/37012] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f892c06db00 con 0x7f892c06b040 2024-08-17T02:27:00.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.070+0000 7f8946000640 1 -- 172.21.15.2:0/2656208991 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89480849d0 con 0x7f8950156a90 2024-08-17T02:27:00.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.070+0000 7f894ea00640 1 --2- 172.21.15.2:0/2656208991 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f892c065150 0x7f892c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.070+0000 7f8947e00640 1 --2- 172.21.15.2:0/2656208991 >> [v2:172.21.15.2:6800/37012,v1:172.21.15.2:6801/37012] conn(0x7f892c06b040 0x7f892c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.071+0000 7f8947e00640 1 --2- 172.21.15.2:0/2656208991 >> [v2:172.21.15.2:6800/37012,v1:172.21.15.2:6801/37012] conn(0x7f892c06b040 0x7f892c06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.071+0000 7f894ea00640 1 --2- 172.21.15.2:0/2656208991 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f892c065150 0x7f892c067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f89400099b0 tx=0x7f8940008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.072+0000 7f8946000640 1 -- 172.21.15.2:0/2656208991 <== osd.1 v2:172.21.15.2:6800/37012 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f892c06db00 con 0x7f892c06b040 2024-08-17T02:27:00.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.085+0000 7f8955e00640 1 -- 172.21.15.2:0/2656208991 --> [v2:172.21.15.2:6800/37012,v1:172.21.15.2:6801/37012] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f89500ad7c0 con 0x7f892c06b040 2024-08-17T02:27:00.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.085+0000 7f8946000640 1 -- 172.21.15.2:0/2656208991 <== osd.1 v2:172.21.15.2:6800/37012 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f89500ad7c0 con 0x7f892c06b040 2024-08-17T02:27:00.086 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-17T02:27:00.087 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:27:00.087 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-17T02:27:00.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.085+0000 7f8955e00640 1 -- 172.21.15.2:0/2656208991 >> [v2:172.21.15.2:6800/37012,v1:172.21.15.2:6801/37012] conn(0x7f892c06b040 msgr2=0x7f892c06d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.085+0000 7f8955e00640 1 --2- 172.21.15.2:0/2656208991 >> [v2:172.21.15.2:6800/37012,v1:172.21.15.2:6801/37012] conn(0x7f892c06b040 0x7f892c06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.085+0000 7f8955e00640 1 -- 172.21.15.2:0/2656208991 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f892c065150 msgr2=0x7f892c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.085+0000 7f8955e00640 1 --2- 172.21.15.2:0/2656208991 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f892c065150 0x7f892c067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f89400099b0 tx=0x7f8940008040 comp rx=0 tx=0).stop 2024-08-17T02:27:00.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.085+0000 7f8955e00640 1 -- 172.21.15.2:0/2656208991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8950156a90 msgr2=0x7f8950147360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.085+0000 7f8955e00640 1 --2- 172.21.15.2:0/2656208991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8950156a90 0x7f8950147360 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f894800c860 tx=0x7f8948001690 comp rx=0 tx=0).stop 2024-08-17T02:27:00.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.085+0000 7f894f400640 1 -- 172.21.15.2:0/2656208991 reap_dead start 2024-08-17T02:27:00.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.086+0000 7f8955e00640 1 -- 172.21.15.2:0/2656208991 shutdown_connections 2024-08-17T02:27:00.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.086+0000 7f8955e00640 1 -- 172.21.15.2:0/2656208991 >> 172.21.15.2:0/2656208991 conn(0x7f8950066e60 msgr2=0x7f8950155cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.086+0000 7f8955e00640 1 -- 172.21.15.2:0/2656208991 shutdown_connections 2024-08-17T02:27:00.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.086+0000 7f8955e00640 1 -- 172.21.15.2:0/2656208991 wait complete. 2024-08-17T02:27:00.101 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-17T02:27:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.252+0000 7fe5b0c00640 1 Processor -- start 2024-08-17T02:27:00.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.252+0000 7fe5b0c00640 1 -- start start 2024-08-17T02:27:00.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.254+0000 7fe5b0c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe5ac0afca0 0x7fe5ac0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.254+0000 7fe5b0c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5ac1590b0 0x7fe5ac159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.254+0000 7fe5b0c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5ac15a4e0 con 0x7fe5ac0acf10 2024-08-17T02:27:00.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.254+0000 7fe5b0c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5ac0b0980 con 0x7fe5ac0afca0 2024-08-17T02:27:00.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.254+0000 7fe5b0c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac0c92b0 con 0x7fe5ac1590b0 2024-08-17T02:27:00.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.254+0000 7fe5a9e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe5ac0afca0 0x7fe5ac0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.254+0000 7fe5a9e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe5ac0afca0 0x7fe5ac0b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37122/0 (socket says 172.21.15.2:37122) 2024-08-17T02:27:00.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.254+0000 7fe5a9e00640 1 -- 172.21.15.2:0/1280742721 learned_addr learned my addr 172.21.15.2:0/1280742721 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:00.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.254+0000 7fe5a9400640 1 --1- 172.21.15.2:0/1280742721 >> v1:172.21.15.2:6789/0 conn(0x7fe5ac0acf10 0x7fe5ac1589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48640/0 (socket says 172.21.15.2:48640) 2024-08-17T02:27:00.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.254+0000 7fe5aa800640 1 --2- 172.21.15.2:0/1280742721 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5ac1590b0 0x7fe5ac159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.254+0000 7fe5a9e00640 1 -- 172.21.15.2:0/1280742721 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5ac1590b0 msgr2=0x7fe5ac159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:00.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.254+0000 7fe5a9e00640 1 --2- 172.21.15.2:0/1280742721 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5ac1590b0 0x7fe5ac159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.254+0000 7fe5a9e00640 1 -- 172.21.15.2:0/1280742721 >> v1:172.21.15.2:6789/0 conn(0x7fe5ac0acf10 legacy=0x7fe5ac1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.254+0000 7fe5a9e00640 1 -- 172.21.15.2:0/1280742721 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac0ad480 con 0x7fe5ac0afca0 2024-08-17T02:27:00.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.254+0000 7fe5aa800640 1 --2- 172.21.15.2:0/1280742721 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5ac1590b0 0x7fe5ac159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:00.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.255+0000 7fe5a9e00640 1 --2- 172.21.15.2:0/1280742721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5ac0afca0 0x7fe5ac0b0070 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe59c009910 tx=0x7fe59c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11a255a92afe51b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.256+0000 7fe5a8a00640 1 -- 172.21.15.2:0/1280742721 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c031510 con 0x7fe5ac0afca0 2024-08-17T02:27:00.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.256+0000 7fe5a8a00640 1 -- 172.21.15.2:0/1280742721 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59c02f050 con 0x7fe5ac0afca0 2024-08-17T02:27:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.256+0000 7fe5a8a00640 1 -- 172.21.15.2:0/1280742721 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c0318e0 con 0x7fe5ac0afca0 2024-08-17T02:27:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.256+0000 7fe5b0c00640 1 -- 172.21.15.2:0/1280742721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5ac0afca0 msgr2=0x7fe5ac0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.256+0000 7fe5b0c00640 1 --2- 172.21.15.2:0/1280742721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5ac0afca0 0x7fe5ac0b0070 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe59c009910 tx=0x7fe59c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.256+0000 7fe5b0c00640 1 -- 172.21.15.2:0/1280742721 shutdown_connections 2024-08-17T02:27:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.256+0000 7fe5b0c00640 1 --2- 172.21.15.2:0/1280742721 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5ac1590b0 0x7fe5ac159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.256+0000 7fe5b0c00640 1 --2- 172.21.15.2:0/1280742721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5ac0afca0 0x7fe5ac0b0070 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.256+0000 7fe5b0c00640 1 -- 172.21.15.2:0/1280742721 >> 172.21.15.2:0/1280742721 conn(0x7fe5ac066e60 msgr2=0x7fe5ac067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.256+0000 7fe5b0c00640 1 -- 172.21.15.2:0/1280742721 shutdown_connections 2024-08-17T02:27:00.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.257+0000 7fe5b0c00640 1 -- 172.21.15.2:0/1280742721 wait complete. 2024-08-17T02:27:00.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.258+0000 7fe5b0c00640 1 Processor -- start 2024-08-17T02:27:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.258+0000 7fe5b0c00640 1 -- start start 2024-08-17T02:27:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.259+0000 7fe5b0c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5ac0acf10 0x7fe5ac156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.259+0000 7fe5b0c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5ac0afca0 0x7fe5ac142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.259+0000 7fe5b0c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5ac1590b0 0x7fe5ac0cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.259+0000 7fe5b0c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac0a4950 con 0x7fe5ac1590b0 2024-08-17T02:27:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.259+0000 7fe5b0c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac0c5720 con 0x7fe5ac0afca0 2024-08-17T02:27:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.259+0000 7fe5b0c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac157120 con 0x7fe5ac0acf10 2024-08-17T02:27:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.259+0000 7fe5aa800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5ac1590b0 0x7fe5ac0cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.259+0000 7fe5aa800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5ac1590b0 0x7fe5ac0cb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37136/0 (socket says 172.21.15.2:37136) 2024-08-17T02:27:00.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.259+0000 7fe5aa800640 1 -- 172.21.15.2:0/1657157382 learned_addr learned my addr 172.21.15.2:0/1657157382 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:00.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.259+0000 7fe5a9e00640 1 --2- 172.21.15.2:0/1657157382 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5ac0acf10 0x7fe5ac156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.259+0000 7fe5a9400640 1 --2- 172.21.15.2:0/1657157382 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5ac0afca0 0x7fe5ac142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.260+0000 7fe5aa800640 1 -- 172.21.15.2:0/1657157382 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5ac0acf10 msgr2=0x7fe5ac156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.260+0000 7fe5aa800640 1 --2- 172.21.15.2:0/1657157382 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5ac0acf10 0x7fe5ac156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.260+0000 7fe5aa800640 1 -- 172.21.15.2:0/1657157382 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5ac0afca0 msgr2=0x7fe5ac142cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.260+0000 7fe5aa800640 1 --2- 172.21.15.2:0/1657157382 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5ac0afca0 0x7fe5ac142cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.260+0000 7fe5aa800640 1 -- 172.21.15.2:0/1657157382 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c009450 con 0x7fe5ac1590b0 2024-08-17T02:27:00.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.260+0000 7fe5a9e00640 1 --2- 172.21.15.2:0/1657157382 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5ac0acf10 0x7fe5ac156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:00.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.260+0000 7fe5a9400640 1 --2- 172.21.15.2:0/1657157382 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5ac0afca0 0x7fe5ac142cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:00.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.260+0000 7fe5aa800640 1 --2- 172.21.15.2:0/1657157382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5ac1590b0 0x7fe5ac0cb790 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe5a400cf20 tx=0x7fe5a4007820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.260+0000 7fe5a1600640 1 -- 172.21.15.2:0/1657157382 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4016430 con 0x7fe5ac1590b0 2024-08-17T02:27:00.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.260+0000 7fe5a1600640 1 -- 172.21.15.2:0/1657157382 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a4016590 con 0x7fe5ac1590b0 2024-08-17T02:27:00.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.260+0000 7fe5a1600640 1 -- 172.21.15.2:0/1657157382 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4016950 con 0x7fe5ac1590b0 2024-08-17T02:27:00.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.260+0000 7fe5b0c00640 1 -- 172.21.15.2:0/1657157382 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5ac0a4670 con 0x7fe5ac1590b0 2024-08-17T02:27:00.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.260+0000 7fe5b0c00640 1 -- 172.21.15.2:0/1657157382 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ac0c53b0 con 0x7fe5ac1590b0 2024-08-17T02:27:00.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.261+0000 7fe5b0c00640 1 -- 172.21.15.2:0/1657157382 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5ac0c58b0 con 0x7fe5ac1590b0 2024-08-17T02:27:00.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.262+0000 7fe5a1600640 1 -- 172.21.15.2:0/1657157382 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe5a4003020 con 0x7fe5ac1590b0 2024-08-17T02:27:00.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.263+0000 7fe5a1600640 1 --2- 172.21.15.2:0/1657157382 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe58c065150 0x7fe58c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.263+0000 7fe5a1600640 1 -- 172.21.15.2:0/1657157382 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fe5a4012070 con 0x7fe5ac1590b0 2024-08-17T02:27:00.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.263+0000 7fe5a9e00640 1 --2- 172.21.15.2:0/1657157382 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe58c065150 0x7fe58c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.264+0000 7fe5a9e00640 1 --2- 172.21.15.2:0/1657157382 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe58c065150 0x7fe58c067600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe59c036000 tx=0x7fe59c037000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.267+0000 7fe5a1600640 1 -- 172.21.15.2:0/1657157382 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe5a40513b0 con 0x7fe5ac1590b0 2024-08-17T02:27:00.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.446+0000 7fe5b0c00640 1 -- 172.21.15.2:0/1657157382 --> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5ac063fb0 con 0x7fe58c065150 2024-08-17T02:27:00.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.447+0000 7fe5a1600640 1 -- 172.21.15.2:0/1657157382 <== mgr.4108 v2:172.21.15.145:6832/36841 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe5ac063fb0 con 0x7fe58c065150 2024-08-17T02:27:00.449 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 1 to deep-scrub 2024-08-17T02:27:00.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.449+0000 7fe5b0c00640 1 -- 172.21.15.2:0/1657157382 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe58c065150 msgr2=0x7fe58c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.449+0000 7fe5b0c00640 1 --2- 172.21.15.2:0/1657157382 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe58c065150 0x7fe58c067600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe59c036000 tx=0x7fe59c037000 comp rx=0 tx=0).stop 2024-08-17T02:27:00.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.449+0000 7fe5b0c00640 1 -- 172.21.15.2:0/1657157382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5ac1590b0 msgr2=0x7fe5ac0cb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.449+0000 7fe5b0c00640 1 --2- 172.21.15.2:0/1657157382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5ac1590b0 0x7fe5ac0cb790 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe5a400cf20 tx=0x7fe5a4007820 comp rx=0 tx=0).stop 2024-08-17T02:27:00.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.449+0000 7fe5b0c00640 1 -- 172.21.15.2:0/1657157382 shutdown_connections 2024-08-17T02:27:00.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.449+0000 7fe5b0c00640 1 --2- 172.21.15.2:0/1657157382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5ac1590b0 0x7fe5ac0cb790 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.449+0000 7fe5b0c00640 1 --2- 172.21.15.2:0/1657157382 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5ac0afca0 0x7fe5ac142cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.449+0000 7fe5b0c00640 1 --2- 172.21.15.2:0/1657157382 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe58c065150 0x7fe58c067600 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.449+0000 7fe5b0c00640 1 --2- 172.21.15.2:0/1657157382 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5ac0acf10 0x7fe5ac156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.449+0000 7fe5b0c00640 1 -- 172.21.15.2:0/1657157382 >> 172.21.15.2:0/1657157382 conn(0x7fe5ac066e60 msgr2=0x7fe5ac0698a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.450+0000 7fe5b0c00640 1 -- 172.21.15.2:0/1657157382 shutdown_connections 2024-08-17T02:27:00.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.450+0000 7fe5b0c00640 1 -- 172.21.15.2:0/1657157382 wait complete. 2024-08-17T02:27:00.466 INFO:tasks.ceph:Scrubbing osd.2 2024-08-17T02:27:00.466 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:27:00.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.621+0000 7fc8c8c00640 1 Processor -- start 2024-08-17T02:27:00.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.621+0000 7fc8c8c00640 1 -- start start 2024-08-17T02:27:00.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.622+0000 7fc8c8c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc8c4156a90 0x7fc8c40ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.622+0000 7fc8c8c00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc8c40adba0 0x7fc8c40ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.622+0000 7fc8c8c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c41582b0 con 0x7fc8c40aed30 2024-08-17T02:27:00.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.622+0000 7fc8c8c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c40c9f80 con 0x7fc8c4156a90 2024-08-17T02:27:00.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.622+0000 7fc8c8c00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c40ca110 con 0x7fc8c40adba0 2024-08-17T02:27:00.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.622+0000 7fc8c1e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc8c4156a90 0x7fc8c40ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.622+0000 7fc8c2800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc8c40aed30 0x7fc8c406d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48644/0 (socket says 172.21.15.2:48644) 2024-08-17T02:27:00.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.622+0000 7fc8c2800640 1 -- 172.21.15.2:0/529951899 learned_addr learned my addr 172.21.15.2:0/529951899 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:27:00.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.623+0000 7fc8c1400640 1 --2- 172.21.15.2:0/529951899 >> v2:172.21.15.145:3300/0 conn(0x7fc8c40adba0 0x7fc8c40ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.623+0000 7fc8c1e00640 1 -- 172.21.15.2:0/529951899 >> v2:172.21.15.145:3300/0 conn(0x7fc8c40adba0 msgr2=0x7fc8c40ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:00.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.623+0000 7fc8c1e00640 1 --2- 172.21.15.2:0/529951899 >> v2:172.21.15.145:3300/0 conn(0x7fc8c40adba0 0x7fc8c40ae7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.623+0000 7fc8c1e00640 1 -- 172.21.15.2:0/529951899 >> v1:172.21.15.2:6789/0 conn(0x7fc8c40aed30 legacy=0x7fc8c406d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.623+0000 7fc8c1e00640 1 -- 172.21.15.2:0/529951899 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c40adff0 con 0x7fc8c4156a90 2024-08-17T02:27:00.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.623+0000 7fc8c0a00640 1 -- 172.21.15.2:0/529951899 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928064720 0 0) 0x7fc8c41582b0 con 0x7fc8c40aed30 2024-08-17T02:27:00.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.623+0000 7fc8c1400640 1 --2- 172.21.15.2:0/529951899 >> v2:172.21.15.145:3300/0 conn(0x7fc8c40adba0 0x7fc8c40ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:00.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.624+0000 7fc8c1e00640 1 --2- 172.21.15.2:0/529951899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8c4156a90 0x7fc8c40ad660 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4158260 tx=0x7fc8b40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3ef2cf4a73d523 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.624+0000 7fc8c0a00640 1 -- 172.21.15.2:0/529951899 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b402adb0 con 0x7fc8c4156a90 2024-08-17T02:27:00.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.624+0000 7fc8c0a00640 1 -- 172.21.15.2:0/529951899 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b4032440 con 0x7fc8c4156a90 2024-08-17T02:27:00.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.624+0000 7fc8c0a00640 1 -- 172.21.15.2:0/529951899 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b40327e0 con 0x7fc8c4156a90 2024-08-17T02:27:00.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.625+0000 7fc8c8c00640 1 -- 172.21.15.2:0/529951899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8c4156a90 msgr2=0x7fc8c40ad660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.625+0000 7fc8c8c00640 1 --2- 172.21.15.2:0/529951899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8c4156a90 0x7fc8c40ad660 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4158260 tx=0x7fc8b40090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.625+0000 7fc8c8c00640 1 -- 172.21.15.2:0/529951899 shutdown_connections 2024-08-17T02:27:00.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.625+0000 7fc8c8c00640 1 --2- 172.21.15.2:0/529951899 >> v2:172.21.15.145:3300/0 conn(0x7fc8c40adba0 0x7fc8c40ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.625+0000 7fc8c8c00640 1 --2- 172.21.15.2:0/529951899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8c4156a90 0x7fc8c40ad660 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.625+0000 7fc8c8c00640 1 -- 172.21.15.2:0/529951899 >> 172.21.15.2:0/529951899 conn(0x7fc8c4066e60 msgr2=0x7fc8c4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.625+0000 7fc8c8c00640 1 -- 172.21.15.2:0/529951899 shutdown_connections 2024-08-17T02:27:00.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.625+0000 7fc8c8c00640 1 -- 172.21.15.2:0/529951899 wait complete. 2024-08-17T02:27:00.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.626+0000 7fc8c8c00640 1 Processor -- start 2024-08-17T02:27:00.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.627+0000 7fc8c8c00640 1 -- start start 2024-08-17T02:27:00.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.627+0000 7fc8c8c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8c40adba0 0x7fc8c414a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.627+0000 7fc8c8c00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8c40aed30 0x7fc8c40a98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.627+0000 7fc8c8c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8c4156a90 0x7fc8c40cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.627+0000 7fc8c8c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c40aa9a0 con 0x7fc8c40adba0 2024-08-17T02:27:00.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.627+0000 7fc8c8c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c40abf80 con 0x7fc8c4156a90 2024-08-17T02:27:00.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.628+0000 7fc8c8c00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c414aca0 con 0x7fc8c40aed30 2024-08-17T02:27:00.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.628+0000 7fc8c1e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8c40adba0 0x7fc8c414a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.628+0000 7fc8c1e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8c40adba0 0x7fc8c414a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37148/0 (socket says 172.21.15.2:37148) 2024-08-17T02:27:00.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.628+0000 7fc8c1e00640 1 -- 172.21.15.2:0/3894011056 learned_addr learned my addr 172.21.15.2:0/3894011056 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:00.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.628+0000 7fc8c1e00640 1 -- 172.21.15.2:0/3894011056 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8c40aed30 msgr2=0x7fc8c40a98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.628+0000 7fc8c1e00640 1 --2- 172.21.15.2:0/3894011056 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8c40aed30 0x7fc8c40a98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.628+0000 7fc8c1e00640 1 -- 172.21.15.2:0/3894011056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8c4156a90 msgr2=0x7fc8c40cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.628+0000 7fc8c1e00640 1 --2- 172.21.15.2:0/3894011056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8c4156a90 0x7fc8c40cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.628+0000 7fc8c1e00640 1 -- 172.21.15.2:0/3894011056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b4009390 con 0x7fc8c40adba0 2024-08-17T02:27:00.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.628+0000 7fc8c1e00640 1 --2- 172.21.15.2:0/3894011056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8c40adba0 0x7fc8c414a760 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc8b402a7b0 tx=0x7fc8b4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.629+0000 7fc8b9600640 1 -- 172.21.15.2:0/3894011056 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4031b30 con 0x7fc8c40adba0 2024-08-17T02:27:00.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.629+0000 7fc8b9600640 1 -- 172.21.15.2:0/3894011056 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b4031c90 con 0x7fc8c40adba0 2024-08-17T02:27:00.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.629+0000 7fc8b9600640 1 -- 172.21.15.2:0/3894011056 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b403e6a0 con 0x7fc8c40adba0 2024-08-17T02:27:00.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.629+0000 7fc8c8c00640 1 -- 172.21.15.2:0/3894011056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c40aa100 con 0x7fc8c40adba0 2024-08-17T02:27:00.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.629+0000 7fc8c8c00640 1 -- 172.21.15.2:0/3894011056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c40aa6c0 con 0x7fc8c40adba0 2024-08-17T02:27:00.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.630+0000 7fc8c8c00640 1 -- 172.21.15.2:0/3894011056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc8c4063fb0 con 0x7fc8c40adba0 2024-08-17T02:27:00.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.631+0000 7fc8b9600640 1 -- 172.21.15.2:0/3894011056 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc8b403c400 con 0x7fc8c40adba0 2024-08-17T02:27:00.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.631+0000 7fc8b9600640 1 --2- 172.21.15.2:0/3894011056 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc8a4065150 0x7fc8a4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.631+0000 7fc8b9600640 1 -- 172.21.15.2:0/3894011056 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fc8b40a2850 con 0x7fc8c40adba0 2024-08-17T02:27:00.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.632+0000 7fc8b9600640 1 --2- 172.21.15.2:0/3894011056 >> [v2:172.21.15.2:6815/37013,v1:172.21.15.2:6817/37013] conn(0x7fc8a406b040 0x7fc8a406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.632+0000 7fc8b9600640 1 -- 172.21.15.2:0/3894011056 --> [v2:172.21.15.2:6815/37013,v1:172.21.15.2:6817/37013] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc8a406db00 con 0x7fc8a406b040 2024-08-17T02:27:00.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.632+0000 7fc8b9600640 1 -- 172.21.15.2:0/3894011056 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8b40a4d50 con 0x7fc8c40adba0 2024-08-17T02:27:00.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.632+0000 7fc8c2800640 1 --2- 172.21.15.2:0/3894011056 >> [v2:172.21.15.2:6815/37013,v1:172.21.15.2:6817/37013] conn(0x7fc8a406b040 0x7fc8a406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.632+0000 7fc8c1400640 1 --2- 172.21.15.2:0/3894011056 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc8a4065150 0x7fc8a4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.632+0000 7fc8c2800640 1 --2- 172.21.15.2:0/3894011056 >> [v2:172.21.15.2:6815/37013,v1:172.21.15.2:6817/37013] conn(0x7fc8a406b040 0x7fc8a406d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.633+0000 7fc8c1400640 1 --2- 172.21.15.2:0/3894011056 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc8a4065150 0x7fc8a4067600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc8c416c6b0 tx=0x7fc8b0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.633+0000 7fc8b9600640 1 -- 172.21.15.2:0/3894011056 <== osd.2 v2:172.21.15.2:6815/37013 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fc8a406db00 con 0x7fc8a406b040 2024-08-17T02:27:00.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.646+0000 7fc8c8c00640 1 -- 172.21.15.2:0/3894011056 --> [v2:172.21.15.2:6815/37013,v1:172.21.15.2:6817/37013] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc8c41573c0 con 0x7fc8a406b040 2024-08-17T02:27:00.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.646+0000 7fc8b9600640 1 -- 172.21.15.2:0/3894011056 <== osd.2 v2:172.21.15.2:6815/37013 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc8c41573c0 con 0x7fc8a406b040 2024-08-17T02:27:00.648 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-17T02:27:00.648 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:27:00.648 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-17T02:27:00.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.647+0000 7fc8c8c00640 1 -- 172.21.15.2:0/3894011056 >> [v2:172.21.15.2:6815/37013,v1:172.21.15.2:6817/37013] conn(0x7fc8a406b040 msgr2=0x7fc8a406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.647+0000 7fc8c8c00640 1 --2- 172.21.15.2:0/3894011056 >> [v2:172.21.15.2:6815/37013,v1:172.21.15.2:6817/37013] conn(0x7fc8a406b040 0x7fc8a406d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.647+0000 7fc8c8c00640 1 -- 172.21.15.2:0/3894011056 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc8a4065150 msgr2=0x7fc8a4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.647+0000 7fc8c8c00640 1 --2- 172.21.15.2:0/3894011056 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fc8a4065150 0x7fc8a4067600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc8c416c6b0 tx=0x7fc8b0008040 comp rx=0 tx=0).stop 2024-08-17T02:27:00.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.647+0000 7fc8c8c00640 1 -- 172.21.15.2:0/3894011056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8c40adba0 msgr2=0x7fc8c414a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.647+0000 7fc8c8c00640 1 --2- 172.21.15.2:0/3894011056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8c40adba0 0x7fc8c414a760 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc8b402a7b0 tx=0x7fc8b4032000 comp rx=0 tx=0).stop 2024-08-17T02:27:00.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.647+0000 7fc8c2800640 1 -- 172.21.15.2:0/3894011056 reap_dead start 2024-08-17T02:27:00.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.647+0000 7fc8c8c00640 1 -- 172.21.15.2:0/3894011056 shutdown_connections 2024-08-17T02:27:00.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.647+0000 7fc8c8c00640 1 -- 172.21.15.2:0/3894011056 >> 172.21.15.2:0/3894011056 conn(0x7fc8c4066e60 msgr2=0x7fc8c4159e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.647+0000 7fc8c8c00640 1 -- 172.21.15.2:0/3894011056 shutdown_connections 2024-08-17T02:27:00.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.647+0000 7fc8c8c00640 1 -- 172.21.15.2:0/3894011056 wait complete. 2024-08-17T02:27:00.662 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-17T02:27:00.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.815+0000 7ff591800640 1 Processor -- start 2024-08-17T02:27:00.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.816+0000 7ff591800640 1 -- start start 2024-08-17T02:27:00.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.817+0000 7ff591800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff58c1590b0 0x7ff58c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.817+0000 7ff591800640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff58c0acf10 0x7ff58c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.817+0000 7ff591800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff58c15a4e0 con 0x7ff58c0afca0 2024-08-17T02:27:00.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.817+0000 7ff591800640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff58c0b0980 con 0x7ff58c0acf10 2024-08-17T02:27:00.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.817+0000 7ff591800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c0c92b0 con 0x7ff58c1590b0 2024-08-17T02:27:00.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.817+0000 7ff58aa00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff58c0afca0 0x7ff58c1589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48646/0 (socket says 172.21.15.2:48646) 2024-08-17T02:27:00.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.817+0000 7ff58aa00640 1 -- 172.21.15.2:0/1431941062 learned_addr learned my addr 172.21.15.2:0/1431941062 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:27:00.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.817+0000 7ff58b400640 1 --2- 172.21.15.2:0/1431941062 >> v2:172.21.15.145:3300/0 conn(0x7ff58c0acf10 0x7ff58c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.817+0000 7ff583e00640 1 --2- 172.21.15.2:0/1431941062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff58c1590b0 0x7ff58c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.818+0000 7ff58a000640 1 -- 172.21.15.2:0/1431941062 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4263373139 0 0) 0x7ff57c001110 con 0x7ff58c0afca0 2024-08-17T02:27:00.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.818+0000 7ff58a000640 1 -- 172.21.15.2:0/1431941062 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5700034e0 con 0x7ff58c0afca0 2024-08-17T02:27:00.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.818+0000 7ff58b400640 1 -- 172.21.15.2:0/1431941062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff58c1590b0 msgr2=0x7ff58c0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:00.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.818+0000 7ff58b400640 1 --2- 172.21.15.2:0/1431941062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff58c1590b0 0x7ff58c0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.818+0000 7ff58b400640 1 -- 172.21.15.2:0/1431941062 >> v1:172.21.15.2:6789/0 conn(0x7ff58c0afca0 legacy=0x7ff58c1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.818+0000 7ff58b400640 1 -- 172.21.15.2:0/1431941062 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c0ad480 con 0x7ff58c0acf10 2024-08-17T02:27:00.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.818+0000 7ff583e00640 1 --2- 172.21.15.2:0/1431941062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff58c1590b0 0x7ff58c0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:00.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.819+0000 7ff58b400640 1 --2- 172.21.15.2:0/1431941062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff58c0acf10 0x7ff58c159fa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff584009e60 tx=0x7ff584009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84f28c0c0bc8f362 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.819+0000 7ff58a000640 1 -- 172.21.15.2:0/1431941062 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff584007550 con 0x7ff58c0acf10 2024-08-17T02:27:00.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.819+0000 7ff58a000640 1 -- 172.21.15.2:0/1431941062 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58402d050 con 0x7ff58c0acf10 2024-08-17T02:27:00.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.819+0000 7ff58a000640 1 -- 172.21.15.2:0/1431941062 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff584007920 con 0x7ff58c0acf10 2024-08-17T02:27:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.820+0000 7ff591800640 1 -- 172.21.15.2:0/1431941062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff58c0acf10 msgr2=0x7ff58c159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.820+0000 7ff591800640 1 --2- 172.21.15.2:0/1431941062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff58c0acf10 0x7ff58c159fa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff584009e60 tx=0x7ff584009780 comp rx=0 tx=0).stop 2024-08-17T02:27:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.820+0000 7ff591800640 1 -- 172.21.15.2:0/1431941062 shutdown_connections 2024-08-17T02:27:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.820+0000 7ff591800640 1 --2- 172.21.15.2:0/1431941062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff58c0acf10 0x7ff58c159fa0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.820+0000 7ff591800640 1 --2- 172.21.15.2:0/1431941062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff58c1590b0 0x7ff58c0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.820+0000 7ff591800640 1 -- 172.21.15.2:0/1431941062 >> 172.21.15.2:0/1431941062 conn(0x7ff58c066e60 msgr2=0x7ff58c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.820+0000 7ff591800640 1 -- 172.21.15.2:0/1431941062 shutdown_connections 2024-08-17T02:27:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.820+0000 7ff591800640 1 -- 172.21.15.2:0/1431941062 wait complete. 2024-08-17T02:27:00.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.822+0000 7ff591800640 1 Processor -- start 2024-08-17T02:27:00.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.822+0000 7ff591800640 1 -- start start 2024-08-17T02:27:00.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.823+0000 7ff591800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff58c0acf10 0x7ff58c069830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.823+0000 7ff591800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff58c0afca0 0x7ff58c15b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.823+0000 7ff591800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff58c1590b0 0x7ff58c156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.823+0000 7ff591800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c0c4bf0 con 0x7ff58c0afca0 2024-08-17T02:27:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.823+0000 7ff591800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c06a080 con 0x7ff58c1590b0 2024-08-17T02:27:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.823+0000 7ff591800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c06a360 con 0x7ff58c0acf10 2024-08-17T02:27:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.823+0000 7ff583e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff58c0afca0 0x7ff58c15b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.823+0000 7ff583e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff58c0afca0 0x7ff58c15b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37162/0 (socket says 172.21.15.2:37162) 2024-08-17T02:27:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.823+0000 7ff583e00640 1 -- 172.21.15.2:0/2026972438 learned_addr learned my addr 172.21.15.2:0/2026972438 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.823+0000 7ff58b400640 1 --2- 172.21.15.2:0/2026972438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff58c1590b0 0x7ff58c156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.823+0000 7ff58aa00640 1 --2- 172.21.15.2:0/2026972438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff58c0acf10 0x7ff58c069830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.823+0000 7ff583e00640 1 -- 172.21.15.2:0/2026972438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff58c0acf10 msgr2=0x7ff58c069830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.823+0000 7ff583e00640 1 --2- 172.21.15.2:0/2026972438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff58c0acf10 0x7ff58c069830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.823+0000 7ff583e00640 1 -- 172.21.15.2:0/2026972438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff58c1590b0 msgr2=0x7ff58c156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.823+0000 7ff583e00640 1 --2- 172.21.15.2:0/2026972438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff58c1590b0 0x7ff58c156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.823+0000 7ff583e00640 1 -- 172.21.15.2:0/2026972438 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff574009390 con 0x7ff58c0afca0 2024-08-17T02:27:00.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.824+0000 7ff583e00640 1 --2- 172.21.15.2:0/2026972438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff58c0afca0 0x7ff58c15b600 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff57400ea70 tx=0x7ff5740090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.824+0000 7ff582000640 1 -- 172.21.15.2:0/2026972438 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57400ca10 con 0x7ff58c0afca0 2024-08-17T02:27:00.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.824+0000 7ff582000640 1 -- 172.21.15.2:0/2026972438 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57400cb70 con 0x7ff58c0afca0 2024-08-17T02:27:00.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.824+0000 7ff582000640 1 -- 172.21.15.2:0/2026972438 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff574013470 con 0x7ff58c0afca0 2024-08-17T02:27:00.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.824+0000 7ff591800640 1 -- 172.21.15.2:0/2026972438 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff584009a20 con 0x7ff58c0afca0 2024-08-17T02:27:00.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.824+0000 7ff591800640 1 -- 172.21.15.2:0/2026972438 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58c0c4e40 con 0x7ff58c0afca0 2024-08-17T02:27:00.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.825+0000 7ff591800640 1 -- 172.21.15.2:0/2026972438 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff58c069dd0 con 0x7ff58c0afca0 2024-08-17T02:27:00.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.826+0000 7ff582000640 1 -- 172.21.15.2:0/2026972438 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff574013820 con 0x7ff58c0afca0 2024-08-17T02:27:00.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.827+0000 7ff582000640 1 --2- 172.21.15.2:0/2026972438 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7ff568065150 0x7ff568067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.827+0000 7ff582000640 1 -- 172.21.15.2:0/2026972438 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ff5740825c0 con 0x7ff58c0afca0 2024-08-17T02:27:00.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.827+0000 7ff58aa00640 1 --2- 172.21.15.2:0/2026972438 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7ff568065150 0x7ff568067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.828+0000 7ff58aa00640 1 --2- 172.21.15.2:0/2026972438 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7ff568065150 0x7ff568067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff57c001270 tx=0x7ff57c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:00.831+0000 7ff582000640 1 -- 172.21.15.2:0/2026972438 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff574050880 con 0x7ff58c0afca0 2024-08-17T02:27:01.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.018+0000 7ff591800640 1 -- 172.21.15.2:0/2026972438 --> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff58c063fb0 con 0x7ff568065150 2024-08-17T02:27:01.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.019+0000 7ff582000640 1 -- 172.21.15.2:0/2026972438 <== mgr.4108 v2:172.21.15.145:6832/36841 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff58c063fb0 con 0x7ff568065150 2024-08-17T02:27:01.020 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 2 to deep-scrub 2024-08-17T02:27:01.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.021+0000 7ff591800640 1 -- 172.21.15.2:0/2026972438 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7ff568065150 msgr2=0x7ff568067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.021+0000 7ff591800640 1 --2- 172.21.15.2:0/2026972438 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7ff568065150 0x7ff568067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff57c001270 tx=0x7ff57c009040 comp rx=0 tx=0).stop 2024-08-17T02:27:01.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.021+0000 7ff591800640 1 -- 172.21.15.2:0/2026972438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff58c0afca0 msgr2=0x7ff58c15b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.021+0000 7ff591800640 1 --2- 172.21.15.2:0/2026972438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff58c0afca0 0x7ff58c15b600 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff57400ea70 tx=0x7ff5740090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.022+0000 7ff591800640 1 -- 172.21.15.2:0/2026972438 shutdown_connections 2024-08-17T02:27:01.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.022+0000 7ff591800640 1 --2- 172.21.15.2:0/2026972438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff58c1590b0 0x7ff58c156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.022+0000 7ff591800640 1 --2- 172.21.15.2:0/2026972438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff58c0afca0 0x7ff58c15b600 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.022+0000 7ff591800640 1 --2- 172.21.15.2:0/2026972438 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7ff568065150 0x7ff568067600 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.022+0000 7ff591800640 1 --2- 172.21.15.2:0/2026972438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff58c0acf10 0x7ff58c069830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.022+0000 7ff591800640 1 -- 172.21.15.2:0/2026972438 >> 172.21.15.2:0/2026972438 conn(0x7ff58c066e60 msgr2=0x7ff58c0ae960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.022+0000 7ff591800640 1 -- 172.21.15.2:0/2026972438 shutdown_connections 2024-08-17T02:27:01.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.022+0000 7ff591800640 1 -- 172.21.15.2:0/2026972438 wait complete. 2024-08-17T02:27:01.037 INFO:tasks.ceph:Scrubbing osd.3 2024-08-17T02:27:01.038 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:27:01.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.191+0000 7fbf66e00640 1 Processor -- start 2024-08-17T02:27:01.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.192+0000 7fbf66e00640 1 -- start start 2024-08-17T02:27:01.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.193+0000 7fbf66e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf600b4f60 0x7fbf600ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.193+0000 7fbf66e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf600b3ac0 con 0x7fbf601589f0 2024-08-17T02:27:01.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.193+0000 7fbf66e00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf600b3190 con 0x7fbf60158dc0 2024-08-17T02:27:01.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.193+0000 7fbf66e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf600b3470 con 0x7fbf600b4f60 2024-08-17T02:27:01.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.193+0000 7fbf65a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbf601589f0 0x7fbf600ce7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48656/0 (socket says 172.21.15.2:48656) 2024-08-17T02:27:01.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.193+0000 7fbf65a00640 1 -- 172.21.15.2:0/3116486629 learned_addr learned my addr 172.21.15.2:0/3116486629 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:27:01.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.193+0000 7fbf66400640 1 --2- 172.21.15.2:0/3116486629 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf600b4f60 0x7fbf600ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.194+0000 7fbf5fe00640 1 -- 172.21.15.2:0/3116486629 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1368981460 0 0) 0x7fbf600b3ac0 con 0x7fbf601589f0 2024-08-17T02:27:01.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.194+0000 7fbf5fe00640 1 -- 172.21.15.2:0/3116486629 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf480034e0 con 0x7fbf601589f0 2024-08-17T02:27:01.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.194+0000 7fbf5fe00640 1 -- 172.21.15.2:0/3116486629 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652840445 0 0) 0x7fbf600b3190 con 0x7fbf60158dc0 2024-08-17T02:27:01.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.194+0000 7fbf5fe00640 1 -- 172.21.15.2:0/3116486629 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf600b3ac0 con 0x7fbf60158dc0 2024-08-17T02:27:01.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.194+0000 7fbf66400640 1 -- 172.21.15.2:0/3116486629 >> v1:172.21.15.145:6789/0 conn(0x7fbf60158dc0 legacy=0x7fbf600cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.194+0000 7fbf66400640 1 -- 172.21.15.2:0/3116486629 >> v1:172.21.15.2:6789/0 conn(0x7fbf601589f0 legacy=0x7fbf600ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.194+0000 7fbf5fe00640 1 -- 172.21.15.2:0/3116486629 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4184352440 0 0) 0x7fbf480034e0 con 0x7fbf601589f0 2024-08-17T02:27:01.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.194+0000 7fbf66400640 1 -- 172.21.15.2:0/3116486629 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf600b3750 con 0x7fbf600b4f60 2024-08-17T02:27:01.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.195+0000 7fbf66400640 1 --2- 172.21.15.2:0/3116486629 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf600b4f60 0x7fbf600ceef0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009e90 tx=0x7fbf58009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50f661757b18e7d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.195+0000 7fbf5fe00640 1 -- 172.21.15.2:0/3116486629 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf54001470 con 0x7fbf600b4f60 2024-08-17T02:27:01.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.195+0000 7fbf5fe00640 1 -- 172.21.15.2:0/3116486629 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5802d050 con 0x7fbf600b4f60 2024-08-17T02:27:01.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.195+0000 7fbf5fe00640 1 -- 172.21.15.2:0/3116486629 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf58031630 con 0x7fbf600b4f60 2024-08-17T02:27:01.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.196+0000 7fbf66e00640 1 -- 172.21.15.2:0/3116486629 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf600b4f60 msgr2=0x7fbf600ceef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.196+0000 7fbf66e00640 1 --2- 172.21.15.2:0/3116486629 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf600b4f60 0x7fbf600ceef0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009e90 tx=0x7fbf58009780 comp rx=0 tx=0).stop 2024-08-17T02:27:01.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.196+0000 7fbf66e00640 1 -- 172.21.15.2:0/3116486629 shutdown_connections 2024-08-17T02:27:01.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.196+0000 7fbf66e00640 1 --2- 172.21.15.2:0/3116486629 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf600b4f60 0x7fbf600ceef0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.196+0000 7fbf66e00640 1 -- 172.21.15.2:0/3116486629 >> 172.21.15.2:0/3116486629 conn(0x7fbf60087a80 msgr2=0x7fbf6006e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.196+0000 7fbf66e00640 1 -- 172.21.15.2:0/3116486629 shutdown_connections 2024-08-17T02:27:01.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.196+0000 7fbf66e00640 1 -- 172.21.15.2:0/3116486629 wait complete. 2024-08-17T02:27:01.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.197+0000 7fbf66e00640 1 Processor -- start 2024-08-17T02:27:01.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.198+0000 7fbf66e00640 1 -- start start 2024-08-17T02:27:01.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.198+0000 7fbf66e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf600b4f60 0x7fbf600c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.198+0000 7fbf66e00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf601589f0 0x7fbf600aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.198+0000 7fbf66e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf60158dc0 0x7fbf60168890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.198+0000 7fbf66e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf600b0490 con 0x7fbf60158dc0 2024-08-17T02:27:01.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.198+0000 7fbf66e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf60168dd0 con 0x7fbf600b4f60 2024-08-17T02:27:01.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.198+0000 7fbf66e00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf600b06c0 con 0x7fbf601589f0 2024-08-17T02:27:01.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.199+0000 7fbf66400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf60158dc0 0x7fbf60168890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.199+0000 7fbf66400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf60158dc0 0x7fbf60168890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37174/0 (socket says 172.21.15.2:37174) 2024-08-17T02:27:01.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.199+0000 7fbf66400640 1 -- 172.21.15.2:0/2909398216 learned_addr learned my addr 172.21.15.2:0/2909398216 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:01.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.199+0000 7fbf65a00640 1 --2- 172.21.15.2:0/2909398216 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf600b4f60 0x7fbf600c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.199+0000 7fbf65000640 1 --2- 172.21.15.2:0/2909398216 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf601589f0 0x7fbf600aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.199+0000 7fbf66400640 1 -- 172.21.15.2:0/2909398216 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf601589f0 msgr2=0x7fbf600aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.199+0000 7fbf66400640 1 --2- 172.21.15.2:0/2909398216 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf601589f0 0x7fbf600aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.199+0000 7fbf66400640 1 -- 172.21.15.2:0/2909398216 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf600b4f60 msgr2=0x7fbf600c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.199+0000 7fbf66400640 1 --2- 172.21.15.2:0/2909398216 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf600b4f60 0x7fbf600c5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.199+0000 7fbf66400640 1 -- 172.21.15.2:0/2909398216 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf58009a20 con 0x7fbf60158dc0 2024-08-17T02:27:01.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.199+0000 7fbf65000640 1 --2- 172.21.15.2:0/2909398216 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf601589f0 0x7fbf600aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:01.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.200+0000 7fbf66400640 1 --2- 172.21.15.2:0/2909398216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf60158dc0 0x7fbf60168890 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009e90 tx=0x7fbf58037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.200+0000 7fbf5cc00640 1 -- 172.21.15.2:0/2909398216 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5803ba70 con 0x7fbf60158dc0 2024-08-17T02:27:01.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.200+0000 7fbf5cc00640 1 -- 172.21.15.2:0/2909398216 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf58040070 con 0x7fbf60158dc0 2024-08-17T02:27:01.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.200+0000 7fbf5cc00640 1 -- 172.21.15.2:0/2909398216 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5803be40 con 0x7fbf60158dc0 2024-08-17T02:27:01.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.200+0000 7fbf66e00640 1 -- 172.21.15.2:0/2909398216 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf600b09a0 con 0x7fbf60158dc0 2024-08-17T02:27:01.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.200+0000 7fbf66e00640 1 -- 172.21.15.2:0/2909398216 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf600b0f60 con 0x7fbf60158dc0 2024-08-17T02:27:01.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.201+0000 7fbf66e00640 1 -- 172.21.15.2:0/2909398216 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbf60063f10 con 0x7fbf60158dc0 2024-08-17T02:27:01.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.202+0000 7fbf5cc00640 1 -- 172.21.15.2:0/2909398216 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbf58003020 con 0x7fbf60158dc0 2024-08-17T02:27:01.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.203+0000 7fbf5cc00640 1 --2- 172.21.15.2:0/2909398216 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbf40065180 0x7fbf40067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.203+0000 7fbf5cc00640 1 -- 172.21.15.2:0/2909398216 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fbf58042070 con 0x7fbf60158dc0 2024-08-17T02:27:01.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.203+0000 7fbf5cc00640 1 --2- 172.21.15.2:0/2909398216 >> [v2:172.21.15.2:6824/37033,v1:172.21.15.2:6825/37033] conn(0x7fbf4006b070 0x7fbf4006d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.203+0000 7fbf5cc00640 1 -- 172.21.15.2:0/2909398216 --> [v2:172.21.15.2:6824/37033,v1:172.21.15.2:6825/37033] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbf4006db30 con 0x7fbf4006b070 2024-08-17T02:27:01.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.203+0000 7fbf5cc00640 1 -- 172.21.15.2:0/2909398216 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf580a5a60 con 0x7fbf60158dc0 2024-08-17T02:27:01.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.203+0000 7fbf65000640 1 --2- 172.21.15.2:0/2909398216 >> [v2:172.21.15.2:6824/37033,v1:172.21.15.2:6825/37033] conn(0x7fbf4006b070 0x7fbf4006d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.203+0000 7fbf65a00640 1 --2- 172.21.15.2:0/2909398216 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbf40065180 0x7fbf40067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.204+0000 7fbf65000640 1 --2- 172.21.15.2:0/2909398216 >> [v2:172.21.15.2:6824/37033,v1:172.21.15.2:6825/37033] conn(0x7fbf4006b070 0x7fbf4006d480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.204+0000 7fbf65a00640 1 --2- 172.21.15.2:0/2909398216 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbf40065180 0x7fbf40067630 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbf54001340 tx=0x7fbf54000bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.205+0000 7fbf5cc00640 1 -- 172.21.15.2:0/2909398216 <== osd.3 v2:172.21.15.2:6824/37033 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fbf4006db30 con 0x7fbf4006b070 2024-08-17T02:27:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.218+0000 7fbf66e00640 1 -- 172.21.15.2:0/2909398216 --> [v2:172.21.15.2:6824/37033,v1:172.21.15.2:6825/37033] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbf60088a10 con 0x7fbf4006b070 2024-08-17T02:27:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.218+0000 7fbf5cc00640 1 -- 172.21.15.2:0/2909398216 <== osd.3 v2:172.21.15.2:6824/37033 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbf60088a10 con 0x7fbf4006b070 2024-08-17T02:27:01.220 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-17T02:27:01.220 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:27:01.220 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-17T02:27:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.218+0000 7fbf66e00640 1 -- 172.21.15.2:0/2909398216 >> [v2:172.21.15.2:6824/37033,v1:172.21.15.2:6825/37033] conn(0x7fbf4006b070 msgr2=0x7fbf4006d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.218+0000 7fbf66e00640 1 --2- 172.21.15.2:0/2909398216 >> [v2:172.21.15.2:6824/37033,v1:172.21.15.2:6825/37033] conn(0x7fbf4006b070 0x7fbf4006d480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.218+0000 7fbf66e00640 1 -- 172.21.15.2:0/2909398216 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbf40065180 msgr2=0x7fbf40067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.218+0000 7fbf66e00640 1 --2- 172.21.15.2:0/2909398216 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fbf40065180 0x7fbf40067630 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbf54001340 tx=0x7fbf54000bc0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.218+0000 7fbf66e00640 1 -- 172.21.15.2:0/2909398216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf60158dc0 msgr2=0x7fbf60168890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.218+0000 7fbf66e00640 1 --2- 172.21.15.2:0/2909398216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf60158dc0 0x7fbf60168890 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009e90 tx=0x7fbf58037000 comp rx=0 tx=0).stop 2024-08-17T02:27:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.218+0000 7fbf66400640 1 -- 172.21.15.2:0/2909398216 reap_dead start 2024-08-17T02:27:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.219+0000 7fbf66e00640 1 -- 172.21.15.2:0/2909398216 shutdown_connections 2024-08-17T02:27:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.219+0000 7fbf66e00640 1 -- 172.21.15.2:0/2909398216 >> 172.21.15.2:0/2909398216 conn(0x7fbf60087a80 msgr2=0x7fbf60153df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.219+0000 7fbf66e00640 1 -- 172.21.15.2:0/2909398216 shutdown_connections 2024-08-17T02:27:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.219+0000 7fbf66e00640 1 -- 172.21.15.2:0/2909398216 wait complete. 2024-08-17T02:27:01.233 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-17T02:27:01.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.385+0000 7f2057200640 1 Processor -- start 2024-08-17T02:27:01.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.385+0000 7f2057200640 1 -- start start 2024-08-17T02:27:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.386+0000 7f2057200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2058158dd0 0x7f205806e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.386+0000 7f2057200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f205806ead0 0x7f20580b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.386+0000 7f2057200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f205806eef0 con 0x7f2058158a00 2024-08-17T02:27:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.386+0000 7f2057200640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2058159230 con 0x7f2058158dd0 2024-08-17T02:27:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.386+0000 7f2057200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20580cbc50 con 0x7f205806ead0 2024-08-17T02:27:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.386+0000 7f2055e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2058158a00 0x7f20580cb190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48672/0 (socket says 172.21.15.2:48672) 2024-08-17T02:27:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.386+0000 7f2055e00640 1 -- 172.21.15.2:0/3383769617 learned_addr learned my addr 172.21.15.2:0/3383769617 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:27:01.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.386+0000 7f2055400640 1 --2- 172.21.15.2:0/3383769617 >> v2:172.21.15.145:3300/0 conn(0x7f2058158dd0 0x7f205806e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.386+0000 7f2056800640 1 --2- 172.21.15.2:0/3383769617 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f205806ead0 0x7f20580b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.387+0000 7f2054a00640 1 -- 172.21.15.2:0/3383769617 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 227659368 0 0) 0x7f205806eef0 con 0x7f2058158a00 2024-08-17T02:27:01.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.387+0000 7f2054a00640 1 -- 172.21.15.2:0/3383769617 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f203c0034e0 con 0x7f2058158a00 2024-08-17T02:27:01.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.387+0000 7f2055400640 1 -- 172.21.15.2:0/3383769617 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f205806ead0 msgr2=0x7f20580b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:01.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.387+0000 7f2055400640 1 --2- 172.21.15.2:0/3383769617 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f205806ead0 0x7f20580b3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.387+0000 7f2055400640 1 -- 172.21.15.2:0/3383769617 >> v1:172.21.15.2:6789/0 conn(0x7f2058158a00 legacy=0x7f20580cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.387+0000 7f2055400640 1 -- 172.21.15.2:0/3383769617 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20580cbf30 con 0x7f2058158dd0 2024-08-17T02:27:01.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.388+0000 7f2055400640 1 --2- 172.21.15.2:0/3383769617 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2058158dd0 0x7f205806e590 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2044009850 tx=0x7f20440090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a112d1c530e02b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.388+0000 7f2054a00640 1 -- 172.21.15.2:0/3383769617 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204402ad90 con 0x7f2058158dd0 2024-08-17T02:27:01.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.388+0000 7f2054a00640 1 -- 172.21.15.2:0/3383769617 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2044032440 con 0x7f2058158dd0 2024-08-17T02:27:01.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.388+0000 7f2054a00640 1 -- 172.21.15.2:0/3383769617 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2044032800 con 0x7f2058158dd0 2024-08-17T02:27:01.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.389+0000 7f2057200640 1 -- 172.21.15.2:0/3383769617 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2058158dd0 msgr2=0x7f205806e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.389+0000 7f2057200640 1 --2- 172.21.15.2:0/3383769617 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2058158dd0 0x7f205806e590 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2044009850 tx=0x7f20440090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.389+0000 7f2057200640 1 -- 172.21.15.2:0/3383769617 shutdown_connections 2024-08-17T02:27:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.389+0000 7f2057200640 1 --2- 172.21.15.2:0/3383769617 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f205806ead0 0x7f20580b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.389+0000 7f2057200640 1 --2- 172.21.15.2:0/3383769617 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2058158dd0 0x7f205806e590 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.389+0000 7f2057200640 1 -- 172.21.15.2:0/3383769617 >> 172.21.15.2:0/3383769617 conn(0x7f20580cfb80 msgr2=0x7f20580cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.389+0000 7f2057200640 1 -- 172.21.15.2:0/3383769617 shutdown_connections 2024-08-17T02:27:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.389+0000 7f2057200640 1 -- 172.21.15.2:0/3383769617 wait complete. 2024-08-17T02:27:01.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.390+0000 7f2057200640 1 Processor -- start 2024-08-17T02:27:01.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.391+0000 7f2057200640 1 -- start start 2024-08-17T02:27:01.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.391+0000 7f2057200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f205806ead0 0x7f20580c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.392+0000 7f2057200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2058158a00 0x7f2058168e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.392+0000 7f2057200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2058158dd0 0x7f20580a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.392+0000 7f2057200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20580c7f60 con 0x7f205806ead0 2024-08-17T02:27:01.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.392+0000 7f2057200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20580c70d0 con 0x7f2058158dd0 2024-08-17T02:27:01.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.392+0000 7f2057200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20580c7350 con 0x7f2058158a00 2024-08-17T02:27:01.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.392+0000 7f2055e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f205806ead0 0x7f20580c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.392+0000 7f2055e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f205806ead0 0x7f20580c6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37178/0 (socket says 172.21.15.2:37178) 2024-08-17T02:27:01.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.392+0000 7f2055e00640 1 -- 172.21.15.2:0/1485458446 learned_addr learned my addr 172.21.15.2:0/1485458446 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:01.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.392+0000 7f2055400640 1 --2- 172.21.15.2:0/1485458446 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2058158a00 0x7f2058168e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.392+0000 7f2056800640 1 --2- 172.21.15.2:0/1485458446 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2058158dd0 0x7f20580a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.392+0000 7f2055e00640 1 -- 172.21.15.2:0/1485458446 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2058158a00 msgr2=0x7f2058168e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.392+0000 7f2055e00640 1 --2- 172.21.15.2:0/1485458446 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2058158a00 0x7f2058168e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.392+0000 7f2055e00640 1 -- 172.21.15.2:0/1485458446 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2058158dd0 msgr2=0x7f20580a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.392+0000 7f2055e00640 1 --2- 172.21.15.2:0/1485458446 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2058158dd0 0x7f20580a6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.392+0000 7f2055e00640 1 -- 172.21.15.2:0/1485458446 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2044009390 con 0x7f205806ead0 2024-08-17T02:27:01.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.392+0000 7f2055e00640 1 --2- 172.21.15.2:0/1485458446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f205806ead0 0x7f20580c6b90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f204800c560 tx=0x7f2048007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.393+0000 7f204d600640 1 -- 172.21.15.2:0/1485458446 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2048005aa0 con 0x7f205806ead0 2024-08-17T02:27:01.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.393+0000 7f204d600640 1 -- 172.21.15.2:0/1485458446 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2048005c00 con 0x7f205806ead0 2024-08-17T02:27:01.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.393+0000 7f204d600640 1 -- 172.21.15.2:0/1485458446 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20480070d0 con 0x7f205806ead0 2024-08-17T02:27:01.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.393+0000 7f2057200640 1 -- 172.21.15.2:0/1485458446 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20580c7630 con 0x7f205806ead0 2024-08-17T02:27:01.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.393+0000 7f2057200640 1 -- 172.21.15.2:0/1485458446 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20580c7bf0 con 0x7f205806ead0 2024-08-17T02:27:01.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.394+0000 7f2057200640 1 -- 172.21.15.2:0/1485458446 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2058070720 con 0x7f205806ead0 2024-08-17T02:27:01.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.395+0000 7f204d600640 1 -- 172.21.15.2:0/1485458446 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f20480074c0 con 0x7f205806ead0 2024-08-17T02:27:01.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.395+0000 7f204d600640 1 --2- 172.21.15.2:0/1485458446 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2038065150 0x7f2038067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.396+0000 7f204d600640 1 -- 172.21.15.2:0/1485458446 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f2048081740 con 0x7f205806ead0 2024-08-17T02:27:01.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.396+0000 7f2055400640 1 --2- 172.21.15.2:0/1485458446 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2038065150 0x7f2038067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.397+0000 7f2055400640 1 --2- 172.21.15.2:0/1485458446 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2038065150 0x7f2038067600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2044034000 tx=0x7f2044032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.399+0000 7f204d600640 1 -- 172.21.15.2:0/1485458446 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f204804fa00 con 0x7f205806ead0 2024-08-17T02:27:01.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.582+0000 7f2057200640 1 -- 172.21.15.2:0/1485458446 --> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f20580c80a0 con 0x7f2038065150 2024-08-17T02:27:01.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.582+0000 7f204d600640 1 -- 172.21.15.2:0/1485458446 <== mgr.4108 v2:172.21.15.145:6832/36841 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f20440326c0 con 0x7f2038065150 2024-08-17T02:27:01.583 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 3 to deep-scrub 2024-08-17T02:27:01.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.584+0000 7f2057200640 1 -- 172.21.15.2:0/1485458446 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2038065150 msgr2=0x7f2038067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.584+0000 7f2057200640 1 --2- 172.21.15.2:0/1485458446 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2038065150 0x7f2038067600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2044034000 tx=0x7f2044032000 comp rx=0 tx=0).stop 2024-08-17T02:27:01.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.584+0000 7f2057200640 1 -- 172.21.15.2:0/1485458446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f205806ead0 msgr2=0x7f20580c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.584+0000 7f2057200640 1 --2- 172.21.15.2:0/1485458446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f205806ead0 0x7f20580c6b90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f204800c560 tx=0x7f2048007d60 comp rx=0 tx=0).stop 2024-08-17T02:27:01.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.584+0000 7f2057200640 1 -- 172.21.15.2:0/1485458446 shutdown_connections 2024-08-17T02:27:01.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.584+0000 7f2057200640 1 --2- 172.21.15.2:0/1485458446 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2058158dd0 0x7f20580a6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.584+0000 7f2057200640 1 --2- 172.21.15.2:0/1485458446 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2038065150 0x7f2038067600 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.584+0000 7f2057200640 1 --2- 172.21.15.2:0/1485458446 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2058158a00 0x7f2058168e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.584+0000 7f2057200640 1 --2- 172.21.15.2:0/1485458446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f205806ead0 0x7f20580c6b90 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.584+0000 7f2057200640 1 -- 172.21.15.2:0/1485458446 >> 172.21.15.2:0/1485458446 conn(0x7f20580cfb80 msgr2=0x7f20580cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.584+0000 7f2057200640 1 -- 172.21.15.2:0/1485458446 shutdown_connections 2024-08-17T02:27:01.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.585+0000 7f2057200640 1 -- 172.21.15.2:0/1485458446 wait complete. 2024-08-17T02:27:01.601 INFO:tasks.ceph:Scrubbing osd.4 2024-08-17T02:27:01.601 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:27:01.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.756+0000 7f60ff200640 1 Processor -- start 2024-08-17T02:27:01.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.756+0000 7f60ff200640 1 -- start start 2024-08-17T02:27:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.757+0000 7f60ff200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f60f80ac000 0x7f60f8156a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.757+0000 7f60ff200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f60f80afa00 0x7f60f80afe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.757+0000 7f60ff200640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f8159ad0 con 0x7f60f80ad020 2024-08-17T02:27:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.757+0000 7f60ff200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f8156f40 con 0x7f60f80ac000 2024-08-17T02:27:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.757+0000 7f60ff200640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f80b0340 con 0x7f60f80afa00 2024-08-17T02:27:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.757+0000 7f60f7e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f60f80ac000 0x7f60f8156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.757+0000 7f60f7e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f60f80ac000 0x7f60f8156a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37190/0 (socket says 172.21.15.2:37190) 2024-08-17T02:27:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.757+0000 7f60f7e00640 1 -- 172.21.15.2:0/132446934 learned_addr learned my addr 172.21.15.2:0/132446934 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.757+0000 7f60fd200640 1 --2- 172.21.15.2:0/132446934 >> v2:172.21.15.145:3300/0 conn(0x7f60f80afa00 0x7f60f80afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.758+0000 7f60f7e00640 1 -- 172.21.15.2:0/132446934 >> v2:172.21.15.145:3300/0 conn(0x7f60f80afa00 msgr2=0x7f60f80afe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.758+0000 7f60f7e00640 1 --2- 172.21.15.2:0/132446934 >> v2:172.21.15.145:3300/0 conn(0x7f60f80afa00 0x7f60f80afe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.758+0000 7f60f7e00640 1 -- 172.21.15.2:0/132446934 >> v1:172.21.15.145:6789/0 conn(0x7f60f80ad020 legacy=0x7f60f8159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.758+0000 7f60f7e00640 1 -- 172.21.15.2:0/132446934 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f80ad590 con 0x7f60f80ac000 2024-08-17T02:27:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.759+0000 7f60f7e00640 1 --2- 172.21.15.2:0/132446934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60f80ac000 0x7f60f8156a00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f60f80b09a0 tx=0x7f60e80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90edba5f0b18dcaa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.759+0000 7f60f7400640 1 -- 172.21.15.2:0/132446934 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e802adf0 con 0x7f60f80ac000 2024-08-17T02:27:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.759+0000 7f60f7400640 1 -- 172.21.15.2:0/132446934 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e8032440 con 0x7f60f80ac000 2024-08-17T02:27:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.759+0000 7f60f7400640 1 -- 172.21.15.2:0/132446934 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e8032820 con 0x7f60f80ac000 2024-08-17T02:27:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.760+0000 7f60ff200640 1 -- 172.21.15.2:0/132446934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60f80ac000 msgr2=0x7f60f8156a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.760+0000 7f60ff200640 1 --2- 172.21.15.2:0/132446934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60f80ac000 0x7f60f8156a00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f60f80b09a0 tx=0x7f60e80091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.760+0000 7f60ff200640 1 -- 172.21.15.2:0/132446934 shutdown_connections 2024-08-17T02:27:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.760+0000 7f60ff200640 1 --2- 172.21.15.2:0/132446934 >> v2:172.21.15.145:3300/0 conn(0x7f60f80afa00 0x7f60f80afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.760+0000 7f60ff200640 1 --2- 172.21.15.2:0/132446934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60f80ac000 0x7f60f8156a00 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.760+0000 7f60ff200640 1 -- 172.21.15.2:0/132446934 >> 172.21.15.2:0/132446934 conn(0x7f60f8066e60 msgr2=0x7f60f8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.760+0000 7f60ff200640 1 -- 172.21.15.2:0/132446934 shutdown_connections 2024-08-17T02:27:01.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.760+0000 7f60ff200640 1 -- 172.21.15.2:0/132446934 wait complete. 2024-08-17T02:27:01.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.761+0000 7f60ff200640 1 Processor -- start 2024-08-17T02:27:01.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.761+0000 7f60ff200640 1 -- start start 2024-08-17T02:27:01.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.762+0000 7f60ff200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60f80ac000 0x7f60f814dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.762+0000 7f60ff200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60f80ad020 0x7f60f814d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.762+0000 7f60ff200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60f80afa00 0x7f60f8150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.762+0000 7f60ff200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f80cb310 con 0x7f60f80afa00 2024-08-17T02:27:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.762+0000 7f60ff200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f814e1f0 con 0x7f60f80ac000 2024-08-17T02:27:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.762+0000 7f60ff200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f814e850 con 0x7f60f80ad020 2024-08-17T02:27:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.763+0000 7f60fd200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60f80afa00 0x7f60f8150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.763+0000 7f60fd200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60f80afa00 0x7f60f8150360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37192/0 (socket says 172.21.15.2:37192) 2024-08-17T02:27:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.763+0000 7f60fd200640 1 -- 172.21.15.2:0/3710000605 learned_addr learned my addr 172.21.15.2:0/3710000605 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.763+0000 7f60f7e00640 1 --2- 172.21.15.2:0/3710000605 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60f80ac000 0x7f60f814dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.763+0000 7f60ef400640 1 --2- 172.21.15.2:0/3710000605 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60f80ad020 0x7f60f814d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.763+0000 7f60fd200640 1 -- 172.21.15.2:0/3710000605 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60f80ad020 msgr2=0x7f60f814d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.763+0000 7f60fd200640 1 --2- 172.21.15.2:0/3710000605 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60f80ad020 0x7f60f814d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.763+0000 7f60fd200640 1 -- 172.21.15.2:0/3710000605 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60f80ac000 msgr2=0x7f60f814dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.763+0000 7f60fd200640 1 --2- 172.21.15.2:0/3710000605 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60f80ac000 0x7f60f814dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.763+0000 7f60fd200640 1 -- 172.21.15.2:0/3710000605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e8009450 con 0x7f60f80afa00 2024-08-17T02:27:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.763+0000 7f60fd200640 1 --2- 172.21.15.2:0/3710000605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60f80afa00 0x7f60f8150360 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f60f000ea50 tx=0x7f60f00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.764+0000 7f60efe00640 1 -- 172.21.15.2:0/3710000605 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f000c8e0 con 0x7f60f80afa00 2024-08-17T02:27:01.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.764+0000 7f60efe00640 1 -- 172.21.15.2:0/3710000605 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f000ca40 con 0x7f60f80afa00 2024-08-17T02:27:01.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.764+0000 7f60efe00640 1 -- 172.21.15.2:0/3710000605 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f000ce00 con 0x7f60f80afa00 2024-08-17T02:27:01.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.764+0000 7f60ff200640 1 -- 172.21.15.2:0/3710000605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f815f1c0 con 0x7f60f80afa00 2024-08-17T02:27:01.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.764+0000 7f60ff200640 1 -- 172.21.15.2:0/3710000605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f80cad50 con 0x7f60f80afa00 2024-08-17T02:27:01.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.765+0000 7f60ff200640 1 -- 172.21.15.2:0/3710000605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f60f8063fb0 con 0x7f60f80afa00 2024-08-17T02:27:01.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.766+0000 7f60efe00640 1 -- 172.21.15.2:0/3710000605 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f60f0013680 con 0x7f60f80afa00 2024-08-17T02:27:01.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.766+0000 7f60efe00640 1 --2- 172.21.15.2:0/3710000605 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f60d4065150 0x7f60d4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.766+0000 7f60efe00640 1 -- 172.21.15.2:0/3710000605 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f60f00823c0 con 0x7f60f80afa00 2024-08-17T02:27:01.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.767+0000 7f60efe00640 1 --2- 172.21.15.2:0/3710000605 >> [v2:172.21.15.145:6800/37421,v1:172.21.15.145:6801/37421] conn(0x7f60d406b040 0x7f60d406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.767+0000 7f60efe00640 1 -- 172.21.15.2:0/3710000605 --> [v2:172.21.15.145:6800/37421,v1:172.21.15.145:6801/37421] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f60d406db00 con 0x7f60d406b040 2024-08-17T02:27:01.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.767+0000 7f60efe00640 1 -- 172.21.15.2:0/3710000605 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60f00848c0 con 0x7f60f80afa00 2024-08-17T02:27:01.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.767+0000 7f60f7e00640 1 --2- 172.21.15.2:0/3710000605 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f60d4065150 0x7f60d4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.767+0000 7f60ef400640 1 --2- 172.21.15.2:0/3710000605 >> [v2:172.21.15.145:6800/37421,v1:172.21.15.145:6801/37421] conn(0x7f60d406b040 0x7f60d406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.768+0000 7f60ef400640 1 --2- 172.21.15.2:0/3710000605 >> [v2:172.21.15.145:6800/37421,v1:172.21.15.145:6801/37421] conn(0x7f60d406b040 0x7f60d406d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.768+0000 7f60f7e00640 1 --2- 172.21.15.2:0/3710000605 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f60d4065150 0x7f60d4067600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f60e8034000 tx=0x7f60e8032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.768+0000 7f60efe00640 1 -- 172.21.15.2:0/3710000605 <== osd.4 v2:172.21.15.145:6800/37421 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f60d406db00 con 0x7f60d406b040 2024-08-17T02:27:01.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.781+0000 7f60ff200640 1 -- 172.21.15.2:0/3710000605 --> [v2:172.21.15.145:6800/37421,v1:172.21.15.145:6801/37421] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f60f8067c10 con 0x7f60d406b040 2024-08-17T02:27:01.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.782+0000 7f60efe00640 1 -- 172.21.15.2:0/3710000605 <== osd.4 v2:172.21.15.145:6800/37421 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f60f8067c10 con 0x7f60d406b040 2024-08-17T02:27:01.783 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-17T02:27:01.783 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:27:01.784 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-17T02:27:01.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.782+0000 7f60ff200640 1 -- 172.21.15.2:0/3710000605 >> [v2:172.21.15.145:6800/37421,v1:172.21.15.145:6801/37421] conn(0x7f60d406b040 msgr2=0x7f60d406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.782+0000 7f60ff200640 1 --2- 172.21.15.2:0/3710000605 >> [v2:172.21.15.145:6800/37421,v1:172.21.15.145:6801/37421] conn(0x7f60d406b040 0x7f60d406d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.783+0000 7f60ff200640 1 -- 172.21.15.2:0/3710000605 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f60d4065150 msgr2=0x7f60d4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.783+0000 7f60ff200640 1 --2- 172.21.15.2:0/3710000605 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f60d4065150 0x7f60d4067600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f60e8034000 tx=0x7f60e8032000 comp rx=0 tx=0).stop 2024-08-17T02:27:01.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.783+0000 7f60ff200640 1 -- 172.21.15.2:0/3710000605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60f80afa00 msgr2=0x7f60f8150360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.783+0000 7f60ff200640 1 --2- 172.21.15.2:0/3710000605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60f80afa00 0x7f60f8150360 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f60f000ea50 tx=0x7f60f00090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.783+0000 7f60fd200640 1 -- 172.21.15.2:0/3710000605 reap_dead start 2024-08-17T02:27:01.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.783+0000 7f60ff200640 1 -- 172.21.15.2:0/3710000605 shutdown_connections 2024-08-17T02:27:01.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.783+0000 7f60ff200640 1 -- 172.21.15.2:0/3710000605 >> 172.21.15.2:0/3710000605 conn(0x7f60f8066e60 msgr2=0x7f60f80af220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.783+0000 7f60ff200640 1 -- 172.21.15.2:0/3710000605 shutdown_connections 2024-08-17T02:27:01.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.783+0000 7f60ff200640 1 -- 172.21.15.2:0/3710000605 wait complete. 2024-08-17T02:27:01.798 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-17T02:27:01.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.950+0000 7f80bec00640 1 Processor -- start 2024-08-17T02:27:01.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.950+0000 7f80bec00640 1 -- start start 2024-08-17T02:27:01.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.951+0000 7f80bec00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f80b80afca0 0x7f80b80b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.951+0000 7f80bec00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80b81590b0 0x7f80b8159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.951+0000 7f80bec00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b815a4e0 con 0x7f80b80acf10 2024-08-17T02:27:01.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.951+0000 7f80bec00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b80b0980 con 0x7f80b80afca0 2024-08-17T02:27:01.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.951+0000 7f80bec00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b80c92b0 con 0x7f80b81590b0 2024-08-17T02:27:01.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.952+0000 7f80b7e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f80b80afca0 0x7f80b80b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.952+0000 7f80b7e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f80b80afca0 0x7f80b80b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37208/0 (socket says 172.21.15.2:37208) 2024-08-17T02:27:01.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.952+0000 7f80b7e00640 1 -- 172.21.15.2:0/3316549746 learned_addr learned my addr 172.21.15.2:0/3316549746 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:01.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.952+0000 7f80bcc00640 1 --2- 172.21.15.2:0/3316549746 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80b81590b0 0x7f80b8159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.952+0000 7f80b7e00640 1 -- 172.21.15.2:0/3316549746 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80b81590b0 msgr2=0x7f80b8159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:01.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.952+0000 7f80b7e00640 1 --2- 172.21.15.2:0/3316549746 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80b81590b0 0x7f80b8159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.952+0000 7f80b7e00640 1 -- 172.21.15.2:0/3316549746 >> v1:172.21.15.145:6789/0 conn(0x7f80b80acf10 legacy=0x7f80b81589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:01.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.952+0000 7f80b7e00640 1 -- 172.21.15.2:0/3316549746 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b80ad480 con 0x7f80b80afca0 2024-08-17T02:27:01.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.953+0000 7f80b7e00640 1 --2- 172.21.15.2:0/3316549746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b80afca0 0x7f80b80b0070 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009910 tx=0x7f80a80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6edb0472220f66 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.953+0000 7f80b6a00640 1 -- 172.21.15.2:0/3316549746 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a802adb0 con 0x7f80b80afca0 2024-08-17T02:27:01.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.953+0000 7f80b6a00640 1 -- 172.21.15.2:0/3316549746 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a8032440 con 0x7f80b80afca0 2024-08-17T02:27:01.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.953+0000 7f80b6a00640 1 -- 172.21.15.2:0/3316549746 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a8032820 con 0x7f80b80afca0 2024-08-17T02:27:01.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.954+0000 7f80bec00640 1 -- 172.21.15.2:0/3316549746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b80afca0 msgr2=0x7f80b80b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.954+0000 7f80bec00640 1 --2- 172.21.15.2:0/3316549746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b80afca0 0x7f80b80b0070 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009910 tx=0x7f80a80091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.954+0000 7f80bec00640 1 -- 172.21.15.2:0/3316549746 shutdown_connections 2024-08-17T02:27:01.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.954+0000 7f80bec00640 1 --2- 172.21.15.2:0/3316549746 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80b81590b0 0x7f80b8159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.954+0000 7f80bec00640 1 --2- 172.21.15.2:0/3316549746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b80afca0 0x7f80b80b0070 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.954+0000 7f80bec00640 1 -- 172.21.15.2:0/3316549746 >> 172.21.15.2:0/3316549746 conn(0x7f80b8066e60 msgr2=0x7f80b8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.954+0000 7f80bec00640 1 -- 172.21.15.2:0/3316549746 shutdown_connections 2024-08-17T02:27:01.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.954+0000 7f80bec00640 1 -- 172.21.15.2:0/3316549746 wait complete. 2024-08-17T02:27:01.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.955+0000 7f80bec00640 1 Processor -- start 2024-08-17T02:27:01.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.956+0000 7f80bec00640 1 -- start start 2024-08-17T02:27:01.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.956+0000 7f80bec00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80b80acf10 0x7f80b806ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.956+0000 7f80bec00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80b80afca0 0x7f80b80c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.956+0000 7f80bec00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b81590b0 0x7f80b814b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.956+0000 7f80bec00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b80c6340 con 0x7f80b81590b0 2024-08-17T02:27:01.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.956+0000 7f80bec00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b80c7140 con 0x7f80b80afca0 2024-08-17T02:27:01.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.956+0000 7f80bec00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b80c75d0 con 0x7f80b80acf10 2024-08-17T02:27:01.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.957+0000 7f80bcc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b81590b0 0x7f80b814b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.957+0000 7f80bcc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b81590b0 0x7f80b814b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37218/0 (socket says 172.21.15.2:37218) 2024-08-17T02:27:01.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.957+0000 7f80bcc00640 1 -- 172.21.15.2:0/842190962 learned_addr learned my addr 172.21.15.2:0/842190962 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:01.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.957+0000 7f80b7e00640 1 --2- 172.21.15.2:0/842190962 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80b80acf10 0x7f80b806ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.957+0000 7f80b7400640 1 --2- 172.21.15.2:0/842190962 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80b80afca0 0x7f80b80c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.957+0000 7f80bcc00640 1 -- 172.21.15.2:0/842190962 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80b80acf10 msgr2=0x7f80b806ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.957+0000 7f80bcc00640 1 --2- 172.21.15.2:0/842190962 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80b80acf10 0x7f80b806ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.957+0000 7f80bcc00640 1 -- 172.21.15.2:0/842190962 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80b80afca0 msgr2=0x7f80b80c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.957+0000 7f80bcc00640 1 --2- 172.21.15.2:0/842190962 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80b80afca0 0x7f80b80c5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.957+0000 7f80bcc00640 1 -- 172.21.15.2:0/842190962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a8009450 con 0x7f80b81590b0 2024-08-17T02:27:01.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.957+0000 7f80b7e00640 1 --2- 172.21.15.2:0/842190962 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80b80acf10 0x7f80b806ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:01.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.957+0000 7f80bcc00640 1 --2- 172.21.15.2:0/842190962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b81590b0 0x7f80b814b830 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f80b000cd30 tx=0x7f80b0007790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.958+0000 7f80af400640 1 -- 172.21.15.2:0/842190962 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b000ce90 con 0x7f80b81590b0 2024-08-17T02:27:01.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.958+0000 7f80af400640 1 -- 172.21.15.2:0/842190962 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b000ac70 con 0x7f80b81590b0 2024-08-17T02:27:01.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.958+0000 7f80af400640 1 -- 172.21.15.2:0/842190962 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0017680 con 0x7f80b81590b0 2024-08-17T02:27:01.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.958+0000 7f80bec00640 1 -- 172.21.15.2:0/842190962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b80c6530 con 0x7f80b81590b0 2024-08-17T02:27:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.958+0000 7f80bec00640 1 -- 172.21.15.2:0/842190962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b80c6af0 con 0x7f80b81590b0 2024-08-17T02:27:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.959+0000 7f80bec00640 1 -- 172.21.15.2:0/842190962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b8063fb0 con 0x7f80b81590b0 2024-08-17T02:27:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.960+0000 7f80af400640 1 -- 172.21.15.2:0/842190962 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f80b0003020 con 0x7f80b81590b0 2024-08-17T02:27:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.961+0000 7f80af400640 1 --2- 172.21.15.2:0/842190962 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8098065180 0x7f8098067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.961+0000 7f80af400640 1 -- 172.21.15.2:0/842190962 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f80b0013070 con 0x7f80b81590b0 2024-08-17T02:27:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.961+0000 7f80b7e00640 1 --2- 172.21.15.2:0/842190962 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8098065180 0x7f8098067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.962+0000 7f80b7e00640 1 --2- 172.21.15.2:0/842190962 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8098065180 0x7f8098067630 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f80a8034000 tx=0x7f80a8032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:01.965+0000 7f80af400640 1 -- 172.21.15.2:0/842190962 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f80b0050b10 con 0x7f80b81590b0 2024-08-17T02:27:02.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.147+0000 7f80bec00640 1 -- 172.21.15.2:0/842190962 --> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f80b80c7280 con 0x7f8098065180 2024-08-17T02:27:02.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.148+0000 7f80af400640 1 -- 172.21.15.2:0/842190962 <== mgr.4108 v2:172.21.15.145:6832/36841 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f80b80c7280 con 0x7f8098065180 2024-08-17T02:27:02.149 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 4 to deep-scrub 2024-08-17T02:27:02.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.150+0000 7f80bec00640 1 -- 172.21.15.2:0/842190962 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8098065180 msgr2=0x7f8098067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.150+0000 7f80bec00640 1 --2- 172.21.15.2:0/842190962 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8098065180 0x7f8098067630 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f80a8034000 tx=0x7f80a8032000 comp rx=0 tx=0).stop 2024-08-17T02:27:02.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.150+0000 7f80bec00640 1 -- 172.21.15.2:0/842190962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b81590b0 msgr2=0x7f80b814b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.150+0000 7f80bec00640 1 --2- 172.21.15.2:0/842190962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b81590b0 0x7f80b814b830 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f80b000cd30 tx=0x7f80b0007790 comp rx=0 tx=0).stop 2024-08-17T02:27:02.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.150+0000 7f80bec00640 1 -- 172.21.15.2:0/842190962 shutdown_connections 2024-08-17T02:27:02.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.150+0000 7f80bec00640 1 --2- 172.21.15.2:0/842190962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b81590b0 0x7f80b814b830 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.150+0000 7f80bec00640 1 --2- 172.21.15.2:0/842190962 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80b80afca0 0x7f80b80c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.150+0000 7f80bec00640 1 --2- 172.21.15.2:0/842190962 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8098065180 0x7f8098067630 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.150+0000 7f80bec00640 1 --2- 172.21.15.2:0/842190962 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80b80acf10 0x7f80b806ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.150+0000 7f80bec00640 1 -- 172.21.15.2:0/842190962 >> 172.21.15.2:0/842190962 conn(0x7f80b8066e60 msgr2=0x7f80b806e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.150+0000 7f80bec00640 1 -- 172.21.15.2:0/842190962 shutdown_connections 2024-08-17T02:27:02.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.150+0000 7f80bec00640 1 -- 172.21.15.2:0/842190962 wait complete. 2024-08-17T02:27:02.166 INFO:tasks.ceph:Scrubbing osd.5 2024-08-17T02:27:02.166 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:27:02.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.320+0000 7faa6ee00640 1 Processor -- start 2024-08-17T02:27:02.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.321+0000 7faa6ee00640 1 -- start start 2024-08-17T02:27:02.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.322+0000 7faa6ee00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7faa6815cde0 0x7faa680ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.322+0000 7faa6ee00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa680aec20 0x7faa6806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.322+0000 7faa6ee00640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa680afcb0 con 0x7faa6806de00 2024-08-17T02:27:02.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.322+0000 7faa6ee00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa6806e240 con 0x7faa6815cde0 2024-08-17T02:27:02.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.322+0000 7faa6ee00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa680af0a0 con 0x7faa680aec20 2024-08-17T02:27:02.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.322+0000 7faa6d000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa680aec20 0x7faa6806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.322+0000 7faa6d000640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa680aec20 0x7faa6806d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.2:33792/0 (socket says 172.21.15.2:33792) 2024-08-17T02:27:02.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.322+0000 7faa6d000640 1 -- 172.21.15.2:0/2690884717 learned_addr learned my addr 172.21.15.2:0/2690884717 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:02.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.322+0000 7faa6da00640 1 --2- 172.21.15.2:0/2690884717 >> v2:172.21.15.145:3300/0 conn(0x7faa6815cde0 0x7faa680ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.323+0000 7faa6d000640 1 -- 172.21.15.2:0/2690884717 >> v2:172.21.15.145:3300/0 conn(0x7faa6815cde0 msgr2=0x7faa680ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:02.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.323+0000 7faa6d000640 1 --2- 172.21.15.2:0/2690884717 >> v2:172.21.15.145:3300/0 conn(0x7faa6815cde0 0x7faa680ae6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.323+0000 7faa6d000640 1 -- 172.21.15.2:0/2690884717 >> v1:172.21.15.145:6789/0 conn(0x7faa6806de00 legacy=0x7faa680b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.323+0000 7faa6d000640 1 -- 172.21.15.2:0/2690884717 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa680af380 con 0x7faa680aec20 2024-08-17T02:27:02.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.324+0000 7faa6d000640 1 --2- 172.21.15.2:0/2690884717 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa680aec20 0x7faa6806d8c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faa54009910 tx=0x7faa540091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13d70a64467ac48e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.324+0000 7faa67e00640 1 -- 172.21.15.2:0/2690884717 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5402ae40 con 0x7faa680aec20 2024-08-17T02:27:02.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.324+0000 7faa67e00640 1 -- 172.21.15.2:0/2690884717 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa54032440 con 0x7faa680aec20 2024-08-17T02:27:02.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.324+0000 7faa67e00640 1 -- 172.21.15.2:0/2690884717 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa54032820 con 0x7faa680aec20 2024-08-17T02:27:02.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.325+0000 7faa6ee00640 1 -- 172.21.15.2:0/2690884717 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa680aec20 msgr2=0x7faa6806d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.325+0000 7faa6ee00640 1 --2- 172.21.15.2:0/2690884717 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa680aec20 0x7faa6806d8c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faa54009910 tx=0x7faa540091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.325+0000 7faa6ee00640 1 -- 172.21.15.2:0/2690884717 shutdown_connections 2024-08-17T02:27:02.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.325+0000 7faa6ee00640 1 --2- 172.21.15.2:0/2690884717 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa680aec20 0x7faa6806d8c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.325+0000 7faa6ee00640 1 --2- 172.21.15.2:0/2690884717 >> v2:172.21.15.145:3300/0 conn(0x7faa6815cde0 0x7faa680ae6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.325+0000 7faa6ee00640 1 -- 172.21.15.2:0/2690884717 >> 172.21.15.2:0/2690884717 conn(0x7faa68066e60 msgr2=0x7faa68067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.325+0000 7faa6ee00640 1 -- 172.21.15.2:0/2690884717 shutdown_connections 2024-08-17T02:27:02.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.325+0000 7faa6ee00640 1 -- 172.21.15.2:0/2690884717 wait complete. 2024-08-17T02:27:02.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.326+0000 7faa6ee00640 1 Processor -- start 2024-08-17T02:27:02.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.326+0000 7faa6ee00640 1 -- start start 2024-08-17T02:27:02.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.327+0000 7faa6ee00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa6806de00 0x7faa681704d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.327+0000 7faa6ee00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa6815cde0 0x7faa68154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.327+0000 7faa6ee00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa6813d820 0x7faa6813dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.327+0000 7faa6ee00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa68151060 con 0x7faa6813d820 2024-08-17T02:27:02.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.327+0000 7faa6ee00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6812d1a0 con 0x7faa6815cde0 2024-08-17T02:27:02.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.327+0000 7faa6ee00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa681507c0 con 0x7faa6806de00 2024-08-17T02:27:02.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.327+0000 7faa6e400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa6813d820 0x7faa6813dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.327+0000 7faa6e400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa6813d820 0x7faa6813dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37232/0 (socket says 172.21.15.2:37232) 2024-08-17T02:27:02.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.327+0000 7faa6e400640 1 -- 172.21.15.2:0/1194117981 learned_addr learned my addr 172.21.15.2:0/1194117981 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:02.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.327+0000 7faa6d000640 1 --2- 172.21.15.2:0/1194117981 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa6815cde0 0x7faa68154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.328+0000 7faa6da00640 1 --2- 172.21.15.2:0/1194117981 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa6806de00 0x7faa681704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.328+0000 7faa6e400640 1 -- 172.21.15.2:0/1194117981 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa6806de00 msgr2=0x7faa681704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.328+0000 7faa6e400640 1 --2- 172.21.15.2:0/1194117981 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa6806de00 0x7faa681704d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.328+0000 7faa6e400640 1 -- 172.21.15.2:0/1194117981 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa6815cde0 msgr2=0x7faa68154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.328+0000 7faa6e400640 1 --2- 172.21.15.2:0/1194117981 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa6815cde0 0x7faa68154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.328+0000 7faa6e400640 1 -- 172.21.15.2:0/1194117981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa54009450 con 0x7faa6813d820 2024-08-17T02:27:02.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.328+0000 7faa6e400640 1 --2- 172.21.15.2:0/1194117981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa6813d820 0x7faa6813dca0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7faa6000c860 tx=0x7faa60001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.328+0000 7faa64c00640 1 -- 172.21.15.2:0/1194117981 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6000ce50 con 0x7faa6813d820 2024-08-17T02:27:02.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.328+0000 7faa64c00640 1 -- 172.21.15.2:0/1194117981 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6000a850 con 0x7faa6813d820 2024-08-17T02:27:02.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.328+0000 7faa64c00640 1 -- 172.21.15.2:0/1194117981 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6000ac10 con 0x7faa6813d820 2024-08-17T02:27:02.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.328+0000 7faa6ee00640 1 -- 172.21.15.2:0/1194117981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa68150aa0 con 0x7faa6813d820 2024-08-17T02:27:02.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.329+0000 7faa6ee00640 1 -- 172.21.15.2:0/1194117981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa68170a10 con 0x7faa6813d820 2024-08-17T02:27:02.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.329+0000 7faa6ee00640 1 -- 172.21.15.2:0/1194117981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faa6812cf70 con 0x7faa6813d820 2024-08-17T02:27:02.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.330+0000 7faa64c00640 1 -- 172.21.15.2:0/1194117981 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7faa60012420 con 0x7faa6813d820 2024-08-17T02:27:02.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.331+0000 7faa64c00640 1 --2- 172.21.15.2:0/1194117981 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7faa48065150 0x7faa48067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.331+0000 7faa64c00640 1 -- 172.21.15.2:0/1194117981 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7faa600823e0 con 0x7faa6813d820 2024-08-17T02:27:02.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.331+0000 7faa64c00640 1 --2- 172.21.15.2:0/1194117981 >> [v2:172.21.15.145:6824/37439,v1:172.21.15.145:6825/37439] conn(0x7faa4806b040 0x7faa4806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.331+0000 7faa64c00640 1 -- 172.21.15.2:0/1194117981 --> [v2:172.21.15.145:6824/37439,v1:172.21.15.145:6825/37439] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa4806db00 con 0x7faa4806b040 2024-08-17T02:27:02.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.331+0000 7faa64c00640 1 -- 172.21.15.2:0/1194117981 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa60084940 con 0x7faa6813d820 2024-08-17T02:27:02.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.332+0000 7faa6da00640 1 --2- 172.21.15.2:0/1194117981 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7faa48065150 0x7faa48067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.332+0000 7faa6d000640 1 --2- 172.21.15.2:0/1194117981 >> [v2:172.21.15.145:6824/37439,v1:172.21.15.145:6825/37439] conn(0x7faa4806b040 0x7faa4806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.332+0000 7faa6da00640 1 --2- 172.21.15.2:0/1194117981 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7faa48065150 0x7faa48067600 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faa5c009c80 tx=0x7faa5c0090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.332+0000 7faa6d000640 1 --2- 172.21.15.2:0/1194117981 >> [v2:172.21.15.145:6824/37439,v1:172.21.15.145:6825/37439] conn(0x7faa4806b040 0x7faa4806d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.333+0000 7faa64c00640 1 -- 172.21.15.2:0/1194117981 <== osd.5 v2:172.21.15.145:6824/37439 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7faa4806db00 con 0x7faa4806b040 2024-08-17T02:27:02.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.346+0000 7faa6ee00640 1 -- 172.21.15.2:0/1194117981 --> [v2:172.21.15.145:6824/37439,v1:172.21.15.145:6825/37439] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7faa68063f10 con 0x7faa4806b040 2024-08-17T02:27:02.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.347+0000 7faa64c00640 1 -- 172.21.15.2:0/1194117981 <== osd.5 v2:172.21.15.145:6824/37439 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7faa68063f10 con 0x7faa4806b040 2024-08-17T02:27:02.348 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-17T02:27:02.348 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:27:02.348 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-17T02:27:02.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.347+0000 7faa6ee00640 1 -- 172.21.15.2:0/1194117981 >> [v2:172.21.15.145:6824/37439,v1:172.21.15.145:6825/37439] conn(0x7faa4806b040 msgr2=0x7faa4806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.347+0000 7faa6ee00640 1 --2- 172.21.15.2:0/1194117981 >> [v2:172.21.15.145:6824/37439,v1:172.21.15.145:6825/37439] conn(0x7faa4806b040 0x7faa4806d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.347+0000 7faa6ee00640 1 -- 172.21.15.2:0/1194117981 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7faa48065150 msgr2=0x7faa48067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.347+0000 7faa6ee00640 1 --2- 172.21.15.2:0/1194117981 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7faa48065150 0x7faa48067600 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faa5c009c80 tx=0x7faa5c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.347+0000 7faa6ee00640 1 -- 172.21.15.2:0/1194117981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa6813d820 msgr2=0x7faa6813dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.347+0000 7faa6ee00640 1 --2- 172.21.15.2:0/1194117981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa6813d820 0x7faa6813dca0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7faa6000c860 tx=0x7faa60001690 comp rx=0 tx=0).stop 2024-08-17T02:27:02.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.347+0000 7faa6e400640 1 -- 172.21.15.2:0/1194117981 reap_dead start 2024-08-17T02:27:02.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.347+0000 7faa6ee00640 1 -- 172.21.15.2:0/1194117981 shutdown_connections 2024-08-17T02:27:02.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.347+0000 7faa6ee00640 1 -- 172.21.15.2:0/1194117981 >> 172.21.15.2:0/1194117981 conn(0x7faa68066e60 msgr2=0x7faa68156540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.347+0000 7faa6ee00640 1 -- 172.21.15.2:0/1194117981 shutdown_connections 2024-08-17T02:27:02.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.347+0000 7faa6ee00640 1 -- 172.21.15.2:0/1194117981 wait complete. 2024-08-17T02:27:02.362 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-17T02:27:02.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.513+0000 7fe953200640 1 Processor -- start 2024-08-17T02:27:02.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.514+0000 7fe953200640 1 -- start start 2024-08-17T02:27:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.515+0000 7fe953200640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe94c158a00 0x7fe94c158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.515+0000 7fe953200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe94c0cb190 0x7fe94c0cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.515+0000 7fe953200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94c0cbc50 con 0x7fe94c06e590 2024-08-17T02:27:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.515+0000 7fe953200640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe94c0cbf30 con 0x7fe94c158a00 2024-08-17T02:27:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.515+0000 7fe953200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c0cc210 con 0x7fe94c0cb190 2024-08-17T02:27:02.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.515+0000 7fe952800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe94c06e590 0x7fe94c0683e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48688/0 (socket says 172.21.15.2:48688) 2024-08-17T02:27:02.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.515+0000 7fe952800640 1 -- 172.21.15.2:0/112659123 learned_addr learned my addr 172.21.15.2:0/112659123 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:27:02.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.515+0000 7fe951400640 1 --2- 172.21.15.2:0/112659123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe94c0cb190 0x7fe94c0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.515+0000 7fe951e00640 1 --2- 172.21.15.2:0/112659123 >> v2:172.21.15.145:3300/0 conn(0x7fe94c158a00 0x7fe94c158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.516+0000 7fe950a00640 1 -- 172.21.15.2:0/112659123 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1136312744 0 0) 0x7fe94c0cbc50 con 0x7fe94c06e590 2024-08-17T02:27:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.516+0000 7fe950a00640 1 -- 172.21.15.2:0/112659123 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9340034e0 con 0x7fe94c06e590 2024-08-17T02:27:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.516+0000 7fe951e00640 1 -- 172.21.15.2:0/112659123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe94c0cb190 msgr2=0x7fe94c0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.516+0000 7fe951e00640 1 --2- 172.21.15.2:0/112659123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe94c0cb190 0x7fe94c0cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.516+0000 7fe951e00640 1 -- 172.21.15.2:0/112659123 >> v1:172.21.15.2:6789/0 conn(0x7fe94c06e590 legacy=0x7fe94c0683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.516+0000 7fe951e00640 1 -- 172.21.15.2:0/112659123 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c0b2930 con 0x7fe94c158a00 2024-08-17T02:27:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.516+0000 7fe951400640 1 --2- 172.21.15.2:0/112659123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe94c0cb190 0x7fe94c0cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.517+0000 7fe951e00640 1 --2- 172.21.15.2:0/112659123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe94c158a00 0x7fe94c158dd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe940009850 tx=0x7fe9400090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc3ab866755995fd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.517+0000 7fe950a00640 1 -- 172.21.15.2:0/112659123 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94002ad90 con 0x7fe94c158a00 2024-08-17T02:27:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.517+0000 7fe950a00640 1 -- 172.21.15.2:0/112659123 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe940032440 con 0x7fe94c158a00 2024-08-17T02:27:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.517+0000 7fe950a00640 1 -- 172.21.15.2:0/112659123 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe940032820 con 0x7fe94c158a00 2024-08-17T02:27:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.518+0000 7fe953200640 1 -- 172.21.15.2:0/112659123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe94c158a00 msgr2=0x7fe94c158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.518+0000 7fe953200640 1 --2- 172.21.15.2:0/112659123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe94c158a00 0x7fe94c158dd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe940009850 tx=0x7fe9400090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.518+0000 7fe953200640 1 -- 172.21.15.2:0/112659123 shutdown_connections 2024-08-17T02:27:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.518+0000 7fe953200640 1 --2- 172.21.15.2:0/112659123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe94c0cb190 0x7fe94c0cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.518+0000 7fe953200640 1 --2- 172.21.15.2:0/112659123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe94c158a00 0x7fe94c158dd0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.518+0000 7fe953200640 1 -- 172.21.15.2:0/112659123 >> 172.21.15.2:0/112659123 conn(0x7fe94c0cfb80 msgr2=0x7fe94c0cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.518+0000 7fe953200640 1 -- 172.21.15.2:0/112659123 shutdown_connections 2024-08-17T02:27:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.518+0000 7fe953200640 1 -- 172.21.15.2:0/112659123 wait complete. 2024-08-17T02:27:02.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.520+0000 7fe953200640 1 Processor -- start 2024-08-17T02:27:02.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.520+0000 7fe953200640 1 -- start start 2024-08-17T02:27:02.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.521+0000 7fe953200640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe94c06e590 0x7fe94c150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.521+0000 7fe953200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe94c0cb190 0x7fe94c15b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.521+0000 7fe953200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe94c158a00 0x7fe94c15ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.521+0000 7fe953200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c169e90 con 0x7fe94c0cb190 2024-08-17T02:27:02.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.521+0000 7fe953200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c15ae10 con 0x7fe94c158a00 2024-08-17T02:27:02.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.521+0000 7fe953200640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c15a4e0 con 0x7fe94c06e590 2024-08-17T02:27:02.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.521+0000 7fe951400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe94c0cb190 0x7fe94c15b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.521+0000 7fe951400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe94c0cb190 0x7fe94c15b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37242/0 (socket says 172.21.15.2:37242) 2024-08-17T02:27:02.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.521+0000 7fe951400640 1 -- 172.21.15.2:0/3292917818 learned_addr learned my addr 172.21.15.2:0/3292917818 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:02.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.521+0000 7fe951e00640 1 --2- 172.21.15.2:0/3292917818 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe94c06e590 0x7fe94c150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.521+0000 7fe952800640 1 --2- 172.21.15.2:0/3292917818 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe94c158a00 0x7fe94c15ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.521+0000 7fe951400640 1 -- 172.21.15.2:0/3292917818 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe94c06e590 msgr2=0x7fe94c150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.521+0000 7fe951400640 1 --2- 172.21.15.2:0/3292917818 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe94c06e590 0x7fe94c150cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.521+0000 7fe951400640 1 -- 172.21.15.2:0/3292917818 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe94c158a00 msgr2=0x7fe94c15ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.521+0000 7fe951400640 1 --2- 172.21.15.2:0/3292917818 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe94c158a00 0x7fe94c15ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.521+0000 7fe951400640 1 -- 172.21.15.2:0/3292917818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93c009390 con 0x7fe94c0cb190 2024-08-17T02:27:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.521+0000 7fe952800640 1 --2- 172.21.15.2:0/3292917818 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe94c158a00 0x7fe94c15ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.522+0000 7fe951400640 1 --2- 172.21.15.2:0/3292917818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe94c0cb190 0x7fe94c15b530 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe93c00ec80 tx=0x7fe93c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.522+0000 7fe945600640 1 -- 172.21.15.2:0/3292917818 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c00eec0 con 0x7fe94c0cb190 2024-08-17T02:27:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.522+0000 7fe945600640 1 -- 172.21.15.2:0/3292917818 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93c00cbc0 con 0x7fe94c0cb190 2024-08-17T02:27:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.522+0000 7fe953200640 1 -- 172.21.15.2:0/3292917818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe940009390 con 0x7fe94c0cb190 2024-08-17T02:27:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.522+0000 7fe945600640 1 -- 172.21.15.2:0/3292917818 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c013470 con 0x7fe94c0cb190 2024-08-17T02:27:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.522+0000 7fe953200640 1 -- 172.21.15.2:0/3292917818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe94c15aaa0 con 0x7fe94c0cb190 2024-08-17T02:27:02.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.523+0000 7fe953200640 1 -- 172.21.15.2:0/3292917818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe94c15af80 con 0x7fe94c0cb190 2024-08-17T02:27:02.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.524+0000 7fe945600640 1 -- 172.21.15.2:0/3292917818 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe93c0137e0 con 0x7fe94c0cb190 2024-08-17T02:27:02.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.525+0000 7fe945600640 1 --2- 172.21.15.2:0/3292917818 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe930065180 0x7fe930067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.525+0000 7fe945600640 1 -- 172.21.15.2:0/3292917818 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fe93c082600 con 0x7fe94c0cb190 2024-08-17T02:27:02.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.526+0000 7fe951e00640 1 --2- 172.21.15.2:0/3292917818 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe930065180 0x7fe930067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.526+0000 7fe951e00640 1 --2- 172.21.15.2:0/3292917818 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe930065180 0x7fe930067630 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe940034000 tx=0x7fe940032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.529+0000 7fe945600640 1 -- 172.21.15.2:0/3292917818 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe93c0508c0 con 0x7fe94c0cb190 2024-08-17T02:27:02.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.714+0000 7fe953200640 1 -- 172.21.15.2:0/3292917818 --> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fe94c070720 con 0x7fe930065180 2024-08-17T02:27:02.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.715+0000 7fe945600640 1 -- 172.21.15.2:0/3292917818 <== mgr.4108 v2:172.21.15.145:6832/36841 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe94c070720 con 0x7fe930065180 2024-08-17T02:27:02.716 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 5 to deep-scrub 2024-08-17T02:27:02.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.717+0000 7fe953200640 1 -- 172.21.15.2:0/3292917818 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe930065180 msgr2=0x7fe930067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.717+0000 7fe953200640 1 --2- 172.21.15.2:0/3292917818 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe930065180 0x7fe930067630 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe940034000 tx=0x7fe940032000 comp rx=0 tx=0).stop 2024-08-17T02:27:02.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.717+0000 7fe953200640 1 -- 172.21.15.2:0/3292917818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe94c0cb190 msgr2=0x7fe94c15b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.717+0000 7fe953200640 1 --2- 172.21.15.2:0/3292917818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe94c0cb190 0x7fe94c15b530 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe93c00ec80 tx=0x7fe93c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.717+0000 7fe953200640 1 -- 172.21.15.2:0/3292917818 shutdown_connections 2024-08-17T02:27:02.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.717+0000 7fe953200640 1 --2- 172.21.15.2:0/3292917818 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe94c158a00 0x7fe94c15ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.717+0000 7fe953200640 1 --2- 172.21.15.2:0/3292917818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe94c0cb190 0x7fe94c15b530 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.717+0000 7fe953200640 1 --2- 172.21.15.2:0/3292917818 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7fe930065180 0x7fe930067630 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.717+0000 7fe953200640 1 --2- 172.21.15.2:0/3292917818 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe94c06e590 0x7fe94c150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.717+0000 7fe953200640 1 -- 172.21.15.2:0/3292917818 >> 172.21.15.2:0/3292917818 conn(0x7fe94c0cfb80 msgr2=0x7fe94c06e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.717+0000 7fe953200640 1 -- 172.21.15.2:0/3292917818 shutdown_connections 2024-08-17T02:27:02.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.717+0000 7fe953200640 1 -- 172.21.15.2:0/3292917818 wait complete. 2024-08-17T02:27:02.734 INFO:tasks.ceph:Scrubbing osd.6 2024-08-17T02:27:02.734 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:27:02.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.888+0000 7f17b2a00640 1 Processor -- start 2024-08-17T02:27:02.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.888+0000 7f17b2a00640 1 -- start start 2024-08-17T02:27:02.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.889+0000 7f17b2a00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f17ac0ad020 0x7f17ac159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.889+0000 7f17b2a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f17ac0afa00 0x7f17ac0afe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.889+0000 7f17b2a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ac159ad0 con 0x7f17ac0ac000 2024-08-17T02:27:02.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.889+0000 7f17b2a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17ac0b0340 con 0x7f17ac0afa00 2024-08-17T02:27:02.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.889+0000 7f17b2a00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17ac0ad590 con 0x7f17ac0ad020 2024-08-17T02:27:02.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.889+0000 7f17b0a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f17ac0afa00 0x7f17ac0afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.889+0000 7f17b0a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f17ac0afa00 0x7f17ac0afe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37258/0 (socket says 172.21.15.2:37258) 2024-08-17T02:27:02.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.889+0000 7f17b0a00640 1 -- 172.21.15.2:0/4014153368 learned_addr learned my addr 172.21.15.2:0/4014153368 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:02.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.889+0000 7f17abe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f17ac0ac000 0x7f17ac156a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48698/0 (socket says 172.21.15.2:48698) 2024-08-17T02:27:02.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.890+0000 7f17a3400640 1 --2- 172.21.15.2:0/4014153368 >> v2:172.21.15.145:3300/0 conn(0x7f17ac0ad020 0x7f17ac159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.890+0000 7f17b0a00640 1 -- 172.21.15.2:0/4014153368 >> v2:172.21.15.145:3300/0 conn(0x7f17ac0ad020 msgr2=0x7f17ac159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:02.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.890+0000 7f17b0a00640 1 --2- 172.21.15.2:0/4014153368 >> v2:172.21.15.145:3300/0 conn(0x7f17ac0ad020 0x7f17ac159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.890+0000 7f17b0a00640 1 -- 172.21.15.2:0/4014153368 >> v1:172.21.15.2:6789/0 conn(0x7f17ac0ac000 legacy=0x7f17ac156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.890+0000 7f17b0a00640 1 -- 172.21.15.2:0/4014153368 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ac0ad870 con 0x7f17ac0afa00 2024-08-17T02:27:02.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.890+0000 7f17ab400640 1 -- 172.21.15.2:0/4014153368 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 559793163 0 0) 0x7f17ac159ad0 con 0x7f17ac0ac000 2024-08-17T02:27:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.891+0000 7f17b0a00640 1 --2- 172.21.15.2:0/4014153368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ac0afa00 0x7f17ac0afe00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f17ac06b9b0 tx=0x7f17a40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae3d35e7b07314c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.891+0000 7f17ab400640 1 -- 172.21.15.2:0/4014153368 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a402adf0 con 0x7f17ac0afa00 2024-08-17T02:27:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.891+0000 7f17ab400640 1 -- 172.21.15.2:0/4014153368 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a4032440 con 0x7f17ac0afa00 2024-08-17T02:27:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.891+0000 7f17ab400640 1 -- 172.21.15.2:0/4014153368 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a40327e0 con 0x7f17ac0afa00 2024-08-17T02:27:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.892+0000 7f17b2a00640 1 -- 172.21.15.2:0/4014153368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ac0afa00 msgr2=0x7f17ac0afe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.892+0000 7f17b2a00640 1 --2- 172.21.15.2:0/4014153368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ac0afa00 0x7f17ac0afe00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f17ac06b9b0 tx=0x7f17a40091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.892+0000 7f17b2a00640 1 -- 172.21.15.2:0/4014153368 shutdown_connections 2024-08-17T02:27:02.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.892+0000 7f17b2a00640 1 --2- 172.21.15.2:0/4014153368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ac0afa00 0x7f17ac0afe00 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.892+0000 7f17b2a00640 1 --2- 172.21.15.2:0/4014153368 >> v2:172.21.15.145:3300/0 conn(0x7f17ac0ad020 0x7f17ac159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.892+0000 7f17b2a00640 1 -- 172.21.15.2:0/4014153368 >> 172.21.15.2:0/4014153368 conn(0x7f17ac066e60 msgr2=0x7f17ac067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.892+0000 7f17b2a00640 1 -- 172.21.15.2:0/4014153368 shutdown_connections 2024-08-17T02:27:02.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.892+0000 7f17b2a00640 1 -- 172.21.15.2:0/4014153368 wait complete. 2024-08-17T02:27:02.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.893+0000 7f17b2a00640 1 Processor -- start 2024-08-17T02:27:02.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.893+0000 7f17b2a00640 1 -- start start 2024-08-17T02:27:02.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.894+0000 7f17b2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ac0ac000 0x7f17ac1698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.894+0000 7f17b2a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17ac0ad020 0x7f17ac0c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.894+0000 7f17b2a00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17ac0afa00 0x7f17ac0c2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.894+0000 7f17b2a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac169e20 con 0x7f17ac0ac000 2024-08-17T02:27:02.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.894+0000 7f17b2a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac0c1d80 con 0x7f17ac0ad020 2024-08-17T02:27:02.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.894+0000 7f17b2a00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac0c18f0 con 0x7f17ac0afa00 2024-08-17T02:27:02.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.894+0000 7f17abe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ac0ac000 0x7f17ac1698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.894+0000 7f17abe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ac0ac000 0x7f17ac1698e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37264/0 (socket says 172.21.15.2:37264) 2024-08-17T02:27:02.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.894+0000 7f17abe00640 1 -- 172.21.15.2:0/1036188877 learned_addr learned my addr 172.21.15.2:0/1036188877 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:02.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.895+0000 7f17a3400640 1 --2- 172.21.15.2:0/1036188877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17ac0ad020 0x7f17ac0c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.895+0000 7f17b0a00640 1 --2- 172.21.15.2:0/1036188877 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17ac0afa00 0x7f17ac0c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.895+0000 7f17abe00640 1 -- 172.21.15.2:0/1036188877 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17ac0afa00 msgr2=0x7f17ac0c2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.895+0000 7f17abe00640 1 --2- 172.21.15.2:0/1036188877 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17ac0afa00 0x7f17ac0c2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.895+0000 7f17abe00640 1 -- 172.21.15.2:0/1036188877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17ac0ad020 msgr2=0x7f17ac0c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.895+0000 7f17abe00640 1 --2- 172.21.15.2:0/1036188877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17ac0ad020 0x7f17ac0c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.895+0000 7f17abe00640 1 -- 172.21.15.2:0/1036188877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a4009450 con 0x7f17ac0ac000 2024-08-17T02:27:02.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.895+0000 7f17abe00640 1 --2- 172.21.15.2:0/1036188877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ac0ac000 0x7f17ac1698e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f179c00c960 tx=0x7f179c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.895+0000 7f17a3e00640 1 -- 172.21.15.2:0/1036188877 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c005d60 con 0x7f17ac0ac000 2024-08-17T02:27:02.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.896+0000 7f17a3e00640 1 -- 172.21.15.2:0/1036188877 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179c00a640 con 0x7f17ac0ac000 2024-08-17T02:27:02.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.896+0000 7f17a3e00640 1 -- 172.21.15.2:0/1036188877 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c00aa00 con 0x7f17ac0ac000 2024-08-17T02:27:02.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.896+0000 7f17b2a00640 1 -- 172.21.15.2:0/1036188877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ac0c0ce0 con 0x7f17ac0ac000 2024-08-17T02:27:02.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.896+0000 7f17b2a00640 1 -- 172.21.15.2:0/1036188877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ac0c12a0 con 0x7f17ac0ac000 2024-08-17T02:27:02.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.896+0000 7f17b2a00640 1 -- 172.21.15.2:0/1036188877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f17ac063fb0 con 0x7f17ac0ac000 2024-08-17T02:27:02.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.897+0000 7f17a3e00640 1 -- 172.21.15.2:0/1036188877 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f179c0070f0 con 0x7f17ac0ac000 2024-08-17T02:27:02.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.898+0000 7f17a3e00640 1 --2- 172.21.15.2:0/1036188877 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1788065150 0x7f1788067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.898+0000 7f17a3e00640 1 -- 172.21.15.2:0/1036188877 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f179c081ea0 con 0x7f17ac0ac000 2024-08-17T02:27:02.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.899+0000 7f17a3e00640 1 --2- 172.21.15.2:0/1036188877 >> [v2:172.21.15.145:6808/37423,v1:172.21.15.145:6809/37423] conn(0x7f178806b040 0x7f178806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.899+0000 7f17a3e00640 1 -- 172.21.15.2:0/1036188877 --> [v2:172.21.15.145:6808/37423,v1:172.21.15.145:6809/37423] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f178806db00 con 0x7f178806b040 2024-08-17T02:27:02.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.899+0000 7f17a3e00640 1 -- 172.21.15.2:0/1036188877 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f179c084400 con 0x7f17ac0ac000 2024-08-17T02:27:02.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.899+0000 7f17a3400640 1 --2- 172.21.15.2:0/1036188877 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1788065150 0x7f1788067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.899+0000 7f17b0a00640 1 --2- 172.21.15.2:0/1036188877 >> [v2:172.21.15.145:6808/37423,v1:172.21.15.145:6809/37423] conn(0x7f178806b040 0x7f178806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.899+0000 7f17a3400640 1 --2- 172.21.15.2:0/1036188877 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1788065150 0x7f1788067600 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f17ac0ab5a0 tx=0x7f1794008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.900+0000 7f17b0a00640 1 --2- 172.21.15.2:0/1036188877 >> [v2:172.21.15.145:6808/37423,v1:172.21.15.145:6809/37423] conn(0x7f178806b040 0x7f178806d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.901+0000 7f17a3e00640 1 -- 172.21.15.2:0/1036188877 <== osd.6 v2:172.21.15.145:6808/37423 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f178806db00 con 0x7f178806b040 2024-08-17T02:27:02.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.913+0000 7f17b2a00640 1 -- 172.21.15.2:0/1036188877 --> [v2:172.21.15.145:6808/37423,v1:172.21.15.145:6809/37423] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f17ac067c10 con 0x7f178806b040 2024-08-17T02:27:02.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.914+0000 7f17a3e00640 1 -- 172.21.15.2:0/1036188877 <== osd.6 v2:172.21.15.145:6808/37423 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f17ac067c10 con 0x7f178806b040 2024-08-17T02:27:02.915 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-17T02:27:02.916 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:27:02.916 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-17T02:27:02.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.915+0000 7f17b2a00640 1 -- 172.21.15.2:0/1036188877 >> [v2:172.21.15.145:6808/37423,v1:172.21.15.145:6809/37423] conn(0x7f178806b040 msgr2=0x7f178806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.915+0000 7f17b2a00640 1 --2- 172.21.15.2:0/1036188877 >> [v2:172.21.15.145:6808/37423,v1:172.21.15.145:6809/37423] conn(0x7f178806b040 0x7f178806d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.915+0000 7f17b2a00640 1 -- 172.21.15.2:0/1036188877 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1788065150 msgr2=0x7f1788067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.915+0000 7f17b2a00640 1 --2- 172.21.15.2:0/1036188877 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f1788065150 0x7f1788067600 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f17ac0ab5a0 tx=0x7f1794008040 comp rx=0 tx=0).stop 2024-08-17T02:27:02.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.915+0000 7f17b2a00640 1 -- 172.21.15.2:0/1036188877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ac0ac000 msgr2=0x7f17ac1698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.915+0000 7f17b2a00640 1 --2- 172.21.15.2:0/1036188877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ac0ac000 0x7f17ac1698e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f179c00c960 tx=0x7f179c001670 comp rx=0 tx=0).stop 2024-08-17T02:27:02.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.915+0000 7f17b0a00640 1 -- 172.21.15.2:0/1036188877 reap_dead start 2024-08-17T02:27:02.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.915+0000 7f17b2a00640 1 -- 172.21.15.2:0/1036188877 shutdown_connections 2024-08-17T02:27:02.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.915+0000 7f17b2a00640 1 -- 172.21.15.2:0/1036188877 >> 172.21.15.2:0/1036188877 conn(0x7f17ac066e60 msgr2=0x7f17ac06e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.915+0000 7f17b2a00640 1 -- 172.21.15.2:0/1036188877 shutdown_connections 2024-08-17T02:27:02.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:02.915+0000 7f17b2a00640 1 -- 172.21.15.2:0/1036188877 wait complete. 2024-08-17T02:27:02.930 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-17T02:27:03.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.082+0000 7f334d400640 1 Processor -- start 2024-08-17T02:27:03.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.082+0000 7f334d400640 1 -- start start 2024-08-17T02:27:03.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.083+0000 7f334d400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3348155040 0x7f3348158c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.083+0000 7f334d400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33480aeeb0 con 0x7f334806e770 2024-08-17T02:27:03.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.083+0000 7f334d400640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33480aadd0 con 0x7f33481591c0 2024-08-17T02:27:03.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.083+0000 7f334d400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3348159610 con 0x7f3348155040 2024-08-17T02:27:03.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.084+0000 7f3346800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3348155040 0x7f3348158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.084+0000 7f3347200640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f334806e770 0x7f33480af340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48710/0 (socket says 172.21.15.2:48710) 2024-08-17T02:27:03.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.084+0000 7f3346800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3348155040 0x7f3348158c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37272/0 (socket says 172.21.15.2:37272) 2024-08-17T02:27:03.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.084+0000 7f3347200640 1 -- 172.21.15.2:0/2984692142 learned_addr learned my addr 172.21.15.2:0/2984692142 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:27:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.084+0000 7f3346800640 1 -- 172.21.15.2:0/2984692142 >> v1:172.21.15.145:6789/0 conn(0x7f33481591c0 legacy=0x7f334806e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.084+0000 7f3346800640 1 -- 172.21.15.2:0/2984692142 >> v1:172.21.15.2:6789/0 conn(0x7f334806e770 legacy=0x7f33480af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.084+0000 7f3346800640 1 -- 172.21.15.2:0/2984692142 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33481597f0 con 0x7f3348155040 2024-08-17T02:27:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.085+0000 7f3346800640 1 --2- 172.21.15.2:0/2984692142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3348155040 0x7f3348158c80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3338009850 tx=0x7f33380090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feba26b463a16519 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.085+0000 7f3345400640 1 -- 172.21.15.2:0/2984692142 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333802ad00 con 0x7f3348155040 2024-08-17T02:27:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.085+0000 7f3345400640 1 -- 172.21.15.2:0/2984692142 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333802ae60 con 0x7f3348155040 2024-08-17T02:27:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.085+0000 7f3345400640 1 -- 172.21.15.2:0/2984692142 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338032670 con 0x7f3348155040 2024-08-17T02:27:03.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.086+0000 7f334d400640 1 -- 172.21.15.2:0/2984692142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3348155040 msgr2=0x7f3348158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.086+0000 7f334d400640 1 --2- 172.21.15.2:0/2984692142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3348155040 0x7f3348158c80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3338009850 tx=0x7f33380090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.086+0000 7f334d400640 1 -- 172.21.15.2:0/2984692142 shutdown_connections 2024-08-17T02:27:03.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.086+0000 7f334d400640 1 --2- 172.21.15.2:0/2984692142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3348155040 0x7f3348158c80 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.086+0000 7f334d400640 1 -- 172.21.15.2:0/2984692142 >> 172.21.15.2:0/2984692142 conn(0x7f3348066e60 msgr2=0x7f3348067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:03.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.086+0000 7f334d400640 1 -- 172.21.15.2:0/2984692142 shutdown_connections 2024-08-17T02:27:03.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.086+0000 7f334d400640 1 -- 172.21.15.2:0/2984692142 wait complete. 2024-08-17T02:27:03.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.087+0000 7f334d400640 1 Processor -- start 2024-08-17T02:27:03.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.087+0000 7f334d400640 1 -- start start 2024-08-17T02:27:03.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.088+0000 7f334d400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f334806e770 0x7f33481665f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.088+0000 7f334d400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3348155040 0x7f33480a8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.088+0000 7f334d400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33481591c0 0x7f3348156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.088+0000 7f334d400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334816b0f0 con 0x7f334806e770 2024-08-17T02:27:03.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.088+0000 7f334d400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334816a4e0 con 0x7f3348155040 2024-08-17T02:27:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.088+0000 7f334d400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f334816a7c0 con 0x7f33481591c0 2024-08-17T02:27:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.088+0000 7f3346800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f334806e770 0x7f33481665f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.089+0000 7f3346800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f334806e770 0x7f33481665f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37280/0 (socket says 172.21.15.2:37280) 2024-08-17T02:27:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.089+0000 7f3346800640 1 -- 172.21.15.2:0/2882090342 learned_addr learned my addr 172.21.15.2:0/2882090342 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.089+0000 7f3347200640 1 --2- 172.21.15.2:0/2882090342 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33481591c0 0x7f3348156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.089+0000 7f3345e00640 1 --2- 172.21.15.2:0/2882090342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3348155040 0x7f33480a8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.089+0000 7f3346800640 1 -- 172.21.15.2:0/2882090342 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33481591c0 msgr2=0x7f3348156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.089+0000 7f3346800640 1 --2- 172.21.15.2:0/2882090342 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33481591c0 0x7f3348156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.089+0000 7f3346800640 1 -- 172.21.15.2:0/2882090342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3348155040 msgr2=0x7f33480a8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.089+0000 7f3346800640 1 --2- 172.21.15.2:0/2882090342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3348155040 0x7f33480a8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.089+0000 7f3346800640 1 -- 172.21.15.2:0/2882090342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3338009390 con 0x7f334806e770 2024-08-17T02:27:03.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.089+0000 7f3346800640 1 --2- 172.21.15.2:0/2882090342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f334806e770 0x7f33481665f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3338009360 tx=0x7f3338032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.089+0000 7f333e000640 1 -- 172.21.15.2:0/2882090342 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338032e20 con 0x7f334806e770 2024-08-17T02:27:03.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.090+0000 7f333e000640 1 -- 172.21.15.2:0/2882090342 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3338031a60 con 0x7f334806e770 2024-08-17T02:27:03.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.090+0000 7f333e000640 1 -- 172.21.15.2:0/2882090342 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338031e20 con 0x7f334806e770 2024-08-17T02:27:03.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.090+0000 7f334d400640 1 -- 172.21.15.2:0/2882090342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f334816aaa0 con 0x7f334806e770 2024-08-17T02:27:03.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.090+0000 7f334d400640 1 -- 172.21.15.2:0/2882090342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33480aa700 con 0x7f334806e770 2024-08-17T02:27:03.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.091+0000 7f334d400640 1 -- 172.21.15.2:0/2882090342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3348063fb0 con 0x7f334806e770 2024-08-17T02:27:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.092+0000 7f333e000640 1 -- 172.21.15.2:0/2882090342 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3338043030 con 0x7f334806e770 2024-08-17T02:27:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.092+0000 7f333e000640 1 --2- 172.21.15.2:0/2882090342 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3328065150 0x7f3328067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.092+0000 7f333e000640 1 -- 172.21.15.2:0/2882090342 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f3338041070 con 0x7f334806e770 2024-08-17T02:27:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.093+0000 7f3345e00640 1 --2- 172.21.15.2:0/2882090342 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3328065150 0x7f3328067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.094+0000 7f3345e00640 1 --2- 172.21.15.2:0/2882090342 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3328065150 0x7f3328067600 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f33480ca720 tx=0x7f3334009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.096+0000 7f333e000640 1 -- 172.21.15.2:0/2882090342 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3338070b90 con 0x7f334806e770 2024-08-17T02:27:03.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.279+0000 7f334d400640 1 -- 172.21.15.2:0/2882090342 --> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f334816af20 con 0x7f3328065150 2024-08-17T02:27:03.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.279+0000 7f333e000640 1 -- 172.21.15.2:0/2882090342 <== mgr.4108 v2:172.21.15.145:6832/36841 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3334003cd0 con 0x7f3328065150 2024-08-17T02:27:03.281 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 6 to deep-scrub 2024-08-17T02:27:03.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.281+0000 7f334d400640 1 -- 172.21.15.2:0/2882090342 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3328065150 msgr2=0x7f3328067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.281+0000 7f334d400640 1 --2- 172.21.15.2:0/2882090342 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3328065150 0x7f3328067600 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f33480ca720 tx=0x7f3334009040 comp rx=0 tx=0).stop 2024-08-17T02:27:03.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.281+0000 7f334d400640 1 -- 172.21.15.2:0/2882090342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f334806e770 msgr2=0x7f33481665f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.281+0000 7f334d400640 1 --2- 172.21.15.2:0/2882090342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f334806e770 0x7f33481665f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3338009360 tx=0x7f3338032000 comp rx=0 tx=0).stop 2024-08-17T02:27:03.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.281+0000 7f334d400640 1 -- 172.21.15.2:0/2882090342 shutdown_connections 2024-08-17T02:27:03.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.281+0000 7f334d400640 1 --2- 172.21.15.2:0/2882090342 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f3328065150 0x7f3328067600 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.281+0000 7f334d400640 1 --2- 172.21.15.2:0/2882090342 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33481591c0 0x7f3348156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.281+0000 7f334d400640 1 --2- 172.21.15.2:0/2882090342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3348155040 0x7f33480a8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.281+0000 7f334d400640 1 --2- 172.21.15.2:0/2882090342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f334806e770 0x7f33481665f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.281+0000 7f334d400640 1 -- 172.21.15.2:0/2882090342 >> 172.21.15.2:0/2882090342 conn(0x7f3348066e60 msgr2=0x7f33480c9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:03.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.282+0000 7f334d400640 1 -- 172.21.15.2:0/2882090342 shutdown_connections 2024-08-17T02:27:03.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.282+0000 7f334d400640 1 -- 172.21.15.2:0/2882090342 wait complete. 2024-08-17T02:27:03.297 INFO:tasks.ceph:Scrubbing osd.7 2024-08-17T02:27:03.297 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:27:03.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.452+0000 7f275ea00640 1 Processor -- start 2024-08-17T02:27:03.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.453+0000 7f275ea00640 1 -- start start 2024-08-17T02:27:03.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.454+0000 7f275ea00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2758067090 0x7f27580aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.454+0000 7f275ea00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f27580ac6b0 0x7f27581566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.454+0000 7f275ea00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27580aded0 con 0x7f2758067460 2024-08-17T02:27:03.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.454+0000 7f275ea00640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27580acad0 con 0x7f27580ac6b0 2024-08-17T02:27:03.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.454+0000 7f275ea00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27580cd7e0 con 0x7f2758067090 2024-08-17T02:27:03.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.454+0000 7f275cc00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2758067460 0x7f27580ccfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48718/0 (socket says 172.21.15.2:48718) 2024-08-17T02:27:03.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.454+0000 7f275cc00640 1 -- 172.21.15.2:0/2183243076 learned_addr learned my addr 172.21.15.2:0/2183243076 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:27:03.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.454+0000 7f275d600640 1 --2- 172.21.15.2:0/2183243076 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2758067090 0x7f27580aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.454+0000 7f275e000640 1 --2- 172.21.15.2:0/2183243076 >> v2:172.21.15.145:3300/0 conn(0x7f27580ac6b0 0x7f27581566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.455+0000 7f2757e00640 1 -- 172.21.15.2:0/2183243076 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060268710 0 0) 0x7f27580aded0 con 0x7f2758067460 2024-08-17T02:27:03.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.455+0000 7f2757e00640 1 -- 172.21.15.2:0/2183243076 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27400034e0 con 0x7f2758067460 2024-08-17T02:27:03.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.455+0000 7f275d600640 1 -- 172.21.15.2:0/2183243076 >> v2:172.21.15.145:3300/0 conn(0x7f27580ac6b0 msgr2=0x7f27581566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:03.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.455+0000 7f275d600640 1 --2- 172.21.15.2:0/2183243076 >> v2:172.21.15.145:3300/0 conn(0x7f27580ac6b0 0x7f27581566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.455+0000 7f275d600640 1 -- 172.21.15.2:0/2183243076 >> v1:172.21.15.2:6789/0 conn(0x7f2758067460 legacy=0x7f27580ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.455+0000 7f2757e00640 1 -- 172.21.15.2:0/2183243076 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 150494777 0 0) 0x7f27400034e0 con 0x7f2758067460 2024-08-17T02:27:03.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.455+0000 7f275d600640 1 -- 172.21.15.2:0/2183243076 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27580ae100 con 0x7f2758067090 2024-08-17T02:27:03.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.455+0000 7f275e000640 1 --2- 172.21.15.2:0/2183243076 >> v2:172.21.15.145:3300/0 conn(0x7f27580ac6b0 0x7f27581566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:03.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.456+0000 7f275d600640 1 --2- 172.21.15.2:0/2183243076 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2758067090 0x7f27580aeec0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f274c009850 tx=0x7f274c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4162b6ec6a5d589 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.456+0000 7f2757e00640 1 -- 172.21.15.2:0/2183243076 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744001470 con 0x7f2758067090 2024-08-17T02:27:03.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.457+0000 7f2757e00640 1 -- 172.21.15.2:0/2183243076 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274c02aae0 con 0x7f2758067090 2024-08-17T02:27:03.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.457+0000 7f2757e00640 1 -- 172.21.15.2:0/2183243076 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c02ae60 con 0x7f2758067090 2024-08-17T02:27:03.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.457+0000 7f275ea00640 1 -- 172.21.15.2:0/2183243076 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2758067090 msgr2=0x7f27580aeec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.457+0000 7f275ea00640 1 --2- 172.21.15.2:0/2183243076 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2758067090 0x7f27580aeec0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f274c009850 tx=0x7f274c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.457+0000 7f275ea00640 1 -- 172.21.15.2:0/2183243076 shutdown_connections 2024-08-17T02:27:03.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.457+0000 7f275ea00640 1 --2- 172.21.15.2:0/2183243076 >> v2:172.21.15.145:3300/0 conn(0x7f27580ac6b0 0x7f27581566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.457+0000 7f275ea00640 1 --2- 172.21.15.2:0/2183243076 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2758067090 0x7f27580aeec0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.457+0000 7f275ea00640 1 -- 172.21.15.2:0/2183243076 >> 172.21.15.2:0/2183243076 conn(0x7f27580689f0 msgr2=0x7f27580cc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:03.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.457+0000 7f275ea00640 1 -- 172.21.15.2:0/2183243076 shutdown_connections 2024-08-17T02:27:03.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.457+0000 7f275ea00640 1 -- 172.21.15.2:0/2183243076 wait complete. 2024-08-17T02:27:03.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.459+0000 7f275ea00640 1 Processor -- start 2024-08-17T02:27:03.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.459+0000 7f275ea00640 1 -- start start 2024-08-17T02:27:03.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.459+0000 7f275ea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2758067090 0x7f2758148470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.460+0000 7f275ea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2758067460 0x7f2758150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.460+0000 7f275ea00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27580ac6b0 0x7f2758151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.460+0000 7f275ea00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27580b0cc0 con 0x7f2758067460 2024-08-17T02:27:03.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.460+0000 7f275ea00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27580b00f0 con 0x7f2758067090 2024-08-17T02:27:03.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.460+0000 7f275ea00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27580b0390 con 0x7f27580ac6b0 2024-08-17T02:27:03.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.460+0000 7f275cc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2758067460 0x7f2758150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.460+0000 7f275cc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2758067460 0x7f2758150ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37288/0 (socket says 172.21.15.2:37288) 2024-08-17T02:27:03.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.460+0000 7f275cc00640 1 -- 172.21.15.2:0/628312721 learned_addr learned my addr 172.21.15.2:0/628312721 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:03.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.460+0000 7f275e000640 1 --2- 172.21.15.2:0/628312721 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27580ac6b0 0x7f2758151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.460+0000 7f275cc00640 1 -- 172.21.15.2:0/628312721 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27580ac6b0 msgr2=0x7f2758151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.460+0000 7f275d600640 1 --2- 172.21.15.2:0/628312721 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2758067090 0x7f2758148470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.460+0000 7f275cc00640 1 --2- 172.21.15.2:0/628312721 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27580ac6b0 0x7f2758151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.460+0000 7f275cc00640 1 -- 172.21.15.2:0/628312721 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2758067090 msgr2=0x7f2758148470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.460+0000 7f275cc00640 1 --2- 172.21.15.2:0/628312721 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2758067090 0x7f2758148470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.460+0000 7f275cc00640 1 -- 172.21.15.2:0/628312721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2750009a20 con 0x7f2758067460 2024-08-17T02:27:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.460+0000 7f275e000640 1 --2- 172.21.15.2:0/628312721 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27580ac6b0 0x7f2758151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.460+0000 7f275d600640 1 --2- 172.21.15.2:0/628312721 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2758067090 0x7f2758148470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.461+0000 7f275cc00640 1 --2- 172.21.15.2:0/628312721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2758067460 0x7f2758150ca0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f274400cb90 tx=0x7f2744001bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.461+0000 7f2754c00640 1 -- 172.21.15.2:0/628312721 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744007360 con 0x7f2758067460 2024-08-17T02:27:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.461+0000 7f2754c00640 1 -- 172.21.15.2:0/628312721 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27440074e0 con 0x7f2758067460 2024-08-17T02:27:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.461+0000 7f2754c00640 1 -- 172.21.15.2:0/628312721 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27440049f0 con 0x7f2758067460 2024-08-17T02:27:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.461+0000 7f275ea00640 1 -- 172.21.15.2:0/628312721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f274c009390 con 0x7f2758067460 2024-08-17T02:27:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.461+0000 7f275ea00640 1 -- 172.21.15.2:0/628312721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27580b0950 con 0x7f2758067460 2024-08-17T02:27:03.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.462+0000 7f275ea00640 1 -- 172.21.15.2:0/628312721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2758063f10 con 0x7f2758067460 2024-08-17T02:27:03.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.463+0000 7f2754c00640 1 -- 172.21.15.2:0/628312721 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f274400a640 con 0x7f2758067460 2024-08-17T02:27:03.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.464+0000 7f2754c00640 1 --2- 172.21.15.2:0/628312721 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2738065150 0x7f2738067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.464+0000 7f2754c00640 1 -- 172.21.15.2:0/628312721 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f27440817b0 con 0x7f2758067460 2024-08-17T02:27:03.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.464+0000 7f2754c00640 1 --2- 172.21.15.2:0/628312721 >> [v2:172.21.15.145:6813/37424,v1:172.21.15.145:6815/37424] conn(0x7f273806af70 0x7f273806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.464+0000 7f2754c00640 1 -- 172.21.15.2:0/628312721 --> [v2:172.21.15.145:6813/37424,v1:172.21.15.145:6815/37424] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f273806da30 con 0x7f273806af70 2024-08-17T02:27:03.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.464+0000 7f2754c00640 1 -- 172.21.15.2:0/628312721 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2744083d90 con 0x7f2758067460 2024-08-17T02:27:03.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.464+0000 7f275d600640 1 --2- 172.21.15.2:0/628312721 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2738065150 0x7f2738067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.464+0000 7f275e000640 1 --2- 172.21.15.2:0/628312721 >> [v2:172.21.15.145:6813/37424,v1:172.21.15.145:6815/37424] conn(0x7f273806af70 0x7f273806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.465+0000 7f275d600640 1 --2- 172.21.15.2:0/628312721 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2738065150 0x7f2738067600 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f274c034000 tx=0x7f274c032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.465+0000 7f275e000640 1 --2- 172.21.15.2:0/628312721 >> [v2:172.21.15.145:6813/37424,v1:172.21.15.145:6815/37424] conn(0x7f273806af70 0x7f273806d380 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.466+0000 7f2754c00640 1 -- 172.21.15.2:0/628312721 <== osd.7 v2:172.21.15.145:6813/37424 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f273806da30 con 0x7f273806af70 2024-08-17T02:27:03.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.479+0000 7f275ea00640 1 -- 172.21.15.2:0/628312721 --> [v2:172.21.15.145:6813/37424,v1:172.21.15.145:6815/37424] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f27580ca3f0 con 0x7f273806af70 2024-08-17T02:27:03.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.480+0000 7f2754c00640 1 -- 172.21.15.2:0/628312721 <== osd.7 v2:172.21.15.145:6813/37424 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f27580ca3f0 con 0x7f273806af70 2024-08-17T02:27:03.481 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-17T02:27:03.481 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:27:03.481 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-17T02:27:03.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.480+0000 7f275ea00640 1 -- 172.21.15.2:0/628312721 >> [v2:172.21.15.145:6813/37424,v1:172.21.15.145:6815/37424] conn(0x7f273806af70 msgr2=0x7f273806d380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.480+0000 7f275ea00640 1 --2- 172.21.15.2:0/628312721 >> [v2:172.21.15.145:6813/37424,v1:172.21.15.145:6815/37424] conn(0x7f273806af70 0x7f273806d380 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.480+0000 7f275ea00640 1 -- 172.21.15.2:0/628312721 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2738065150 msgr2=0x7f2738067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.480+0000 7f275ea00640 1 --2- 172.21.15.2:0/628312721 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f2738065150 0x7f2738067600 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f274c034000 tx=0x7f274c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:03.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.480+0000 7f275ea00640 1 -- 172.21.15.2:0/628312721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2758067460 msgr2=0x7f2758150ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.480+0000 7f275ea00640 1 --2- 172.21.15.2:0/628312721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2758067460 0x7f2758150ca0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f274400cb90 tx=0x7f2744001bd0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.480+0000 7f275e000640 1 -- 172.21.15.2:0/628312721 reap_dead start 2024-08-17T02:27:03.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.480+0000 7f275ea00640 1 -- 172.21.15.2:0/628312721 shutdown_connections 2024-08-17T02:27:03.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.480+0000 7f275ea00640 1 -- 172.21.15.2:0/628312721 >> 172.21.15.2:0/628312721 conn(0x7f27580689f0 msgr2=0x7f275815f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:03.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.480+0000 7f275ea00640 1 -- 172.21.15.2:0/628312721 shutdown_connections 2024-08-17T02:27:03.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.480+0000 7f275ea00640 1 -- 172.21.15.2:0/628312721 wait complete. 2024-08-17T02:27:03.495 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-17T02:27:03.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.647+0000 7f7f8c800640 1 Processor -- start 2024-08-17T02:27:03.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.647+0000 7f7f8c800640 1 -- start start 2024-08-17T02:27:03.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.648+0000 7f7f8c800640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7f840ae8d0 0x7f7f840aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.649+0000 7f7f8c800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f840c9ed0 0x7f7f8415f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.649+0000 7f7f8c800640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f840cb180 con 0x7f7f840aff50 2024-08-17T02:27:03.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.649+0000 7f7f8c800640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f840ad410 con 0x7f7f840ae8d0 2024-08-17T02:27:03.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.649+0000 7f7f8c800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840ad6b0 con 0x7f7f840c9ed0 2024-08-17T02:27:03.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.649+0000 7f7f89400640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f7f840aff50 0x7f7f840aeca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:37446/0 (socket says 172.21.15.2:37446) 2024-08-17T02:27:03.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.649+0000 7f7f89400640 1 -- 172.21.15.2:0/3945799099 learned_addr learned my addr 172.21.15.2:0/3945799099 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:27:03.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.649+0000 7f7f89e00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7f840ae8d0 0x7f7f840aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.649+0000 7f7f8a800640 1 --2- 172.21.15.2:0/3945799099 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f840c9ed0 0x7f7f8415f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.650+0000 7f7f88a00640 1 -- 172.21.15.2:0/3945799099 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299053872 0 0) 0x7f7f840cb180 con 0x7f7f840aff50 2024-08-17T02:27:03.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.650+0000 7f7f88a00640 1 -- 172.21.15.2:0/3945799099 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f6c0034e0 con 0x7f7f840aff50 2024-08-17T02:27:03.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.650+0000 7f7f8a800640 1 -- 172.21.15.2:0/3945799099 >> v2:172.21.15.145:3300/0 conn(0x7f7f840ae8d0 msgr2=0x7f7f840aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:03.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.650+0000 7f7f8a800640 1 --2- 172.21.15.2:0/3945799099 >> v2:172.21.15.145:3300/0 conn(0x7f7f840ae8d0 0x7f7f840aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.650+0000 7f7f8a800640 1 -- 172.21.15.2:0/3945799099 >> v1:172.21.15.145:6789/0 conn(0x7f7f840aff50 legacy=0x7f7f840aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.650+0000 7f7f8a800640 1 -- 172.21.15.2:0/3945799099 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f840ad990 con 0x7f7f840c9ed0 2024-08-17T02:27:03.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.650+0000 7f7f89e00640 1 --2- 172.21.15.2:0/3945799099 >> v2:172.21.15.145:3300/0 conn(0x7f7f840ae8d0 0x7f7f840aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:03.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.651+0000 7f7f8a800640 1 --2- 172.21.15.2:0/3945799099 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f840c9ed0 0x7f7f8415f600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009e60 tx=0x7f7f80009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ed02a3badcab3ab server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.651+0000 7f7f88a00640 1 -- 172.21.15.2:0/3945799099 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80007550 con 0x7f7f840c9ed0 2024-08-17T02:27:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.651+0000 7f7f88a00640 1 -- 172.21.15.2:0/3945799099 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8002d050 con 0x7f7f840c9ed0 2024-08-17T02:27:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.651+0000 7f7f88a00640 1 -- 172.21.15.2:0/3945799099 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80007920 con 0x7f7f840c9ed0 2024-08-17T02:27:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.652+0000 7f7f8c800640 1 -- 172.21.15.2:0/3945799099 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f840c9ed0 msgr2=0x7f7f8415f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.652+0000 7f7f8c800640 1 --2- 172.21.15.2:0/3945799099 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f840c9ed0 0x7f7f8415f600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009e60 tx=0x7f7f80009780 comp rx=0 tx=0).stop 2024-08-17T02:27:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.652+0000 7f7f8c800640 1 -- 172.21.15.2:0/3945799099 shutdown_connections 2024-08-17T02:27:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.652+0000 7f7f8c800640 1 --2- 172.21.15.2:0/3945799099 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f840c9ed0 0x7f7f8415f600 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.652+0000 7f7f8c800640 1 --2- 172.21.15.2:0/3945799099 >> v2:172.21.15.145:3300/0 conn(0x7f7f840ae8d0 0x7f7f840aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.652+0000 7f7f8c800640 1 -- 172.21.15.2:0/3945799099 >> 172.21.15.2:0/3945799099 conn(0x7f7f84066e60 msgr2=0x7f7f84067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.652+0000 7f7f8c800640 1 -- 172.21.15.2:0/3945799099 shutdown_connections 2024-08-17T02:27:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.652+0000 7f7f8c800640 1 -- 172.21.15.2:0/3945799099 wait complete. 2024-08-17T02:27:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.653+0000 7f7f8c800640 1 Processor -- start 2024-08-17T02:27:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.654+0000 7f7f8c800640 1 -- start start 2024-08-17T02:27:03.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.654+0000 7f7f8c800640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f840ae8d0 0x7f7f840c1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.654+0000 7f7f8c800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f840aff50 0x7f7f84150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.654+0000 7f7f8c800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f840c9ed0 0x7f7f84157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.654+0000 7f7f8c800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f84150bb0 con 0x7f7f840c9ed0 2024-08-17T02:27:03.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.654+0000 7f7f8c800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f84164aa0 con 0x7f7f840aff50 2024-08-17T02:27:03.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.654+0000 7f7f8c800640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f841584c0 con 0x7f7f840ae8d0 2024-08-17T02:27:03.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.655+0000 7f7f8a800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f840c9ed0 0x7f7f84157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.655+0000 7f7f8a800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f840c9ed0 0x7f7f84157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37304/0 (socket says 172.21.15.2:37304) 2024-08-17T02:27:03.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.655+0000 7f7f8a800640 1 -- 172.21.15.2:0/1013449578 learned_addr learned my addr 172.21.15.2:0/1013449578 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:03.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.655+0000 7f7f89e00640 1 --2- 172.21.15.2:0/1013449578 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f840ae8d0 0x7f7f840c1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.655+0000 7f7f89400640 1 --2- 172.21.15.2:0/1013449578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f840aff50 0x7f7f84150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.655+0000 7f7f8a800640 1 -- 172.21.15.2:0/1013449578 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f840ae8d0 msgr2=0x7f7f840c1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.655+0000 7f7f8a800640 1 --2- 172.21.15.2:0/1013449578 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f840ae8d0 0x7f7f840c1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.655+0000 7f7f8a800640 1 -- 172.21.15.2:0/1013449578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f840aff50 msgr2=0x7f7f84150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.655+0000 7f7f8a800640 1 --2- 172.21.15.2:0/1013449578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f840aff50 0x7f7f84150670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.655+0000 7f7f8a800640 1 -- 172.21.15.2:0/1013449578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f78009390 con 0x7f7f840c9ed0 2024-08-17T02:27:03.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.656+0000 7f7f8a800640 1 --2- 172.21.15.2:0/1013449578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f840c9ed0 0x7f7f84157c20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7f800099f0 tx=0x7f7f80037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.656+0000 7f7f7d600640 1 -- 172.21.15.2:0/1013449578 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80031aa0 con 0x7f7f840c9ed0 2024-08-17T02:27:03.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.656+0000 7f7f7d600640 1 -- 172.21.15.2:0/1013449578 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f80031c00 con 0x7f7f840c9ed0 2024-08-17T02:27:03.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.656+0000 7f7f7d600640 1 -- 172.21.15.2:0/1013449578 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80045460 con 0x7f7f840c9ed0 2024-08-17T02:27:03.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.656+0000 7f7f8c800640 1 -- 172.21.15.2:0/1013449578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f80009a20 con 0x7f7f840c9ed0 2024-08-17T02:27:03.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.656+0000 7f7f8c800640 1 -- 172.21.15.2:0/1013449578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f84158a80 con 0x7f7f840c9ed0 2024-08-17T02:27:03.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.657+0000 7f7f8c800640 1 -- 172.21.15.2:0/1013449578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f84063fb0 con 0x7f7f840c9ed0 2024-08-17T02:27:03.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.658+0000 7f7f7d600640 1 -- 172.21.15.2:0/1013449578 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7f800457d0 con 0x7f7f840c9ed0 2024-08-17T02:27:03.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.659+0000 7f7f7d600640 1 --2- 172.21.15.2:0/1013449578 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7f68065150 0x7f7f68067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.659+0000 7f7f7d600640 1 -- 172.21.15.2:0/1013449578 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f7f800a3650 con 0x7f7f840c9ed0 2024-08-17T02:27:03.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.659+0000 7f7f89e00640 1 --2- 172.21.15.2:0/1013449578 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7f68065150 0x7f7f68067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.660+0000 7f7f89e00640 1 --2- 172.21.15.2:0/1013449578 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7f68065150 0x7f7f68067600 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009360 tx=0x7f7f78008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.663+0000 7f7f7d600640 1 -- 172.21.15.2:0/1013449578 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7f80071910 con 0x7f7f840c9ed0 2024-08-17T02:27:03.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.845+0000 7f7f8c800640 1 -- 172.21.15.2:0/1013449578 --> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f84155b80 con 0x7f7f68065150 2024-08-17T02:27:03.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.845+0000 7f7f7d600640 1 -- 172.21.15.2:0/1013449578 <== mgr.4108 v2:172.21.15.145:6832/36841 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7f84155b80 con 0x7f7f68065150 2024-08-17T02:27:03.847 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 7 to deep-scrub 2024-08-17T02:27:03.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.847+0000 7f7f8c800640 1 -- 172.21.15.2:0/1013449578 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7f68065150 msgr2=0x7f7f68067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.847+0000 7f7f8c800640 1 --2- 172.21.15.2:0/1013449578 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7f68065150 0x7f7f68067600 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009360 tx=0x7f7f78008040 comp rx=0 tx=0).stop 2024-08-17T02:27:03.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.847+0000 7f7f8c800640 1 -- 172.21.15.2:0/1013449578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f840c9ed0 msgr2=0x7f7f84157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.847+0000 7f7f8c800640 1 --2- 172.21.15.2:0/1013449578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f840c9ed0 0x7f7f84157c20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7f800099f0 tx=0x7f7f80037000 comp rx=0 tx=0).stop 2024-08-17T02:27:03.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.847+0000 7f7f8c800640 1 -- 172.21.15.2:0/1013449578 shutdown_connections 2024-08-17T02:27:03.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.847+0000 7f7f8c800640 1 --2- 172.21.15.2:0/1013449578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f840c9ed0 0x7f7f84157c20 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.847+0000 7f7f8c800640 1 --2- 172.21.15.2:0/1013449578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f840aff50 0x7f7f84150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.847+0000 7f7f8c800640 1 --2- 172.21.15.2:0/1013449578 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f7f68065150 0x7f7f68067600 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.847+0000 7f7f8c800640 1 --2- 172.21.15.2:0/1013449578 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f840ae8d0 0x7f7f840c1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.847+0000 7f7f8c800640 1 -- 172.21.15.2:0/1013449578 >> 172.21.15.2:0/1013449578 conn(0x7f7f84066e60 msgr2=0x7f7f8406d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:03.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.847+0000 7f7f8c800640 1 -- 172.21.15.2:0/1013449578 shutdown_connections 2024-08-17T02:27:03.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:03.847+0000 7f7f8c800640 1 -- 172.21.15.2:0/1013449578 wait complete. 2024-08-17T02:27:03.863 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:04.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.014+0000 7f61d0600640 1 Processor -- start 2024-08-17T02:27:04.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.014+0000 7f61d0600640 1 -- start start 2024-08-17T02:27:04.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.015+0000 7f61d0600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f61c80ad960 0x7f61c815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.015+0000 7f61d0600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c815b5e0 con 0x7f61c80ca050 2024-08-17T02:27:04.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.015+0000 7f61d0600640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c80cb160 con 0x7f61c80add30 2024-08-17T02:27:04.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.015+0000 7f61d0600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c80b0d10 con 0x7f61c80ad960 2024-08-17T02:27:04.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.016+0000 7f61cd200640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f61c80ca050 0x7f61c8156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48734/0 (socket says 172.21.15.2:48734) 2024-08-17T02:27:04.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.016+0000 7f61cd200640 1 -- 172.21.15.2:0/1067144289 learned_addr learned my addr 172.21.15.2:0/1067144289 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:27:04.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.016+0000 7f61cdc00640 1 --2- 172.21.15.2:0/1067144289 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f61c80ad960 0x7f61c815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.016+0000 7f61c7e00640 1 -- 172.21.15.2:0/1067144289 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2152697200 0 0) 0x7f61c80cb160 con 0x7f61c80add30 2024-08-17T02:27:04.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.016+0000 7f61c7e00640 1 -- 172.21.15.2:0/1067144289 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61b00034e0 con 0x7f61c80add30 2024-08-17T02:27:04.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.016+0000 7f61c7e00640 1 -- 172.21.15.2:0/1067144289 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350768363 0 0) 0x7f61b4001110 con 0x7f61c80ca050 2024-08-17T02:27:04.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.016+0000 7f61c7e00640 1 -- 172.21.15.2:0/1067144289 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61c80cb160 con 0x7f61c80ca050 2024-08-17T02:27:04.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.016+0000 7f61cdc00640 1 -- 172.21.15.2:0/1067144289 >> v1:172.21.15.145:6789/0 conn(0x7f61c80add30 legacy=0x7f61c80aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.016+0000 7f61cdc00640 1 -- 172.21.15.2:0/1067144289 >> v1:172.21.15.2:6789/0 conn(0x7f61c80ca050 legacy=0x7f61c8156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.016+0000 7f61cdc00640 1 -- 172.21.15.2:0/1067144289 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c80ca550 con 0x7f61c80ad960 2024-08-17T02:27:04.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.018+0000 7f61cdc00640 1 --2- 172.21.15.2:0/1067144289 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f61c80ad960 0x7f61c815b0a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f61bc009880 tx=0x7f61bc0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0610d1a65c5bf65 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:04.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.018+0000 7f61c7e00640 1 -- 172.21.15.2:0/1067144289 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc02aea0 con 0x7f61c80ad960 2024-08-17T02:27:04.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.018+0000 7f61c7e00640 1 -- 172.21.15.2:0/1067144289 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc032440 con 0x7f61c80ad960 2024-08-17T02:27:04.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.018+0000 7f61c7e00640 1 -- 172.21.15.2:0/1067144289 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc0327c0 con 0x7f61c80ad960 2024-08-17T02:27:04.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.019+0000 7f61d0600640 1 -- 172.21.15.2:0/1067144289 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f61c80ad960 msgr2=0x7f61c815b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.019+0000 7f61d0600640 1 --2- 172.21.15.2:0/1067144289 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f61c80ad960 0x7f61c815b0a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f61bc009880 tx=0x7f61bc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.019+0000 7f61d0600640 1 -- 172.21.15.2:0/1067144289 shutdown_connections 2024-08-17T02:27:04.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.019+0000 7f61d0600640 1 --2- 172.21.15.2:0/1067144289 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f61c80ad960 0x7f61c815b0a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.019+0000 7f61d0600640 1 -- 172.21.15.2:0/1067144289 >> 172.21.15.2:0/1067144289 conn(0x7f61c8066e60 msgr2=0x7f61c8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:04.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.019+0000 7f61d0600640 1 -- 172.21.15.2:0/1067144289 shutdown_connections 2024-08-17T02:27:04.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.019+0000 7f61d0600640 1 -- 172.21.15.2:0/1067144289 wait complete. 2024-08-17T02:27:04.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.020+0000 7f61d0600640 1 Processor -- start 2024-08-17T02:27:04.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.020+0000 7f61d0600640 1 -- start start 2024-08-17T02:27:04.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.021+0000 7f61d0600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f61c80ad960 0x7f61c8144300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.021+0000 7f61d0600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61c80add30 0x7f61c806a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.021+0000 7f61d0600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f61c80ca050 0x7f61c806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.021+0000 7f61d0600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c8159ee0 con 0x7f61c80add30 2024-08-17T02:27:04.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.021+0000 7f61d0600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c814f8c0 con 0x7f61c80ca050 2024-08-17T02:27:04.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.021+0000 7f61d0600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c81592d0 con 0x7f61c80ad960 2024-08-17T02:27:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.021+0000 7f61cd200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61c80add30 0x7f61c806a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.021+0000 7f61cd200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61c80add30 0x7f61c806a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37318/0 (socket says 172.21.15.2:37318) 2024-08-17T02:27:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.021+0000 7f61cd200640 1 -- 172.21.15.2:0/1733500359 learned_addr learned my addr 172.21.15.2:0/1733500359 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.022+0000 7f61cdc00640 1 --2- 172.21.15.2:0/1733500359 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f61c80ad960 0x7f61c8144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.022+0000 7f61ce600640 1 --2- 172.21.15.2:0/1733500359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f61c80ca050 0x7f61c806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.022+0000 7f61cd200640 1 -- 172.21.15.2:0/1733500359 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f61c80ad960 msgr2=0x7f61c8144300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.022+0000 7f61cd200640 1 --2- 172.21.15.2:0/1733500359 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f61c80ad960 0x7f61c8144300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.022+0000 7f61cd200640 1 -- 172.21.15.2:0/1733500359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f61c80ca050 msgr2=0x7f61c806a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.022+0000 7f61cd200640 1 --2- 172.21.15.2:0/1733500359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f61c80ca050 0x7f61c806a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.022+0000 7f61cd200640 1 -- 172.21.15.2:0/1733500359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61bc009390 con 0x7f61c80add30 2024-08-17T02:27:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.022+0000 7f61ce600640 1 --2- 172.21.15.2:0/1733500359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f61c80ca050 0x7f61c806a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.022+0000 7f61cd200640 1 --2- 172.21.15.2:0/1733500359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61c80add30 0x7f61c806a390 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f61b400c7f0 tx=0x7f61b4007b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.022+0000 7f61c4c00640 1 -- 172.21.15.2:0/1733500359 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b4005870 con 0x7f61c80add30 2024-08-17T02:27:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.023+0000 7f61c4c00640 1 -- 172.21.15.2:0/1733500359 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b40059d0 con 0x7f61c80add30 2024-08-17T02:27:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.023+0000 7f61c4c00640 1 -- 172.21.15.2:0/1733500359 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b4005d90 con 0x7f61c80add30 2024-08-17T02:27:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.023+0000 7f61d0600640 1 -- 172.21.15.2:0/1733500359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c81595b0 con 0x7f61c80add30 2024-08-17T02:27:04.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.023+0000 7f61d0600640 1 -- 172.21.15.2:0/1733500359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c8159b70 con 0x7f61c80add30 2024-08-17T02:27:04.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.024+0000 7f61d0600640 1 -- 172.21.15.2:0/1733500359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c815a090 con 0x7f61c80add30 2024-08-17T02:27:04.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.025+0000 7f61c4c00640 1 -- 172.21.15.2:0/1733500359 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f61b4007300 con 0x7f61c80add30 2024-08-17T02:27:04.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.025+0000 7f61c4c00640 1 --2- 172.21.15.2:0/1733500359 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f61a8065180 0x7f61a8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.025+0000 7f61c4c00640 1 -- 172.21.15.2:0/1733500359 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f61b4081380 con 0x7f61c80add30 2024-08-17T02:27:04.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.026+0000 7f61cdc00640 1 --2- 172.21.15.2:0/1733500359 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f61a8065180 0x7f61a8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.026+0000 7f61cdc00640 1 --2- 172.21.15.2:0/1733500359 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f61a8065180 0x7f61a8067630 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f61bc034000 tx=0x7f61bc032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:04.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.029+0000 7f61c4c00640 1 -- 172.21.15.2:0/1733500359 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f61c815a090 con 0x7f61c80add30 2024-08-17T02:27:04.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.207+0000 7f61d0600640 1 -- 172.21.15.2:0/1733500359 --> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f61c815b5e0 con 0x7f61a8065180 2024-08-17T02:27:04.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.211+0000 7f61c4c00640 1 -- 172.21.15.2:0/1733500359 <== mgr.4108 v2:172.21.15.145:6832/36841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50787 (secure 0 0 0) 0x7f61c815b5e0 con 0x7f61a8065180 2024-08-17T02:27:04.212 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:27:04.212 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-17T02:27:04.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.212+0000 7f61d0600640 1 -- 172.21.15.2:0/1733500359 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f61a8065180 msgr2=0x7f61a8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.212+0000 7f61d0600640 1 --2- 172.21.15.2:0/1733500359 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f61a8065180 0x7f61a8067630 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f61bc034000 tx=0x7f61bc032000 comp rx=0 tx=0).stop 2024-08-17T02:27:04.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.212+0000 7f61d0600640 1 -- 172.21.15.2:0/1733500359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61c80add30 msgr2=0x7f61c806a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.212+0000 7f61d0600640 1 --2- 172.21.15.2:0/1733500359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61c80add30 0x7f61c806a390 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f61b400c7f0 tx=0x7f61b4007b80 comp rx=0 tx=0).stop 2024-08-17T02:27:04.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.212+0000 7f61d0600640 1 -- 172.21.15.2:0/1733500359 shutdown_connections 2024-08-17T02:27:04.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.212+0000 7f61d0600640 1 --2- 172.21.15.2:0/1733500359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f61c80ca050 0x7f61c806a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.212+0000 7f61d0600640 1 --2- 172.21.15.2:0/1733500359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61c80add30 0x7f61c806a390 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.212+0000 7f61d0600640 1 --2- 172.21.15.2:0/1733500359 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f61a8065180 0x7f61a8067630 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.212+0000 7f61d0600640 1 --2- 172.21.15.2:0/1733500359 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f61c80ad960 0x7f61c8144300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.212+0000 7f61d0600640 1 -- 172.21.15.2:0/1733500359 >> 172.21.15.2:0/1733500359 conn(0x7f61c8066e60 msgr2=0x7f61c8152710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:04.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.212+0000 7f61d0600640 1 -- 172.21.15.2:0/1733500359 shutdown_connections 2024-08-17T02:27:04.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:04.213+0000 7f61d0600640 1 -- 172.21.15.2:0/1733500359 wait complete. 2024-08-17T02:27:04.230 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-08-17T02:27:04.108363+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2400576,"kb_used_data":5064,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574144,"statfs":{"total":773094113280,"available":770635923456,"internally_reserved":0,"allocated":5185536,"data_stored":2826128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.601954"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-08-17T02:26:52.501953+0000","last_change":"2024-08-17T02:23:27.953699+0000","last_active":"2024-08-17T02:26:52.501953+0000","last_peered":"2024-08-17T02:26:52.501953+0000","last_clean":"2024-08-17T02:26:52.501953+0000","last_became_active":"2024-08-17T02:23:27.952879+0000","last_became_peered":"2024-08-17T02:23:27.952879+0000","last_unstale":"2024-08-17T02:26:52.501953+0000","last_undegraded":"2024-08-17T02:26:52.501953+0000","last_fullsized":"2024-08-17T02:26:52.501953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:26.811202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:26.811202+0000","last_clean_scrub_stamp":"2024-08-17T02:23:26.811202+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:48.565059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298428,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073412,"statfs":{"total":96636764160,"available":96331173888,"internally_reserved":0,"allocated":1093632,"data_stored":796042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68700000000000006,"15min":0.66900000000000004},"min":{"1min":0.55900000000000005,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86099999999999999,"5min":1.8,"15min":1.8},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.66800000000000004,"15min":0.61499999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.024,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.51600000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.70499999999999996,"15min":0.66100000000000003},"min":{"1min":0.66300000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98699999999999999,"5min":1.022,"15min":1.022},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.74299999999999999,"15min":0.69699999999999995},"min":{"1min":0.53200000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96899999999999997,"5min":2.8039999999999998,"15min":2.8039999999999998},"last":0.58999999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.65900000000000003,"15min":0.623},"min":{"1min":0.53800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.93100000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.69999999999999996,"15min":0.67000000000000004},"min":{"1min":0.64900000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.75700000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.66400000000000003,"15min":0.626},"min":{"1min":0.63500000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.94099999999999995,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76300000000000001,"15min":0.754},"min":{"1min":0.624,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.95299999999999996,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.88}]},{"osd":4,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.60299999999999998,"15min":0.59399999999999997},"min":{"1min":0.42299999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80500000000000005,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.41499999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81100000000000005,"5min":0.88,"15min":0.88},"last":0.96799999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65400000000000003,"15min":0.66300000000000003},"min":{"1min":0.44900000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.98099999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68799999999999994,"15min":0.67200000000000004},"min":{"1min":0.47399999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.86799999999999999,"5min":2.7090000000000001,"15min":2.7090000000000001},"last":0.77200000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.75700000000000001,"15min":0.745},"min":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.878,"5min":2.742,"15min":2.742},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69199999999999995,"15min":0.68600000000000005},"min":{"1min":0.56999999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88800000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.73699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297852,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073988,"statfs":{"total":96636764160,"available":96331763712,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66500000000000004,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89900000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68700000000000006,"15min":0.68300000000000005},"min":{"1min":0.52700000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.94899999999999995,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.66800000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70499999999999996,"15min":0.69999999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.877,"5min":1.268,"15min":1.268},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68899999999999995,"15min":0.68100000000000005},"min":{"1min":0.49399999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86199999999999999,"5min":1.383,"15min":1.383},"last":0.79800000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.55900000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96799999999999997,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.75700000000000001,"15min":0.74099999999999999},"min":{"1min":0.57599999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.01,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.77400000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.56699999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.96899999999999997,"5min":1.528,"15min":1.528},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78500000000000003,"15min":0.79900000000000004},"min":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.94199999999999995,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.63100000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63200000000000001,"15min":0.64200000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.65800000000000003,"15min":0.67100000000000004},"min":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90700000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.72799999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.67400000000000004,"15min":0.69799999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.84999999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68200000000000005,"15min":0.68899999999999995},"min":{"1min":0.52700000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88800000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.755}]},{"osd":7,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72699999999999998,"15min":0.74299999999999999},"min":{"1min":0.502,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.83499999999999996,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.76000000000000001,"15min":0.77900000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97699999999999998,"5min":1.014,"15min":1.014},"last":0.82699999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297848,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073992,"statfs":{"total":96636764160,"available":96331767808,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.69599999999999995,"15min":0.66100000000000003},"min":{"1min":0.65200000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.63},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.52000000000000002,"5min":0.495,"15min":0.495},"max":{"1min":0.996,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.68200000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.72499999999999998,"15min":0.70099999999999996},"min":{"1min":0.68899999999999995,"5min":0.497,"15min":0.497},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.75},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72199999999999998,"15min":0.70199999999999996},"min":{"1min":0.55000000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96199999999999997,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.65900000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.73699999999999999,"15min":0.72099999999999997},"min":{"1min":0.57899999999999996,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.77100000000000002,"15min":0.75700000000000001},"min":{"1min":0.72099999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.78800000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71799999999999997,"15min":0.70999999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.91400000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.504},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.78000000000000003,"15min":0.77200000000000002},"min":{"1min":0.66900000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.77400000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.47499999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85499999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63900000000000001,"15min":0.65000000000000002},"min":{"1min":0.45100000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.81100000000000005,"5min":0.874,"15min":0.874},"last":0.55600000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65400000000000003,"15min":0.68000000000000005},"min":{"1min":0.51400000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91500000000000004,"5min":1.03,"15min":1.03},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69699999999999995,"15min":0.72199999999999998},"min":{"1min":0.54300000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89100000000000001,"5min":1.026,"15min":1.026},"last":0.81999999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69499999999999995,"15min":0.70999999999999996},"min":{"1min":0.55000000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.79400000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.746,"15min":0.78000000000000003},"min":{"1min":0.55800000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98899999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.81000000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297844,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71799999999999997,"15min":0.71299999999999997},"min":{"1min":0.52500000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86899999999999999,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77500000000000002,"15min":0.78800000000000003},"min":{"1min":0.58099999999999996,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91200000000000003,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.626}]},{"osd":1,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.753,"15min":0.747},"min":{"1min":0.65500000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89100000000000001,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73899999999999999,"15min":0.73599999999999999},"min":{"1min":0.58299999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.90200000000000002,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.70699999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67700000000000005,"15min":0.67900000000000005},"min":{"1min":0.56299999999999994,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.78600000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71199999999999997,"15min":0.70899999999999996},"min":{"1min":0.61699999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.86299999999999999,"5min":1.022,"15min":1.022},"last":0.67600000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.66500000000000004},"min":{"1min":0.53300000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85199999999999998,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72899999999999998,"15min":0.72699999999999998},"min":{"1min":0.54200000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.85699999999999998,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.69399999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.61499999999999999,"15min":0.629},"min":{"1min":0.41299999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75900000000000001,"5min":1.069,"15min":1.069},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.48899999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.872,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.54900000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.64000000000000001,"15min":0.66000000000000003},"min":{"1min":0.45500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.72199999999999998,"5min":1.012,"15min":1.012},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.72799999999999998,"15min":0.746},"min":{"1min":0.47599999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.85799999999999998,"5min":1.325,"15min":1.325},"last":0.72599999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.69299999999999995,"15min":0.69799999999999995},"min":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.83299999999999996,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.871,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.61899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302004,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069836,"statfs":{"total":96636764160,"available":96327512064,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.44800000000000001,"15min":0.45800000000000002},"min":{"1min":0.33900000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.56899999999999995,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.438},{"interface":"front","average":{"1min":0.502,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.35999999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67700000000000005,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.39300000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67400000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.45800000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73399999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.54500000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.438,"5min":0.377,"15min":0.377},"max":{"1min":0.67600000000000005,"5min":0.875,"15min":0.875},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.47399999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.36899999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.60499999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81999999999999995,"15min":0.84399999999999997},"min":{"1min":0.67600000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.079,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.78800000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81699999999999995,"15min":0.83699999999999997},"min":{"1min":0.63100000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.85599999999999998},"min":{"1min":0.62,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.145,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.83299999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.84399999999999997,"15min":0.86499999999999999},"min":{"1min":0.68300000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.147,"5min":1.353,"15min":1.353},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.84199999999999997,"15min":0.84999999999999998},"min":{"1min":0.63700000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.69099999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85099999999999998,"15min":0.879},"min":{"1min":0.66400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2010000000000001,"5min":1.28,"15min":1.28},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.85999999999999999,"15min":0.875},"min":{"1min":0.68400000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.165,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.72199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302008,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069832,"statfs":{"total":96636764160,"available":96327507968,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.61899999999999999,"15min":0.70899999999999996},"min":{"1min":0.33900000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.59199999999999997,"5min":6.9820000000000002,"15min":6.9820000000000002},"last":0.313},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.61199999999999999,"15min":0.67100000000000004},"min":{"1min":0.34599999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67400000000000004,"5min":5.1269999999999998,"15min":5.1269999999999998},"last":0.45700000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.73899999999999999,"15min":0.82899999999999996},"min":{"1min":0.42899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73399999999999999,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.69499999999999995,"15min":0.747},"min":{"1min":0.438,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.73899999999999999,"5min":4.9589999999999996,"15min":4.9589999999999996},"last":0.49199999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51600000000000001,"15min":0.53000000000000003},"min":{"1min":0.35599999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.66800000000000004,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.76800000000000002,"15min":0.86199999999999999},"min":{"1min":0.41999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.70099999999999996,"5min":7.0419999999999998,"15min":7.0419999999999998},"last":0.53100000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.93100000000000005,"15min":1.0129999999999999},"min":{"1min":0.57899999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.083,"5min":7.0880000000000001,"15min":7.0880000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.86499999999999999,"15min":0.91500000000000004},"min":{"1min":0.57699999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.03,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.77700000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.83999999999999997,"15min":0.88},"min":{"1min":0.56499999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.99299999999999999,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.99299999999999999,"15min":1.069},"min":{"1min":0.70699999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.0149999999999999,"5min":7.133,"15min":7.133},"last":0.746}]},{"osd":6,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.88100000000000001,"15min":0.93899999999999995},"min":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.107,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.878,"15min":0.92500000000000004},"min":{"1min":0.55900000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1479999999999999,"5min":4.0570000000000004,"15min":4.0570000000000004},"last":0.72699999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.95599999999999996,"15min":1.01},"min":{"1min":0.60799999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2170000000000001,"5min":4.726,"15min":4.726},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.92100000000000004,"15min":0.96899999999999997},"min":{"1min":0.61399999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0720000000000001,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.623}]}]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302004,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069836,"statfs":{"total":96636764160,"available":96327512064,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.59099999999999997,"15min":0.66500000000000004},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.55700000000000005,"5min":4.4420000000000002,"15min":4.4420000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.68500000000000005,"15min":0.755},"min":{"1min":0.37,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69499999999999995,"5min":4.8019999999999996,"15min":4.8019999999999996},"last":0.51000000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.66900000000000004,"15min":0.72099999999999997},"min":{"1min":0.41999999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76700000000000002,"5min":4.5949999999999998,"15min":4.5949999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.63,"15min":0.67600000000000005},"min":{"1min":0.35599999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.78600000000000003,"5min":4.3799999999999999,"15min":4.3799999999999999},"last":0.54300000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.68100000000000005,"15min":0.71699999999999997},"min":{"1min":0.42399999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84199999999999997,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.73699999999999999,"15min":0.81399999999999995},"min":{"1min":0.42899999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70999999999999996,"5min":4.7629999999999999,"15min":4.7629999999999999},"last":0.60199999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.96199999999999997,"15min":1.034},"min":{"1min":0.60699999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.95299999999999996,"5min":4.6369999999999996,"15min":4.6369999999999996},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":1.0740000000000001,"15min":1.1899999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.026,"5min":4.5149999999999997,"15min":4.5149999999999997},"last":0.79800000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":1.0760000000000001,"15min":1.1870000000000001},"min":{"1min":0.67000000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.044,"5min":4.5270000000000001,"15min":4.5270000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.95199999999999996,"15min":1.01},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0489999999999999,"5min":4.4909999999999997,"15min":4.4909999999999997},"last":0.95499999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.98999999999999999,"15min":1.0600000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.0720000000000001,"5min":4.6879999999999997,"15min":4.6879999999999997},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":1.093,"15min":1.2010000000000001},"min":{"1min":0.71499999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.008,"5min":4.5640000000000001,"15min":4.5640000000000001},"last":0.97199999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.94899999999999995,"15min":1.0049999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.97899999999999998,"5min":4.4580000000000002,"15min":4.4580000000000002},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":1.0049999999999999,"15min":1.0800000000000001},"min":{"1min":0.65300000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0629999999999999,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.93700000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302588,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069252,"statfs":{"total":96636764160,"available":96326914048,"internally_reserved":0,"allocated":1093632,"data_stored":796042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45100000000000001,"15min":0.443},"min":{"1min":0.34599999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60099999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51700000000000002,"15min":0.501},"min":{"1min":0.42099999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.60999999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34499999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.495,"15min":0.47999999999999998},"min":{"1min":0.35899999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.75700000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.57099999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.378,"5min":0.37,"15min":0.37},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.495,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63200000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.111,"5min":1.151,"15min":1.151},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.79400000000000004,"15min":0.79300000000000004},"min":{"1min":0.61499999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97499999999999998,"5min":1.159,"15min":1.159},"last":0.99099999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79900000000000004,"15min":0.80000000000000004},"min":{"1min":0.58299999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0660000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.60999999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0269999999999999,"5min":1.131,"15min":1.131},"last":1.0069999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.85099999999999998,"15min":0.84899999999999998},"min":{"1min":0.69399999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0760000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.86499999999999999,"15min":0.876},"min":{"1min":0.67000000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1619999999999999,"5min":1.575,"15min":1.575},"last":0.96399999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83699999999999997,"15min":0.84699999999999998},"min":{"1min":0.625,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0629999999999999,"5min":1.268,"15min":1.268},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.70899999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1830000000000001,"5min":1.204,"15min":1.204},"last":0.88600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:04.233 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-17T02:23:26.811202+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=23, tm_sec=26, tm_wday=5, tm_yday=230, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=26, tm_sec=58, tm_wday=5, tm_yday=230, tm_isdst=0) 2024-08-17T02:27:04.233 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-17T02:27:07.157 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:07.162 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:24.234 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:24.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.397+0000 7ffaab400640 1 Processor -- start 2024-08-17T02:27:24.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.397+0000 7ffaab400640 1 -- start start 2024-08-17T02:27:24.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.398+0000 7ffaab400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffaa4155040 0x7ffaa4158c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.398+0000 7ffaab400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffaa41591c0 0x7ffaa406e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.398+0000 7ffaab400640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa40aeeb0 con 0x7ffaa406e5a0 2024-08-17T02:27:24.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.398+0000 7ffaab400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa4159610 con 0x7ffaa4155040 2024-08-17T02:27:24.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.398+0000 7ffaab400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa406e9e0 con 0x7ffaa41591c0 2024-08-17T02:27:24.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.398+0000 7ffaa8a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffaa4155040 0x7ffaa4158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.399+0000 7ffaa8a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffaa4155040 0x7ffaa4158c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43762/0 (socket says 172.21.15.2:43762) 2024-08-17T02:27:24.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.399+0000 7ffaa8a00640 1 -- 172.21.15.2:0/374614065 learned_addr learned my addr 172.21.15.2:0/374614065 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:24.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.399+0000 7ffaa3e00640 1 --2- 172.21.15.2:0/374614065 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffaa41591c0 0x7ffaa406e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.399+0000 7ffaa8a00640 1 -- 172.21.15.2:0/374614065 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffaa41591c0 msgr2=0x7ffaa406e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:24.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.399+0000 7ffaa8a00640 1 --2- 172.21.15.2:0/374614065 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffaa41591c0 0x7ffaa406e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.399+0000 7ffaa8a00640 1 -- 172.21.15.2:0/374614065 >> v1:172.21.15.145:6789/0 conn(0x7ffaa406e5a0 legacy=0x7ffaa40ab3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.399+0000 7ffaa8a00640 1 -- 172.21.15.2:0/374614065 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa40aadd0 con 0x7ffaa4155040 2024-08-17T02:27:24.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.400+0000 7ffaa8a00640 1 --2- 172.21.15.2:0/374614065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa4155040 0x7ffaa4158c80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009910 tx=0x7ffa980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd2f6073ae10b0e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:24.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.400+0000 7ffaa3400640 1 -- 172.21.15.2:0/374614065 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9802add0 con 0x7ffaa4155040 2024-08-17T02:27:24.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.400+0000 7ffaa3400640 1 -- 172.21.15.2:0/374614065 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa98032440 con 0x7ffaa4155040 2024-08-17T02:27:24.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.400+0000 7ffaa3400640 1 -- 172.21.15.2:0/374614065 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa98032820 con 0x7ffaa4155040 2024-08-17T02:27:24.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.401+0000 7ffaab400640 1 -- 172.21.15.2:0/374614065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa4155040 msgr2=0x7ffaa4158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.401+0000 7ffaab400640 1 --2- 172.21.15.2:0/374614065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa4155040 0x7ffaa4158c80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009910 tx=0x7ffa980091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.401+0000 7ffaab400640 1 -- 172.21.15.2:0/374614065 shutdown_connections 2024-08-17T02:27:24.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.401+0000 7ffaab400640 1 --2- 172.21.15.2:0/374614065 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffaa41591c0 0x7ffaa406e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.401+0000 7ffaab400640 1 --2- 172.21.15.2:0/374614065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa4155040 0x7ffaa4158c80 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.401+0000 7ffaab400640 1 -- 172.21.15.2:0/374614065 >> 172.21.15.2:0/374614065 conn(0x7ffaa4066e60 msgr2=0x7ffaa4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:24.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.401+0000 7ffaab400640 1 -- 172.21.15.2:0/374614065 shutdown_connections 2024-08-17T02:27:24.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.401+0000 7ffaab400640 1 -- 172.21.15.2:0/374614065 wait complete. 2024-08-17T02:27:24.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.402+0000 7ffaab400640 1 Processor -- start 2024-08-17T02:27:24.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.403+0000 7ffaab400640 1 -- start start 2024-08-17T02:27:24.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.403+0000 7ffaab400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffaa406e5a0 0x7ffaa415c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.403+0000 7ffaab400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffaa4155040 0x7ffaa4159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.403+0000 7ffaab400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa41591c0 0x7ffaa41531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.403+0000 7ffaab400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa416ac00 con 0x7ffaa41591c0 2024-08-17T02:27:24.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.403+0000 7ffaab400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa416a030 con 0x7ffaa4155040 2024-08-17T02:27:24.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.403+0000 7ffaab400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa416a2d0 con 0x7ffaa406e5a0 2024-08-17T02:27:24.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.404+0000 7ffaa9400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa41591c0 0x7ffaa41531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.404+0000 7ffaa9400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa41591c0 0x7ffaa41531f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43770/0 (socket says 172.21.15.2:43770) 2024-08-17T02:27:24.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.404+0000 7ffaa9400640 1 -- 172.21.15.2:0/1132820826 learned_addr learned my addr 172.21.15.2:0/1132820826 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:24.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.404+0000 7ffaa8a00640 1 --2- 172.21.15.2:0/1132820826 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffaa406e5a0 0x7ffaa415c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.404+0000 7ffaa3e00640 1 --2- 172.21.15.2:0/1132820826 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffaa4155040 0x7ffaa4159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.404+0000 7ffaa9400640 1 -- 172.21.15.2:0/1132820826 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffaa406e5a0 msgr2=0x7ffaa415c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.404+0000 7ffaa9400640 1 --2- 172.21.15.2:0/1132820826 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffaa406e5a0 0x7ffaa415c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.404+0000 7ffaa9400640 1 -- 172.21.15.2:0/1132820826 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffaa4155040 msgr2=0x7ffaa4159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.404+0000 7ffaa9400640 1 --2- 172.21.15.2:0/1132820826 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffaa4155040 0x7ffaa4159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.404+0000 7ffaa9400640 1 -- 172.21.15.2:0/1132820826 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa98009450 con 0x7ffaa41591c0 2024-08-17T02:27:24.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.405+0000 7ffaa9400640 1 --2- 172.21.15.2:0/1132820826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa41591c0 0x7ffaa41531f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00c860 tx=0x7ffa9c001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:24.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.405+0000 7ffa97e00640 1 -- 172.21.15.2:0/1132820826 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c00ce50 con 0x7ffaa41591c0 2024-08-17T02:27:24.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.405+0000 7ffa97e00640 1 -- 172.21.15.2:0/1132820826 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c00a850 con 0x7ffaa41591c0 2024-08-17T02:27:24.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.405+0000 7ffa97e00640 1 -- 172.21.15.2:0/1132820826 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c00ac10 con 0x7ffaa41591c0 2024-08-17T02:27:24.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.405+0000 7ffaab400640 1 -- 172.21.15.2:0/1132820826 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa416a5b0 con 0x7ffaa41591c0 2024-08-17T02:27:24.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.405+0000 7ffaab400640 1 -- 172.21.15.2:0/1132820826 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa415a300 con 0x7ffaa41591c0 2024-08-17T02:27:24.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.406+0000 7ffaab400640 1 -- 172.21.15.2:0/1132820826 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa416adb0 con 0x7ffaa41591c0 2024-08-17T02:27:24.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.407+0000 7ffa97e00640 1 -- 172.21.15.2:0/1132820826 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ffa9c012630 con 0x7ffaa41591c0 2024-08-17T02:27:24.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.408+0000 7ffa97e00640 1 --2- 172.21.15.2:0/1132820826 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7ffa84065180 0x7ffa84067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.408+0000 7ffa97e00640 1 -- 172.21.15.2:0/1132820826 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ffa9c082450 con 0x7ffaa41591c0 2024-08-17T02:27:24.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.408+0000 7ffaa8a00640 1 --2- 172.21.15.2:0/1132820826 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7ffa84065180 0x7ffa84067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.409+0000 7ffaa8a00640 1 --2- 172.21.15.2:0/1132820826 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7ffa84065180 0x7ffa84067630 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ffa98034000 tx=0x7ffa98032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:24.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.412+0000 7ffa97e00640 1 -- 172.21.15.2:0/1132820826 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ffaa416adb0 con 0x7ffaa41591c0 2024-08-17T02:27:24.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.589+0000 7ffaab400640 1 -- 172.21.15.2:0/1132820826 --> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffaa4063fb0 con 0x7ffa84065180 2024-08-17T02:27:24.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.592+0000 7ffa97e00640 1 -- 172.21.15.2:0/1132820826 <== mgr.4108 v2:172.21.15.145:6832/36841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50840 (secure 0 0 0) 0x7ffaa4063fb0 con 0x7ffa84065180 2024-08-17T02:27:24.592 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:27:24.593 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-17T02:27:24.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.594+0000 7ffaab400640 1 -- 172.21.15.2:0/1132820826 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7ffa84065180 msgr2=0x7ffa84067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.594+0000 7ffaab400640 1 --2- 172.21.15.2:0/1132820826 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7ffa84065180 0x7ffa84067630 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ffa98034000 tx=0x7ffa98032000 comp rx=0 tx=0).stop 2024-08-17T02:27:24.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.594+0000 7ffaab400640 1 -- 172.21.15.2:0/1132820826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa41591c0 msgr2=0x7ffaa41531f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.594+0000 7ffaab400640 1 --2- 172.21.15.2:0/1132820826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa41591c0 0x7ffaa41531f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00c860 tx=0x7ffa9c001690 comp rx=0 tx=0).stop 2024-08-17T02:27:24.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.594+0000 7ffaab400640 1 -- 172.21.15.2:0/1132820826 shutdown_connections 2024-08-17T02:27:24.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.594+0000 7ffaab400640 1 --2- 172.21.15.2:0/1132820826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa41591c0 0x7ffaa41531f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.594+0000 7ffaab400640 1 --2- 172.21.15.2:0/1132820826 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffaa4155040 0x7ffaa4159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.594+0000 7ffaab400640 1 --2- 172.21.15.2:0/1132820826 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7ffa84065180 0x7ffa84067630 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.594+0000 7ffaab400640 1 --2- 172.21.15.2:0/1132820826 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffaa406e5a0 0x7ffaa415c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.594+0000 7ffaab400640 1 -- 172.21.15.2:0/1132820826 >> 172.21.15.2:0/1132820826 conn(0x7ffaa4066e60 msgr2=0x7ffaa40a88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:24.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.594+0000 7ffaab400640 1 -- 172.21.15.2:0/1132820826 shutdown_connections 2024-08-17T02:27:24.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.594+0000 7ffaab400640 1 -- 172.21.15.2:0/1132820826 wait complete. 2024-08-17T02:27:24.609 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-08-17T02:27:24.112976+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2400560,"kb_used_data":5064,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574160,"statfs":{"total":773094113280,"available":770635939840,"internally_reserved":0,"allocated":5185536,"data_stored":2826128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002716"},"pg_stats":[{"pgid":"1.0","version":"42'119","reported_seq":197,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:27:03.969974+0000","last_change":"2024-08-17T02:27:03.969941+0000","last_active":"2024-08-17T02:27:03.969974+0000","last_peered":"2024-08-17T02:27:03.969974+0000","last_clean":"2024-08-17T02:27:03.969974+0000","last_became_active":"2024-08-17T02:23:27.952879+0000","last_became_peered":"2024-08-17T02:23:27.952879+0000","last_unstale":"2024-08-17T02:27:03.969974+0000","last_undegraded":"2024-08-17T02:27:03.969974+0000","last_fullsized":"2024-08-17T02:27:03.969974+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'119","last_scrub_stamp":"2024-08-17T02:27:03.969837+0000","last_deep_scrub":"42'119","last_deep_scrub_stamp":"2024-08-17T02:27:03.969837+0000","last_clean_scrub_stamp":"2024-08-17T02:27:03.969837+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:39.952063+0000","scrub_duration":0.0050034299999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298420,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073420,"statfs":{"total":96636764160,"available":96331182080,"internally_reserved":0,"allocated":1093632,"data_stored":796042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68700000000000006,"15min":0.66900000000000004},"min":{"1min":0.55900000000000005,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86099999999999999,"5min":1.8,"15min":1.8},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.66800000000000004,"15min":0.61499999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.024,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.92400000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.70499999999999996,"15min":0.66100000000000003},"min":{"1min":0.66300000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98699999999999999,"5min":1.022,"15min":1.022},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.74299999999999999,"15min":0.69699999999999995},"min":{"1min":0.53200000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96899999999999997,"5min":2.8039999999999998,"15min":2.8039999999999998},"last":0.95699999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.65900000000000003,"15min":0.623},"min":{"1min":0.53800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.93100000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.872},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.69999999999999996,"15min":0.67000000000000004},"min":{"1min":0.64900000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.70699999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.66400000000000003,"15min":0.626},"min":{"1min":0.63500000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.94099999999999995,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76300000000000001,"15min":0.754},"min":{"1min":0.624,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.95299999999999996,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.75800000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.60299999999999998,"15min":0.59399999999999997},"min":{"1min":0.42299999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80500000000000005,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.41499999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81100000000000005,"5min":0.88,"15min":0.88},"last":0.73199999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65400000000000003,"15min":0.66300000000000003},"min":{"1min":0.44900000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.98099999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68799999999999994,"15min":0.67200000000000004},"min":{"1min":0.47399999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.86799999999999999,"5min":2.7090000000000001,"15min":2.7090000000000001},"last":0.77600000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.75700000000000001,"15min":0.745},"min":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.878,"5min":2.742,"15min":2.742},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69199999999999995,"15min":0.68600000000000005},"min":{"1min":0.56999999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88800000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.79800000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297852,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073988,"statfs":{"total":96636764160,"available":96331763712,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66500000000000004,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89900000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68700000000000006,"15min":0.68300000000000005},"min":{"1min":0.52700000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.94899999999999995,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.80900000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70499999999999996,"15min":0.69999999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.877,"5min":1.268,"15min":1.268},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68899999999999995,"15min":0.68100000000000005},"min":{"1min":0.49399999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86199999999999999,"5min":1.383,"15min":1.383},"last":0.79000000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.55900000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96799999999999997,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.75700000000000001,"15min":0.74099999999999999},"min":{"1min":0.57599999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.01,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.72299999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.56699999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.96899999999999997,"5min":1.528,"15min":1.528},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78500000000000003,"15min":0.79900000000000004},"min":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.94199999999999995,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.71399999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63200000000000001,"15min":0.64200000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.65800000000000003,"15min":0.67100000000000004},"min":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90700000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.55900000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.67400000000000004,"15min":0.69799999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.84999999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68200000000000005,"15min":0.68899999999999995},"min":{"1min":0.52700000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88800000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.69699999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72699999999999998,"15min":0.74299999999999999},"min":{"1min":0.502,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.83499999999999996,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.76000000000000001,"15min":0.77900000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97699999999999998,"5min":1.014,"15min":1.014},"last":0.63200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297848,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073992,"statfs":{"total":96636764160,"available":96331767808,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.69599999999999995,"15min":0.66100000000000003},"min":{"1min":0.65200000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.52000000000000002,"5min":0.495,"15min":0.495},"max":{"1min":0.996,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.66400000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.72499999999999998,"15min":0.70099999999999996},"min":{"1min":0.68899999999999995,"5min":0.497,"15min":0.497},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72199999999999998,"15min":0.70199999999999996},"min":{"1min":0.55000000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96199999999999997,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.72299999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.73699999999999999,"15min":0.72099999999999997},"min":{"1min":0.57899999999999996,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.77100000000000002,"15min":0.75700000000000001},"min":{"1min":0.72099999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.83399999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71799999999999997,"15min":0.70999999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.91400000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.75},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.78000000000000003,"15min":0.77200000000000002},"min":{"1min":0.66900000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.68799999999999994}]},{"osd":4,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.47499999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85499999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63900000000000001,"15min":0.65000000000000002},"min":{"1min":0.45100000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.81100000000000005,"5min":0.874,"15min":0.874},"last":0.45500000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65400000000000003,"15min":0.68000000000000005},"min":{"1min":0.51400000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91500000000000004,"5min":1.03,"15min":1.03},"last":0.498},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69699999999999995,"15min":0.72199999999999998},"min":{"1min":0.54300000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89100000000000001,"5min":1.026,"15min":1.026},"last":0.53500000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69499999999999995,"15min":0.70999999999999996},"min":{"1min":0.55000000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.79400000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.746,"15min":0.78000000000000003},"min":{"1min":0.55800000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98899999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.57399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297844,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71799999999999997,"15min":0.71299999999999997},"min":{"1min":0.52500000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86899999999999999,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77500000000000002,"15min":0.78800000000000003},"min":{"1min":0.58099999999999996,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91200000000000003,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.70099999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.753,"15min":0.747},"min":{"1min":0.65500000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89100000000000001,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73899999999999999,"15min":0.73599999999999999},"min":{"1min":0.58299999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.90200000000000002,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.65700000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67700000000000005,"15min":0.67900000000000005},"min":{"1min":0.56299999999999994,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.78600000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71199999999999997,"15min":0.70899999999999996},"min":{"1min":0.61699999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.86299999999999999,"5min":1.022,"15min":1.022},"last":0.57499999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.66500000000000004},"min":{"1min":0.53300000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85199999999999998,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72899999999999998,"15min":0.72699999999999998},"min":{"1min":0.54200000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.85699999999999998,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.56399999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.61499999999999999,"15min":0.629},"min":{"1min":0.41299999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75900000000000001,"5min":1.069,"15min":1.069},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.48899999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.872,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.52800000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.64000000000000001,"15min":0.66000000000000003},"min":{"1min":0.45500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.72199999999999998,"5min":1.012,"15min":1.012},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.72799999999999998,"15min":0.746},"min":{"1min":0.47599999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.85799999999999998,"5min":1.325,"15min":1.325},"last":0.76100000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.69299999999999995,"15min":0.69799999999999995},"min":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.83299999999999996,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.871,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.72199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302004,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069836,"statfs":{"total":96636764160,"available":96327512064,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.44800000000000001,"15min":0.45800000000000002},"min":{"1min":0.33900000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.56899999999999995,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.35999999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67700000000000005,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.44900000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67400000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.45800000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73399999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.51700000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.438,"5min":0.377,"15min":0.377},"max":{"1min":0.67600000000000005,"5min":0.875,"15min":0.875},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.47399999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.55800000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.60499999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81999999999999995,"15min":0.84399999999999997},"min":{"1min":0.67600000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.079,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.94399999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81699999999999995,"15min":0.83699999999999997},"min":{"1min":0.63100000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.85599999999999998},"min":{"1min":0.62,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.145,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":1.008}]},{"osd":6,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.84399999999999997,"15min":0.86499999999999999},"min":{"1min":0.68300000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.147,"5min":1.353,"15min":1.353},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.84199999999999997,"15min":0.84999999999999998},"min":{"1min":0.63700000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.90600000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:26:29 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85099999999999998,"15min":0.879},"min":{"1min":0.66400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2010000000000001,"5min":1.28,"15min":1.28},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.85999999999999999,"15min":0.875},"min":{"1min":0.68400000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.165,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.88500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302008,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069832,"statfs":{"total":96636764160,"available":96327507968,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.61899999999999999,"15min":0.70899999999999996},"min":{"1min":0.33900000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.59199999999999997,"5min":6.9820000000000002,"15min":6.9820000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.61199999999999999,"15min":0.67100000000000004},"min":{"1min":0.34599999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67400000000000004,"5min":5.1269999999999998,"15min":5.1269999999999998},"last":0.52000000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.73899999999999999,"15min":0.82899999999999996},"min":{"1min":0.42899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73399999999999999,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.69499999999999995,"15min":0.747},"min":{"1min":0.438,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.73899999999999999,"5min":4.9589999999999996,"15min":4.9589999999999996},"last":0.57999999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51600000000000001,"15min":0.53000000000000003},"min":{"1min":0.35599999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.66800000000000004,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.76800000000000002,"15min":0.86199999999999999},"min":{"1min":0.41999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.70099999999999996,"5min":7.0419999999999998,"15min":7.0419999999999998},"last":0.63200000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.93100000000000005,"15min":1.0129999999999999},"min":{"1min":0.57899999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.083,"5min":7.0880000000000001,"15min":7.0880000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.86499999999999999,"15min":0.91500000000000004},"min":{"1min":0.57699999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.03,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.85899999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.83999999999999997,"15min":0.88},"min":{"1min":0.56499999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.99299999999999999,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.99299999999999999,"15min":1.069},"min":{"1min":0.70699999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.0149999999999999,"5min":7.133,"15min":7.133},"last":0.81999999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.88100000000000001,"15min":0.93899999999999995},"min":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.107,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.878,"15min":0.92500000000000004},"min":{"1min":0.55900000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1479999999999999,"5min":4.0570000000000004,"15min":4.0570000000000004},"last":0.77000000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.95599999999999996,"15min":1.01},"min":{"1min":0.60799999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2170000000000001,"5min":4.726,"15min":4.726},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.92100000000000004,"15min":0.96899999999999997},"min":{"1min":0.61399999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0720000000000001,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.83899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302004,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069836,"statfs":{"total":96636764160,"available":96327512064,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.59099999999999997,"15min":0.66500000000000004},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.55700000000000005,"5min":4.4420000000000002,"15min":4.4420000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.68500000000000005,"15min":0.755},"min":{"1min":0.37,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69499999999999995,"5min":4.8019999999999996,"15min":4.8019999999999996},"last":0.56100000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.66900000000000004,"15min":0.72099999999999997},"min":{"1min":0.41999999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76700000000000002,"5min":4.5949999999999998,"15min":4.5949999999999998},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.63,"15min":0.67600000000000005},"min":{"1min":0.35599999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.78600000000000003,"5min":4.3799999999999999,"15min":4.3799999999999999},"last":0.78500000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.68100000000000005,"15min":0.71699999999999997},"min":{"1min":0.42399999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84199999999999997,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":0.745},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.73699999999999999,"15min":0.81399999999999995},"min":{"1min":0.42899999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70999999999999996,"5min":4.7629999999999999,"15min":4.7629999999999999},"last":0.66300000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.96199999999999997,"15min":1.034},"min":{"1min":0.60699999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.95299999999999996,"5min":4.6369999999999996,"15min":4.6369999999999996},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":1.0740000000000001,"15min":1.1899999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.026,"5min":4.5149999999999997,"15min":4.5149999999999997},"last":0.93899999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":1.0760000000000001,"15min":1.1870000000000001},"min":{"1min":0.67000000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.044,"5min":4.5270000000000001,"15min":4.5270000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.95199999999999996,"15min":1.01},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0489999999999999,"5min":4.4909999999999997,"15min":4.4909999999999997},"last":1.0089999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.98999999999999999,"15min":1.0600000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.0720000000000001,"5min":4.6879999999999997,"15min":4.6879999999999997},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.84099999999999997,"5min":1.093,"15min":1.2010000000000001},"min":{"1min":0.71499999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.008,"5min":4.5640000000000001,"15min":4.5640000000000001},"last":1.0469999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.94899999999999995,"15min":1.0049999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.97899999999999998,"5min":4.4580000000000002,"15min":4.4580000000000002},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":1.0049999999999999,"15min":1.0800000000000001},"min":{"1min":0.65300000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0629999999999999,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":1.0229999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302580,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069260,"statfs":{"total":96636764160,"available":96326922240,"internally_reserved":0,"allocated":1093632,"data_stored":796042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45100000000000001,"15min":0.443},"min":{"1min":0.34599999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60099999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.443},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51700000000000002,"15min":0.501},"min":{"1min":0.42099999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.59499999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34499999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.495,"15min":0.47999999999999998},"min":{"1min":0.35899999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.75700000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.65900000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.378,"5min":0.37,"15min":0.37},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.495},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.495,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63300000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.111,"5min":1.151,"15min":1.151},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.79400000000000004,"15min":0.79300000000000004},"min":{"1min":0.61499999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97499999999999998,"5min":1.159,"15min":1.159},"last":0.79700000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79900000000000004,"15min":0.80000000000000004},"min":{"1min":0.58299999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0660000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.874},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.60999999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0269999999999999,"5min":1.131,"15min":1.131},"last":0.88600000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.85099999999999998,"15min":0.84899999999999998},"min":{"1min":0.69399999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0760000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.86499999999999999,"15min":0.876},"min":{"1min":0.67000000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1619999999999999,"5min":1.575,"15min":1.575},"last":0.90000000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:26:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83699999999999997,"15min":0.84699999999999998},"min":{"1min":0.625,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0629999999999999,"5min":1.268,"15min":1.268},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.70899999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1830000000000001,"5min":1.204,"15min":1.204},"last":0.85699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:24.613 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-17T02:27:24.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.760+0000 7f6c34600640 1 Processor -- start 2024-08-17T02:27:24.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.760+0000 7f6c34600640 1 -- start start 2024-08-17T02:27:24.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.761+0000 7f6c34600640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6c2c0ae860 0x7f6c2c06d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.761+0000 7f6c34600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c2c0aed90 con 0x7f6c2c158a20 2024-08-17T02:27:24.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.761+0000 7f6c34600640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c2c0af070 con 0x7f6c2c158df0 2024-08-17T02:27:24.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.761+0000 7f6c34600640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c2c0af350 con 0x7f6c2c0ae860 2024-08-17T02:27:24.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.762+0000 7f6c31c00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6c2c158a20 0x7f6c2c0a89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43792/0 (socket says 172.21.15.2:43792) 2024-08-17T02:27:24.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.762+0000 7f6c31c00640 1 -- 172.21.15.2:0/2375233416 learned_addr learned my addr 172.21.15.2:0/2375233416 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:27:24.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.762+0000 7f6c31200640 1 --2- 172.21.15.2:0/2375233416 >> v2:172.21.15.145:3300/0 conn(0x7f6c2c0ae860 0x7f6c2c06d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.762+0000 7f6c2be00640 1 -- 172.21.15.2:0/2375233416 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275333613 0 0) 0x7f6c2c0aed90 con 0x7f6c2c158a20 2024-08-17T02:27:24.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.762+0000 7f6c2be00640 1 -- 172.21.15.2:0/2375233416 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c140034e0 con 0x7f6c2c158a20 2024-08-17T02:27:24.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.763+0000 7f6c2be00640 1 -- 172.21.15.2:0/2375233416 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2061354438 0 0) 0x7f6c140034e0 con 0x7f6c2c158a20 2024-08-17T02:27:24.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.763+0000 7f6c2be00640 1 -- 172.21.15.2:0/2375233416 >> v2:172.21.15.145:3300/0 conn(0x7f6c2c0ae860 msgr2=0x7f6c2c06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.763+0000 7f6c2be00640 1 --2- 172.21.15.2:0/2375233416 >> v2:172.21.15.145:3300/0 conn(0x7f6c2c0ae860 0x7f6c2c06d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.763+0000 7f6c2be00640 1 -- 172.21.15.2:0/2375233416 >> v1:172.21.15.145:6789/0 conn(0x7f6c2c158df0 legacy=0x7f6c2c0afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.763+0000 7f6c2be00640 1 -- 172.21.15.2:0/2375233416 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c0af630 con 0x7f6c2c158a20 2024-08-17T02:27:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.763+0000 7f6c2be00640 1 -- 172.21.15.2:0/2375233416 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 460385639 0 0) 0x7f6c20001470 con 0x7f6c2c158a20 2024-08-17T02:27:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.763+0000 7f6c2be00640 1 -- 172.21.15.2:0/2375233416 >> v1:172.21.15.2:6789/0 conn(0x7f6c2c158a20 legacy=0x7f6c2c0a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.763+0000 7f6c2be00640 1 --2- 172.21.15.2:0/2375233416 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6c140039d0 0x7f6c14003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.763+0000 7f6c2be00640 1 --2- 172.21.15.2:0/2375233416 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c14004780 0x7f6c14004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.763+0000 7f6c2be00640 1 --2- 172.21.15.2:0/2375233416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c14005130 0x7f6c1400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.763+0000 7f6c2be00640 1 -- 172.21.15.2:0/2375233416 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c0af350 con 0x7f6c14005130 2024-08-17T02:27:24.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.763+0000 7f6c2be00640 1 -- 172.21.15.2:0/2375233416 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1400bfc0 con 0x7f6c14004780 2024-08-17T02:27:24.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.763+0000 7f6c2be00640 1 -- 172.21.15.2:0/2375233416 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1400c180 con 0x7f6c140039d0 2024-08-17T02:27:24.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.763+0000 7f6c32600640 1 --2- 172.21.15.2:0/2375233416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c14005130 0x7f6c1400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.763+0000 7f6c31200640 1 --2- 172.21.15.2:0/2375233416 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c14004780 0x7f6c14004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.763+0000 7f6c31c00640 1 --2- 172.21.15.2:0/2375233416 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6c140039d0 0x7f6c14003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.763+0000 7f6c32600640 1 -- 172.21.15.2:0/2375233416 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6c140039d0 msgr2=0x7f6c14003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:24.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.763+0000 7f6c32600640 1 --2- 172.21.15.2:0/2375233416 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6c140039d0 0x7f6c14003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.763+0000 7f6c32600640 1 -- 172.21.15.2:0/2375233416 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c14004780 msgr2=0x7f6c14004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:24.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.763+0000 7f6c32600640 1 --2- 172.21.15.2:0/2375233416 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c14004780 0x7f6c14004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.763+0000 7f6c32600640 1 -- 172.21.15.2:0/2375233416 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c140034e0 con 0x7f6c14005130 2024-08-17T02:27:24.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.764+0000 7f6c32600640 1 -- 172.21.15.2:0/2375233416 reap_dead start 2024-08-17T02:27:24.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.764+0000 7f6c32600640 1 --2- 172.21.15.2:0/2375233416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c14005130 0x7f6c1400b9d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6c24002010 tx=0x7f6c24001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3211334f463b3a23 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:24.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.765+0000 7f6c2be00640 1 -- 172.21.15.2:0/2375233416 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24031440 con 0x7f6c14005130 2024-08-17T02:27:24.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.765+0000 7f6c2be00640 1 -- 172.21.15.2:0/2375233416 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2402d050 con 0x7f6c14005130 2024-08-17T02:27:24.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.765+0000 7f6c2be00640 1 -- 172.21.15.2:0/2375233416 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c240317f0 con 0x7f6c14005130 2024-08-17T02:27:24.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.765+0000 7f6c34600640 1 -- 172.21.15.2:0/2375233416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c14005130 msgr2=0x7f6c1400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.765+0000 7f6c34600640 1 --2- 172.21.15.2:0/2375233416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c14005130 0x7f6c1400b9d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6c24002010 tx=0x7f6c24001640 comp rx=0 tx=0).stop 2024-08-17T02:27:24.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.765+0000 7f6c34600640 1 -- 172.21.15.2:0/2375233416 shutdown_connections 2024-08-17T02:27:24.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.765+0000 7f6c34600640 1 --2- 172.21.15.2:0/2375233416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c14005130 0x7f6c1400b9d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.765+0000 7f6c34600640 1 -- 172.21.15.2:0/2375233416 >> 172.21.15.2:0/2375233416 conn(0x7f6c2c066e60 msgr2=0x7f6c2c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:24.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.765+0000 7f6c34600640 1 -- 172.21.15.2:0/2375233416 shutdown_connections 2024-08-17T02:27:24.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.765+0000 7f6c34600640 1 -- 172.21.15.2:0/2375233416 wait complete. 2024-08-17T02:27:24.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.767+0000 7f6c34600640 1 Processor -- start 2024-08-17T02:27:24.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.767+0000 7f6c34600640 1 -- start start 2024-08-17T02:27:24.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.768+0000 7f6c34600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c14005130 0x7f6c2c1597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.768+0000 7f6c34600640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6c2c1539e0 0x7f6c2c1542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.768+0000 7f6c34600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c2c154820 0x7f6c2c15deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.768+0000 7f6c34600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c15da20 con 0x7f6c14005130 2024-08-17T02:27:24.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.768+0000 7f6c34600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c159d20 con 0x7f6c2c154820 2024-08-17T02:27:24.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.768+0000 7f6c34600640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c159fc0 con 0x7f6c2c1539e0 2024-08-17T02:27:24.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.768+0000 7f6c31c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c14005130 0x7f6c2c1597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.768+0000 7f6c31c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c14005130 0x7f6c2c1597e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56832/0 (socket says 172.21.15.2:56832) 2024-08-17T02:27:24.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.768+0000 7f6c31c00640 1 -- 172.21.15.2:0/2830970631 learned_addr learned my addr 172.21.15.2:0/2830970631 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:24.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.768+0000 7f6c32600640 1 --2- 172.21.15.2:0/2830970631 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c2c154820 0x7f6c2c15deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.768+0000 7f6c31200640 1 --2- 172.21.15.2:0/2830970631 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6c2c1539e0 0x7f6c2c1542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.768+0000 7f6c31c00640 1 -- 172.21.15.2:0/2830970631 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6c2c1539e0 msgr2=0x7f6c2c1542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.768+0000 7f6c31c00640 1 --2- 172.21.15.2:0/2830970631 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6c2c1539e0 0x7f6c2c1542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.768+0000 7f6c31c00640 1 -- 172.21.15.2:0/2830970631 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c2c154820 msgr2=0x7f6c2c15deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.768+0000 7f6c31c00640 1 --2- 172.21.15.2:0/2830970631 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c2c154820 0x7f6c2c15deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.768+0000 7f6c31c00640 1 -- 172.21.15.2:0/2830970631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c15a2a0 con 0x7f6c14005130 2024-08-17T02:27:24.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.769+0000 7f6c31c00640 1 --2- 172.21.15.2:0/2830970631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c14005130 0x7f6c2c1597e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000e830 tx=0x7f6c20000cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:24.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.769+0000 7f6c28c00640 1 -- 172.21.15.2:0/2830970631 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2000a5e0 con 0x7f6c14005130 2024-08-17T02:27:24.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.769+0000 7f6c28c00640 1 -- 172.21.15.2:0/2830970631 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c20010040 con 0x7f6c14005130 2024-08-17T02:27:24.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.769+0000 7f6c28c00640 1 -- 172.21.15.2:0/2830970631 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2000a990 con 0x7f6c14005130 2024-08-17T02:27:24.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.769+0000 7f6c34600640 1 -- 172.21.15.2:0/2830970631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c2c15a580 con 0x7f6c14005130 2024-08-17T02:27:24.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.769+0000 7f6c34600640 1 -- 172.21.15.2:0/2830970631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c2c15e3f0 con 0x7f6c14005130 2024-08-17T02:27:24.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.770+0000 7f6c34600640 1 -- 172.21.15.2:0/2830970631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c2c15d7f0 con 0x7f6c14005130 2024-08-17T02:27:24.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.771+0000 7f6c28c00640 1 -- 172.21.15.2:0/2830970631 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6c2000ad00 con 0x7f6c14005130 2024-08-17T02:27:24.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.772+0000 7f6c28c00640 1 --2- 172.21.15.2:0/2830970631 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6c0c065180 0x7f6c0c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.772+0000 7f6c28c00640 1 -- 172.21.15.2:0/2830970631 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f6c200816d0 con 0x7f6c14005130 2024-08-17T02:27:24.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.772+0000 7f6c31200640 1 --2- 172.21.15.2:0/2830970631 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6c0c065180 0x7f6c0c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.773+0000 7f6c31200640 1 --2- 172.21.15.2:0/2830970631 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6c0c065180 0x7f6c0c067630 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c15afe0 tx=0x7f6c18008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:24.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.776+0000 7f6c28c00640 1 -- 172.21.15.2:0/2830970631 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6c2c15d7f0 con 0x7f6c14005130 2024-08-17T02:27:24.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.958+0000 7f6c34600640 1 -- 172.21.15.2:0/2830970631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f6c2c15d7f0 con 0x7f6c14005130 2024-08-17T02:27:24.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.962+0000 7f6c28c00640 1 -- 172.21.15.2:0/2830970631 <== mon.0 v2:172.21.15.2:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6c20053420 con 0x7f6c14005130 2024-08-17T02:27:24.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.962+0000 7f6c28c00640 1 -- 172.21.15.2:0/2830970631 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f6c2c15d7f0 con 0x7f6c14005130 2024-08-17T02:27:24.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.965+0000 7f6c34600640 1 -- 172.21.15.2:0/2830970631 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6c0c065180 msgr2=0x7f6c0c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.965+0000 7f6c34600640 1 --2- 172.21.15.2:0/2830970631 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6c0c065180 0x7f6c0c067630 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c15afe0 tx=0x7f6c18008040 comp rx=0 tx=0).stop 2024-08-17T02:27:24.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.965+0000 7f6c34600640 1 -- 172.21.15.2:0/2830970631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c14005130 msgr2=0x7f6c2c1597e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.965+0000 7f6c34600640 1 --2- 172.21.15.2:0/2830970631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c14005130 0x7f6c2c1597e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000e830 tx=0x7f6c20000cc0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.965+0000 7f6c34600640 1 -- 172.21.15.2:0/2830970631 shutdown_connections 2024-08-17T02:27:24.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.965+0000 7f6c34600640 1 --2- 172.21.15.2:0/2830970631 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c2c154820 0x7f6c2c15deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.965+0000 7f6c34600640 1 --2- 172.21.15.2:0/2830970631 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f6c0c065180 0x7f6c0c067630 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.965+0000 7f6c34600640 1 --2- 172.21.15.2:0/2830970631 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6c2c1539e0 0x7f6c2c1542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.965+0000 7f6c34600640 1 --2- 172.21.15.2:0/2830970631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c14005130 0x7f6c2c1597e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.965+0000 7f6c34600640 1 -- 172.21.15.2:0/2830970631 >> 172.21.15.2:0/2830970631 conn(0x7f6c2c066e60 msgr2=0x7f6c2c0cb950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:24.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.965+0000 7f6c34600640 1 -- 172.21.15.2:0/2830970631 shutdown_connections 2024-08-17T02:27:24.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:24.965+0000 7f6c34600640 1 -- 172.21.15.2:0/2830970631 wait complete. 2024-08-17T02:27:24.981 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:27:24.981 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:25.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.132+0000 7f8cb7400640 1 Processor -- start 2024-08-17T02:27:25.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.132+0000 7f8cb7400640 1 -- start start 2024-08-17T02:27:25.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.133+0000 7f8cb7400640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8cb01590b0 0x7f8cb00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.133+0000 7f8cb7400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cb00acf10 0x7f8cb0159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.133+0000 7f8cb7400640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb015a4e0 con 0x7f8cb00afca0 2024-08-17T02:27:25.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.133+0000 7f8cb7400640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb00b0980 con 0x7f8cb01590b0 2024-08-17T02:27:25.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.133+0000 7f8cb7400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb00c92b0 con 0x7f8cb00acf10 2024-08-17T02:27:25.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.134+0000 7f8cb5400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cb00acf10 0x7f8cb0159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.134+0000 7f8cb4a00640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f8cb00afca0 0x7f8cb01589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.2:60078/0 (socket says 172.21.15.2:60078) 2024-08-17T02:27:25.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.134+0000 7f8cafe00640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8cb01590b0 0x7f8cb00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.134+0000 7f8cb4a00640 1 -- 172.21.15.2:0/4139911720 learned_addr learned my addr 172.21.15.2:0/4139911720 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:27:25.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.135+0000 7f8cb5400640 1 -- 172.21.15.2:0/4139911720 >> v2:172.21.15.145:3300/0 conn(0x7f8cb01590b0 msgr2=0x7f8cb00b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:25.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.135+0000 7f8cb5400640 1 --2- 172.21.15.2:0/4139911720 >> v2:172.21.15.145:3300/0 conn(0x7f8cb01590b0 0x7f8cb00b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.135+0000 7f8cb5400640 1 -- 172.21.15.2:0/4139911720 >> v1:172.21.15.145:6789/0 conn(0x7f8cb00afca0 legacy=0x7f8cb01589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.135+0000 7f8cb5400640 1 -- 172.21.15.2:0/4139911720 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb00ad480 con 0x7f8cb00acf10 2024-08-17T02:27:25.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.135+0000 7f8caf400640 1 -- 172.21.15.2:0/4139911720 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471431411 0 0) 0x7f8ca4001110 con 0x7f8cb00afca0 2024-08-17T02:27:25.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.135+0000 7f8cafe00640 1 --2- 172.21.15.2:0/4139911720 >> v2:172.21.15.145:3300/0 conn(0x7f8cb01590b0 0x7f8cb00b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:25.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.136+0000 7f8cb5400640 1 --2- 172.21.15.2:0/4139911720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cb00acf10 0x7f8cb0159fa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009e60 tx=0x7f8ca8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94cbd0aaceb4369a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.136+0000 7f8caf400640 1 -- 172.21.15.2:0/4139911720 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8007550 con 0x7f8cb00acf10 2024-08-17T02:27:25.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.136+0000 7f8caf400640 1 -- 172.21.15.2:0/4139911720 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8ca802d050 con 0x7f8cb00acf10 2024-08-17T02:27:25.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.136+0000 7f8caf400640 1 -- 172.21.15.2:0/4139911720 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8007900 con 0x7f8cb00acf10 2024-08-17T02:27:25.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.137+0000 7f8cb7400640 1 -- 172.21.15.2:0/4139911720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cb00acf10 msgr2=0x7f8cb0159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.137+0000 7f8cb7400640 1 --2- 172.21.15.2:0/4139911720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cb00acf10 0x7f8cb0159fa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009e60 tx=0x7f8ca8009780 comp rx=0 tx=0).stop 2024-08-17T02:27:25.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.137+0000 7f8cb7400640 1 -- 172.21.15.2:0/4139911720 shutdown_connections 2024-08-17T02:27:25.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.137+0000 7f8cb7400640 1 --2- 172.21.15.2:0/4139911720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cb00acf10 0x7f8cb0159fa0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.137+0000 7f8cb7400640 1 --2- 172.21.15.2:0/4139911720 >> v2:172.21.15.145:3300/0 conn(0x7f8cb01590b0 0x7f8cb00b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.137+0000 7f8cb7400640 1 -- 172.21.15.2:0/4139911720 >> 172.21.15.2:0/4139911720 conn(0x7f8cb0066e60 msgr2=0x7f8cb0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:25.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.137+0000 7f8cb7400640 1 -- 172.21.15.2:0/4139911720 shutdown_connections 2024-08-17T02:27:25.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.137+0000 7f8cb7400640 1 -- 172.21.15.2:0/4139911720 wait complete. 2024-08-17T02:27:25.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.138+0000 7f8cb7400640 1 Processor -- start 2024-08-17T02:27:25.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.138+0000 7f8cb7400640 1 -- start start 2024-08-17T02:27:25.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.139+0000 7f8cb7400640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cb00acf10 0x7f8cb01569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.139+0000 7f8cb7400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb00afca0 0x7f8cb014a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.139+0000 7f8cb7400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cb01590b0 0x7f8cb014f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.139+0000 7f8cb7400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb0156ef0 con 0x7f8cb00afca0 2024-08-17T02:27:25.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.139+0000 7f8cb7400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb0151030 con 0x7f8cb01590b0 2024-08-17T02:27:25.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.139+0000 7f8cb7400640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb006b1a0 con 0x7f8cb00acf10 2024-08-17T02:27:25.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.139+0000 7f8cafe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb00afca0 0x7f8cb014a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.139+0000 7f8cafe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb00afca0 0x7f8cb014a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56838/0 (socket says 172.21.15.2:56838) 2024-08-17T02:27:25.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.140+0000 7f8cafe00640 1 -- 172.21.15.2:0/1681003426 learned_addr learned my addr 172.21.15.2:0/1681003426 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:27:25.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.140+0000 7f8cb5400640 1 --2- 172.21.15.2:0/1681003426 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cb01590b0 0x7f8cb014f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.140+0000 7f8cb4a00640 1 --2- 172.21.15.2:0/1681003426 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cb00acf10 0x7f8cb01569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.140+0000 7f8cafe00640 1 -- 172.21.15.2:0/1681003426 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cb00acf10 msgr2=0x7f8cb01569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.140+0000 7f8cafe00640 1 --2- 172.21.15.2:0/1681003426 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cb00acf10 0x7f8cb01569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.140+0000 7f8cafe00640 1 -- 172.21.15.2:0/1681003426 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cb01590b0 msgr2=0x7f8cb014f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.140+0000 7f8cafe00640 1 --2- 172.21.15.2:0/1681003426 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cb01590b0 0x7f8cb014f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.140+0000 7f8cafe00640 1 -- 172.21.15.2:0/1681003426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c009390 con 0x7f8cb00afca0 2024-08-17T02:27:25.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.140+0000 7f8cafe00640 1 --2- 172.21.15.2:0/1681003426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb00afca0 0x7f8cb014a500 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00ec80 tx=0x7f8c9c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.140+0000 7f8ca3e00640 1 -- 172.21.15.2:0/1681003426 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c00eec0 con 0x7f8cb00afca0 2024-08-17T02:27:25.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.140+0000 7f8ca3e00640 1 -- 172.21.15.2:0/1681003426 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8c9c00cc50 con 0x7f8cb00afca0 2024-08-17T02:27:25.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.140+0000 7f8cb7400640 1 -- 172.21.15.2:0/1681003426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca8009a20 con 0x7f8cb00afca0 2024-08-17T02:27:25.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.141+0000 7f8ca3e00640 1 -- 172.21.15.2:0/1681003426 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c013470 con 0x7f8cb00afca0 2024-08-17T02:27:25.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.141+0000 7f8cb7400640 1 -- 172.21.15.2:0/1681003426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb01509e0 con 0x7f8cb00afca0 2024-08-17T02:27:25.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.142+0000 7f8cb7400640 1 -- 172.21.15.2:0/1681003426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb0063fb0 con 0x7f8cb00afca0 2024-08-17T02:27:25.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.142+0000 7f8ca3e00640 1 -- 172.21.15.2:0/1681003426 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8c9c013800 con 0x7f8cb00afca0 2024-08-17T02:27:25.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.143+0000 7f8ca3e00640 1 --2- 172.21.15.2:0/1681003426 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8c90065150 0x7f8c90067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.143+0000 7f8ca3e00640 1 -- 172.21.15.2:0/1681003426 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f8c9c0823c0 con 0x7f8cb00afca0 2024-08-17T02:27:25.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.144+0000 7f8cb4a00640 1 --2- 172.21.15.2:0/1681003426 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8c90065150 0x7f8c90067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.145+0000 7f8cb4a00640 1 --2- 172.21.15.2:0/1681003426 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8c90065150 0x7f8c90067600 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4001800 tx=0x7f8ca4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.147+0000 7f8ca3e00640 1 -- 172.21.15.2:0/1681003426 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8c9c054190 con 0x7f8cb00afca0 2024-08-17T02:27:25.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.370+0000 7f8cb7400640 1 -- 172.21.15.2:0/1681003426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8cb0067b70 con 0x7f8cb00afca0 2024-08-17T02:27:25.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.370+0000 7f8ca3e00640 1 -- 172.21.15.2:0/1681003426 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f8c9c017de0 con 0x7f8cb00afca0 2024-08-17T02:27:25.371 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:27:25.371 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1347318932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1347318932},{"type":"v1","addr":"172.21.15.2:6834","nonce":1347318932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6836/4156967978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":4156967978},{"type":"v1","addr":"172.21.15.145:6836","nonce":4156967978}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5015,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/3172948330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":3172948330},{"type":"v1","addr":"172.21.15.145:6837","nonce":3172948330}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/1687147178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":1687147178},{"type":"v1","addr":"172.21.15.2:6835","nonce":1687147178}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[]} 2024-08-17T02:27:25.372 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-08-17T02:27:25.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.372+0000 7f8cb7400640 1 -- 172.21.15.2:0/1681003426 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8c90065150 msgr2=0x7f8c90067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.372+0000 7f8cb7400640 1 --2- 172.21.15.2:0/1681003426 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8c90065150 0x7f8c90067600 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4001800 tx=0x7f8ca4009040 comp rx=0 tx=0).stop 2024-08-17T02:27:25.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.372+0000 7f8cb7400640 1 -- 172.21.15.2:0/1681003426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb00afca0 msgr2=0x7f8cb014a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.372+0000 7f8cb7400640 1 --2- 172.21.15.2:0/1681003426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb00afca0 0x7f8cb014a500 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00ec80 tx=0x7f8c9c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.372+0000 7f8cb7400640 1 -- 172.21.15.2:0/1681003426 shutdown_connections 2024-08-17T02:27:25.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.372+0000 7f8cb7400640 1 --2- 172.21.15.2:0/1681003426 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cb01590b0 0x7f8cb014f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.372+0000 7f8cb7400640 1 --2- 172.21.15.2:0/1681003426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb00afca0 0x7f8cb014a500 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.372+0000 7f8cb7400640 1 --2- 172.21.15.2:0/1681003426 >> [v2:172.21.15.145:6832/36841,v1:172.21.15.145:6833/36841] conn(0x7f8c90065150 0x7f8c90067600 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.372+0000 7f8cb7400640 1 --2- 172.21.15.2:0/1681003426 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cb00acf10 0x7f8cb01569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.372+0000 7f8cb7400640 1 -- 172.21.15.2:0/1681003426 >> 172.21.15.2:0/1681003426 conn(0x7f8cb0066e60 msgr2=0x7f8cb006e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:25.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.372+0000 7f8cb7400640 1 -- 172.21.15.2:0/1681003426 shutdown_connections 2024-08-17T02:27:25.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:27:25.373+0000 7f8cb7400640 1 -- 172.21.15.2:0/1681003426 wait complete. 2024-08-17T02:27:25.387 DEBUG:tasks.cephfs.filesystem:already dead... 2024-08-17T02:27:25.387 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-17T02:27:25.388 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:27:25.388 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:25.402 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:27:25.402 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:27:25.402 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:25.456 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:27:25.457 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:27:25.457 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:25.473 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:27:25.474 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:27:25.474 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:25.530 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:27:25.531 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-17T02:27:25.531 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-17T02:27:25.531 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:25.577 INFO:tasks.ceph.osd.0:Stopped 2024-08-17T02:27:25.577 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-17T02:27:25.577 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:25.638 INFO:tasks.ceph.osd.1:Stopped 2024-08-17T02:27:25.639 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-17T02:27:25.639 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:25.681 INFO:tasks.ceph.osd.2:Stopped 2024-08-17T02:27:25.681 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-17T02:27:25.681 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:25.731 INFO:tasks.ceph.osd.3:Stopped 2024-08-17T02:27:25.731 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-17T02:27:25.731 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:25.783 INFO:tasks.ceph.osd.4:Stopped 2024-08-17T02:27:25.783 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-17T02:27:25.783 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:25.833 INFO:tasks.ceph.osd.5:Stopped 2024-08-17T02:27:25.833 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-17T02:27:25.833 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:25.887 INFO:tasks.ceph.osd.6:Stopped 2024-08-17T02:27:25.887 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-17T02:27:25.887 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:25.938 INFO:tasks.ceph.osd.7:Stopped 2024-08-17T02:27:25.938 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-17T02:27:25.939 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-17T02:27:25.939 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:25.995 INFO:tasks.ceph.mgr.y:Stopped 2024-08-17T02:27:25.995 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-17T02:27:25.996 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:26.057 INFO:tasks.ceph.mgr.x:Stopped 2024-08-17T02:27:26.057 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-17T02:27:26.057 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-17T02:27:26.057 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:26.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-08-17T02:27:26.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-08-17T02:27:26.076 INFO:tasks.ceph.mon.a:Stopped 2024-08-17T02:27:26.077 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-17T02:27:26.077 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:26.094 INFO:tasks.ceph.mon.b:Stopped 2024-08-17T02:27:26.094 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-17T02:27:26.094 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:26.152 INFO:tasks.ceph.mon.c:Stopped 2024-08-17T02:27:26.153 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-17T02:27:26.153 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-08-17T02:27:26.231 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:27:26.231 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-17T02:27:26.419 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:27:26.420 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-17T02:27:26.525 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:27:26.525 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-17T02:27:26.623 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:27:26.623 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-17T02:27:26.732 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi145.front.sepia.ceph.com 2024-08-17T02:27:26.732 DEBUG:teuthology.orchestra.run.smithi145:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-17T02:27:26.935 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi145.front.sepia.ceph.com 2024-08-17T02:27:26.936 DEBUG:teuthology.orchestra.run.smithi145:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-17T02:27:27.040 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi145.front.sepia.ceph.com 2024-08-17T02:27:27.040 DEBUG:teuthology.orchestra.run.smithi145:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-17T02:27:27.139 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi145.front.sepia.ceph.com 2024-08-17T02:27:27.140 DEBUG:teuthology.orchestra.run.smithi145:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-17T02:27:27.249 INFO:tasks.ceph:Archiving mon data... 2024-08-17T02:27:27.251 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858261/data/mon.a.tgz 2024-08-17T02:27:27.251 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-08-17T02:27:27.287 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.8mY5wSmqET 2024-08-17T02:27:27.288 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.8mY5wSmqET 2024-08-17T02:27:27.458 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.8mY5wSmqET 2024-08-17T02:27:27.552 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.8mY5wSmqET is 308KB 2024-08-17T02:27:27.640 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.8mY5wSmqET 2024-08-17T02:27:27.677 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858261/data/mon.b.tgz 2024-08-17T02:27:27.678 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2024-08-17T02:27:27.713 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.xqCeb9RQmm 2024-08-17T02:27:27.713 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.xqCeb9RQmm 2024-08-17T02:27:27.907 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.xqCeb9RQmm 2024-08-17T02:27:28.000 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.xqCeb9RQmm is 412KB 2024-08-17T02:27:28.087 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.xqCeb9RQmm 2024-08-17T02:27:28.122 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858261/data/mon.c.tgz 2024-08-17T02:27:28.122 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2024-08-17T02:27:28.196 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.g6XLDqzKml 2024-08-17T02:27:28.196 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.g6XLDqzKml 2024-08-17T02:27:28.372 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.g6XLDqzKml 2024-08-17T02:27:28.514 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.g6XLDqzKml is 412KB 2024-08-17T02:27:28.602 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.g6XLDqzKml 2024-08-17T02:27:28.636 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-17T02:27:28.636 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:27:28.640 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:27:28.731 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-08-17T02:27:28.732 DEBUG:teuthology.orchestra.run.smithi002:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:27:28.735 DEBUG:teuthology.orchestra.run.smithi145:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:27:28.797 INFO:teuthology.orchestra.run.smithi145.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:27:28.798 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:27:28.808 INFO:tasks.ceph:Archiving crash dumps... 2024-08-17T02:27:28.810 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858261/remote/smithi002/crash 2024-08-17T02:27:28.811 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:27:28.866 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858261/remote/smithi145/crash 2024-08-17T02:27:28.867 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:27:28.921 INFO:tasks.ceph:Shutting down logrotate 2024-08-17T02:27:28.921 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:28.925 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:29.018 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:29.072 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:29.127 INFO:tasks.ceph:Compressing logs... 2024-08-17T02:27:29.128 DEBUG:teuthology.orchestra.run.smithi002:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:27:29.132 DEBUG:teuthology.orchestra.run.smithi145:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:27:29.182 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45544.log 2024-08-17T02:27:29.182 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47342.log 2024-08-17T02:27:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49857.log 2024-08-17T02:27:29.184 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45544.log.gz 2024-08-17T02:27:29.184 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41279.log 2024-08-17T02:27:29.185 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47342.log.gz 2024-08-17T02:27:29.185 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46656.log 2024-08-17T02:27:29.186 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43307.log 2024-08-17T02:27:29.186 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49857.log.gz 2024-08-17T02:27:29.186 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46572.log 2024-08-17T02:27:29.187 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41279.log.gz 2024-08-17T02:27:29.189 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37031.log 2024-08-17T02:27:29.189 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.1.43307.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43307.log.gz 2024-08-17T02:27:29.189 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:27:29.189 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37031.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:27:29.190 INFO:teuthology.orchestra.run.smithi145.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37031.log.gz 2024-08-17T02:27:29.190 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42910.log 2024-08-17T02:27:29.191 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42569.log 2024-08-17T02:27:29.191 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46656.log.gz 2024-08-17T02:27:29.191 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47998.log 2024-08-17T02:27:29.191 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46572.log.gz 2024-08-17T02:27:29.191 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45948.log 2024-08-17T02:27:29.191 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42569.log.gz 2024-08-17T02:27:29.191 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45124.log 2024-08-17T02:27:29.191 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47998.log.gz 2024-08-17T02:27:29.192 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45822.log 2024-08-17T02:27:29.192 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45948.log.gz 2024-08-17T02:27:29.196 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46032.log 2024-08-17T02:27:29.196 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45124.log.gz 2024-08-17T02:27:29.196 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46242.log 2024-08-17T02:27:29.196 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45822.log.gz 2024-08-17T02:27:29.197 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43691.log 2024-08-17T02:27:29.197 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46032.log.gz 2024-08-17T02:27:29.197 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50631.log 2024-08-17T02:27:29.197 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46242.log.gz 2024-08-17T02:27:29.197 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42816.log 2024-08-17T02:27:29.197 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43691.log.gz 2024-08-17T02:27:29.197 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47046.log 2024-08-17T02:27:29.197 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50631.log.gz 2024-08-17T02:27:29.199 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph.audit.log: gzip 91.3% -- replaced with /var/log/ceph/ceph.log.gz -5 2024-08-17T02:27:29.199 INFO:teuthology.orchestra.run.smithi145.stderr: --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-17T02:27:29.199 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.3.42910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42910.log.gz 2024-08-17T02:27:29.199 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-17T02:27:29.199 INFO:teuthology.orchestra.run.smithi145.stderr: 93.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:27:29.199 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-17T02:27:29.200 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37242.log 2024-08-17T02:27:29.200 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-17T02:27:29.200 INFO:teuthology.orchestra.run.smithi145.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-17T02:27:29.200 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37202.log 2024-08-17T02:27:29.200 INFO:teuthology.orchestra.run.smithi145.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37242.log.gz 2024-08-17T02:27:29.200 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-17T02:27:29.200 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37202.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37202.log.gz 2024-08-17T02:27:29.200 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-17T02:27:29.200 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37282.log 2024-08-17T02:27:29.201 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-17T02:27:29.203 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45376.log 2024-08-17T02:27:29.203 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42816.log.gz 2024-08-17T02:27:29.203 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46740.log 2024-08-17T02:27:29.203 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47046.log.gz 2024-08-17T02:27:29.204 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43871.log 2024-08-17T02:27:29.204 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45376.log.gz 2024-08-17T02:27:29.204 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42568.log 2024-08-17T02:27:29.204 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46740.log.gz 2024-08-17T02:27:29.204 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44662.log 2024-08-17T02:27:29.204 INFO:teuthology.orchestra.run.smithi002.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43871.log.gz 2024-08-17T02:27:29.204 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41489.log 2024-08-17T02:27:29.204 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42568.log.gz 2024-08-17T02:27:29.205 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44998.log 2024-08-17T02:27:29.205 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44662.log.gz 2024-08-17T02:27:29.205 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40719.log 2024-08-17T02:27:29.205 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41489.log.gz 2024-08-17T02:27:29.205 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44998.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:27:29.205 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44998.log.gz 2024-08-17T02:27:29.209 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37162.log 2024-08-17T02:27:29.209 INFO:teuthology.orchestra.run.smithi145.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37282.log.gz 2024-08-17T02:27:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37071.log 2024-08-17T02:27:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37162.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37162.log.gz 2024-08-17T02:27:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37071.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37071.log.gz 2024-08-17T02:27:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42589.log 2024-08-17T02:27:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-17T02:27:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.1.42589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42589.log.gz 2024-08-17T02:27:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-17T02:27:29.212 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37322.log 2024-08-17T02:27:29.213 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37122.log 2024-08-17T02:27:29.214 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48294.log 2024-08-17T02:27:29.214 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40719.log.gz 2024-08-17T02:27:29.214 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49531.log 2024-08-17T02:27:29.214 INFO:teuthology.orchestra.run.smithi002.stderr: 84.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:27:29.214 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47956.log 2024-08-17T02:27:29.214 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48294.log.gz 2024-08-17T02:27:29.214 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40990.log 2024-08-17T02:27:29.215 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49531.log.gz 2024-08-17T02:27:29.215 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44914.log 2024-08-17T02:27:29.215 INFO:teuthology.orchestra.run.smithi002.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47956.log.gz 2024-08-17T02:27:29.215 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40990.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-17T02:27:29.215 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40990.log.gz 2024-08-17T02:27:29.215 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46614.log 2024-08-17T02:27:29.215 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44914.log.gz 2024-08-17T02:27:29.215 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42563.log 2024-08-17T02:27:29.215 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46158.log 2024-08-17T02:27:29.215 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46614.log.gz 2024-08-17T02:27:29.216 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42907.log 2024-08-17T02:27:29.216 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42563.log.gz 2024-08-17T02:27:29.216 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50151.log 2024-08-17T02:27:29.216 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46158.log.gz 2024-08-17T02:27:29.216 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42907.log: gzip -5 87.5% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.42907.log.gz /var/log/ceph/ceph-client.admin.44872.log 2024-08-17T02:27:29.216 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-08-17T02:27:29.217 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37322.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37322.log.gz 2024-08-17T02:27:29.219 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45502.log 2024-08-17T02:27:29.219 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50151.log.gz 2024-08-17T02:27:29.219 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49069.log 2024-08-17T02:27:29.219 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44872.log.gz 2024-08-17T02:27:29.219 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50529.log 2024-08-17T02:27:29.219 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45502.log.gz 2024-08-17T02:27:29.219 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49069.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49069.log.gz 2024-08-17T02:27:29.220 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44746.log 2024-08-17T02:27:29.220 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50529.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:27:29.220 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50529.log.gz 2024-08-17T02:27:29.220 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48816.log 2024-08-17T02:27:29.220 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44746.log.gz 2024-08-17T02:27:29.221 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37122.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37122.log.gz 2024-08-17T02:27:29.222 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49027.log 2024-08-17T02:27:29.222 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48816.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48816.log.gz 2024-08-17T02:27:29.222 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41142.log 2024-08-17T02:27:29.222 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:27:29.222 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49027.log: gzip 88.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.49027.log.gz --verbose 2024-08-17T02:27:29.222 INFO:teuthology.orchestra.run.smithi002.stderr: -- /var/log/ceph/ceph-client.admin.42908.log 2024-08-17T02:27:29.223 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42232.log 2024-08-17T02:27:29.223 INFO:teuthology.orchestra.run.smithi002.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41142.log.gz 2024-08-17T02:27:29.223 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47724.log 2024-08-17T02:27:29.224 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42908.log.gz 2024-08-17T02:27:29.224 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41899.log 2024-08-17T02:27:29.225 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42232.log.gz 2024-08-17T02:27:29.225 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47724.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47724.log.gz 2024-08-17T02:27:29.225 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44830.log 2024-08-17T02:27:29.226 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49321.log 2024-08-17T02:27:29.226 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41899.log.gz 2024-08-17T02:27:29.227 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41099.log 2024-08-17T02:27:29.227 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44830.log.gz 2024-08-17T02:27:29.228 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47088.log 2024-08-17T02:27:29.228 INFO:teuthology.orchestra.run.smithi002.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49321.log.gz 2024-08-17T02:27:29.229 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41099.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41099.log.gz 2024-08-17T02:27:29.229 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45990.log 2024-08-17T02:27:29.229 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47300.log 2024-08-17T02:27:29.230 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47088.log.gz 2024-08-17T02:27:29.230 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45990.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-17T02:27:29.230 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45990.log.gz 2024-08-17T02:27:29.231 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42565.log 2024-08-17T02:27:29.232 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47300.log.gz 2024-08-17T02:27:29.232 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48082.log 2024-08-17T02:27:29.233 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42570.log 2024-08-17T02:27:29.233 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42565.log.gz 2024-08-17T02:27:29.234 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50671.log 2024-08-17T02:27:29.234 INFO:teuthology.orchestra.run.smithi002.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48082.log.gz 2024-08-17T02:27:29.235 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42570.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42570.log.gz 2024-08-17T02:27:29.235 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43145.log 2024-08-17T02:27:29.236 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50671.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30679.log 2024-08-17T02:27:29.236 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50671.log.gz 2024-08-17T02:27:29.237 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43187.log 2024-08-17T02:27:29.237 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43145.log.gz 2024-08-17T02:27:29.238 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.tmp-client.admin.30679.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30679.log.gz 2024-08-17T02:27:29.238 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44704.log 2024-08-17T02:27:29.239 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43355.log 2024-08-17T02:27:29.239 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43187.log.gz 2024-08-17T02:27:29.240 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42905.log 2024-08-17T02:27:29.241 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44704.log.gz 2024-08-17T02:27:29.241 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43355.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43355.log.gz 2024-08-17T02:27:29.242 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42229.log 2024-08-17T02:27:29.242 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43733.log 2024-08-17T02:27:29.243 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42905.log.gz 2024-08-17T02:27:29.243 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42229.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42229.log.gz 2024-08-17T02:27:29.244 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48546.log 2024-08-17T02:27:29.244 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44576.log 2024-08-17T02:27:29.245 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48546.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.43733.log.gz 2024-08-17T02:27:29.246 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50445.log 2024-08-17T02:27:29.246 INFO:teuthology.orchestra.run.smithi002.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48546.log.gz 2024-08-17T02:27:29.251 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.2.44576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49941.log 2024-08-17T02:27:29.251 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.44576.log.gz 2024-08-17T02:27:29.251 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50445.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-17T02:27:29.252 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50445.log.gz 2024-08-17T02:27:29.252 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45250.log 2024-08-17T02:27:29.252 INFO:teuthology.orchestra.run.smithi002.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49941.log.gz 2024-08-17T02:27:29.252 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49195.log 2024-08-17T02:27:29.252 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45250.log: 92.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-17T02:27:29.252 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45250.log.gz 2024-08-17T02:27:29.252 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41193.log 2024-08-17T02:27:29.253 INFO:teuthology.orchestra.run.smithi145.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-17T02:27:29.254 INFO:teuthology.orchestra.run.smithi002.stderr:gzip/var/log/ceph/ceph-client.admin.49195.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50571.log 2024-08-17T02:27:29.254 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41193.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49195.log.gz 2024-08-17T02:27:29.255 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48040.log 2024-08-17T02:27:29.255 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41193.log.gz 2024-08-17T02:27:29.255 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48901.log 2024-08-17T02:27:29.255 INFO:teuthology.orchestra.run.smithi002.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50571.log.gz 2024-08-17T02:27:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48040.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48040.log.gz 2024-08-17T02:27:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41363.log 2024-08-17T02:27:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42234.log 2024-08-17T02:27:29.256 INFO:teuthology.orchestra.run.smithi002.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48901.log.gz 2024-08-17T02:27:29.257 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41363.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41363.log.gz 2024-08-17T02:27:29.257 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37130.log 2024-08-17T02:27:29.258 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46954.log 2024-08-17T02:27:29.258 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42234.log.gz 2024-08-17T02:27:29.259 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37130.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37130.log.gzgzip 2024-08-17T02:27:29.259 INFO:teuthology.orchestra.run.smithi002.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44788.log 2024-08-17T02:27:29.260 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48943.log 2024-08-17T02:27:29.261 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46954.log.gz 2024-08-17T02:27:29.261 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44788.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44788.log.gz 2024-08-17T02:27:29.261 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-17T02:27:29.262 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48943.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-17T02:27:29.262 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48943.log.gz 2024-08-17T02:27:29.263 INFO:teuthology.orchestra.run.smithi145.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-17T02:27:29.264 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47892.log 2024-08-17T02:27:29.265 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50713.log 2024-08-17T02:27:29.266 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47766.log 2024-08-17T02:27:29.266 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47892.log.gz 2024-08-17T02:27:29.267 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45166.log 2024-08-17T02:27:29.267 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50713.log.gz 2024-08-17T02:27:29.268 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50025.log 2024-08-17T02:27:29.269 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47766.log.gz 2024-08-17T02:27:29.269 INFO:teuthology.orchestra.run.smithi002.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-17T02:27:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46074.log 2024-08-17T02:27:29.270 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45166.log.gz 2024-08-17T02:27:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50025.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50025.log.gz 2024-08-17T02:27:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-17T02:27:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45460.log 2024-08-17T02:27:29.273 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46074.log: /var/log/ceph/ceph-osd.0.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46074.log.gz 2024-08-17T02:27:29.273 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45418.log 2024-08-17T02:27:29.274 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46782.log 2024-08-17T02:27:29.275 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45460.log.gz 2024-08-17T02:27:29.275 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41573.log 2024-08-17T02:27:29.276 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45418.log.gz 2024-08-17T02:27:29.277 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46364.log 2024-08-17T02:27:29.277 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46782.log.gz 2024-08-17T02:27:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48378.log 2024-08-17T02:27:29.278 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41573.log.gz 2024-08-17T02:27:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50361.log 2024-08-17T02:27:29.280 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46364.log.gz 2024-08-17T02:27:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47216.log 2024-08-17T02:27:29.281 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48378.log.gz 2024-08-17T02:27:29.282 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41531.log 2024-08-17T02:27:29.282 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50361.log.gz 2024-08-17T02:27:29.283 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42226.log 2024-08-17T02:27:29.283 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47216.log.gz 2024-08-17T02:27:29.285 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49773.log 2024-08-17T02:27:29.285 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41531.log.gz 2024-08-17T02:27:29.286 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46528.log 2024-08-17T02:27:29.286 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42226.log.gz 2024-08-17T02:27:29.287 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50319.log 2024-08-17T02:27:29.287 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49773.log.gz 2024-08-17T02:27:29.288 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41891.log 2024-08-17T02:27:29.288 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46528.log.gz 2024-08-17T02:27:29.290 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42223.log 2024-08-17T02:27:29.290 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50319.log.gz 2024-08-17T02:27:29.291 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49111.log 2024-08-17T02:27:29.291 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41891.log.gz 2024-08-17T02:27:29.292 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49899.log 2024-08-17T02:27:29.292 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42223.log.gz 2024-08-17T02:27:29.293 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41895.log 2024-08-17T02:27:29.293 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49111.log.gz 2024-08-17T02:27:29.294 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48672.log 2024-08-17T02:27:29.295 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49899.log.gz 2024-08-17T02:27:29.296 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43397.log 2024-08-17T02:27:29.296 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41895.log.gz 2024-08-17T02:27:29.297 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50109.log 2024-08-17T02:27:29.297 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48672.log.gz 2024-08-17T02:27:29.298 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41633.log 2024-08-17T02:27:29.298 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43397.log.gz 2024-08-17T02:27:29.299 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50109.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-17T02:27:29.300 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50109.log.gz 2024-08-17T02:27:29.301 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45780.log 2024-08-17T02:27:29.301 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41633.log.gz 2024-08-17T02:27:29.302 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42775.log 2024-08-17T02:27:29.303 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46824.log 2024-08-17T02:27:29.303 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45780.log.gz 2024-08-17T02:27:29.304 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42775.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42775.log.gz 2024-08-17T02:27:29.305 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46698.log 2024-08-17T02:27:29.306 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46824.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46824.log.gz -5 2024-08-17T02:27:29.306 INFO:teuthology.orchestra.run.smithi002.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44276.log 2024-08-17T02:27:29.307 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43565.log 2024-08-17T02:27:29.308 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46698.log.gz 2024-08-17T02:27:29.308 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44276.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44276.log.gz 2024-08-17T02:27:29.309 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49983.log 2024-08-17T02:27:29.310 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43481.log 2024-08-17T02:27:29.310 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43565.log.gz 2024-08-17T02:27:29.311 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42559.log 2024-08-17T02:27:29.312 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49983.log.gz 2024-08-17T02:27:29.313 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45738.log 2024-08-17T02:27:29.313 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43481.log.gz 2024-08-17T02:27:29.314 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42559.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42559.log.gz 2024-08-17T02:27:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45738.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45738.log.gz 2024-08-17T02:27:29.316 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40815.log 2024-08-17T02:27:29.317 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41050.log 2024-08-17T02:27:29.318 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48462.log 2024-08-17T02:27:29.318 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40815.log.gz 2024-08-17T02:27:29.319 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41050.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41050.log.gz 2024-08-17T02:27:29.320 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47258.log 2024-08-17T02:27:29.321 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48462.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48462.log.gz 2024-08-17T02:27:29.321 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50067.log 2024-08-17T02:27:29.322 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36745.log 2024-08-17T02:27:29.323 INFO:teuthology.orchestra.run.smithi002.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47258.log.gz 2024-08-17T02:27:29.324 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50067.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50067.log.gz 2024-08-17T02:27:29.325 INFO:teuthology.orchestra.run.smithi002.stderr:gzip/var/log/ceph/ceph-client.admin.36745.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45208.log 2024-08-17T02:27:29.325 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36745.log.gz 2024-08-17T02:27:29.326 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43271.log 2024-08-17T02:27:29.327 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46866.log 2024-08-17T02:27:29.328 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45208.log.gz 2024-08-17T02:27:29.329 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43271.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43271.log.gz 2024-08-17T02:27:29.329 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41717.log 2024-08-17T02:27:29.330 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46866.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46866.log.gz 2024-08-17T02:27:29.331 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47679.log 2024-08-17T02:27:29.332 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42233.log 2024-08-17T02:27:29.332 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41717.log.gz 2024-08-17T02:27:29.333 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.47679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47679.log.gz 2024-08-17T02:27:29.334 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41405.log 2024-08-17T02:27:29.334 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42233.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42233.log.gz 2024-08-17T02:27:29.335 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41675.log 2024-08-17T02:27:29.336 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43229.log 2024-08-17T02:27:29.337 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41405.log.gz 2024-08-17T02:27:29.338 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41675.log: gzip -5 --verbose -- 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41675.log.gz 2024-08-17T02:27:29.338 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.0.44212.log 2024-08-17T02:27:29.339 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43229.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43229.log.gz 2024-08-17T02:27:29.339 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49689.log 2024-08-17T02:27:29.340 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.44212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44212.log.gz 2024-08-17T02:27:29.341 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40941.log 2024-08-17T02:27:29.342 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49489.log 2024-08-17T02:27:29.342 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49689.log.gz 2024-08-17T02:27:29.343 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45864.log 2024-08-17T02:27:29.343 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40941.log.gz 2024-08-17T02:27:29.345 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49815.log 2024-08-17T02:27:29.345 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49489.log.gz 2024-08-17T02:27:29.346 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46116.log 2024-08-17T02:27:29.346 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45864.log.gz 2024-08-17T02:27:29.347 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37014.log 2024-08-17T02:27:29.347 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49815.log.gz 2024-08-17T02:27:29.349 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45906.log 2024-08-17T02:27:29.349 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46116.log.gz 2024-08-17T02:27:29.349 INFO:teuthology.orchestra.run.smithi145.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-17T02:27:29.350 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42466.log 2024-08-17T02:27:29.350 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37014.log.gz 2024-08-17T02:27:29.350 INFO:teuthology.orchestra.run.smithi145.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-17T02:27:29.351 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47850.log 2024-08-17T02:27:29.351 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45906.log.gz 2024-08-17T02:27:29.352 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42571.log 2024-08-17T02:27:29.353 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42466.log.gz 2024-08-17T02:27:29.354 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47850.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47850.log.gz 2024-08-17T02:27:29.355 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47492.log 2024-08-17T02:27:29.356 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42571.log.gz 2024-08-17T02:27:29.356 INFO:teuthology.orchestra.run.smithi002.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-17T02:27:29.356 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45334.log 2024-08-17T02:27:29.357 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42901.log 2024-08-17T02:27:29.358 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47492.log: /var/log/ceph/ceph-client.admin.45334.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47492.log.gz 2024-08-17T02:27:29.358 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47426.log 88.4% 2024-08-17T02:27:29.358 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45334.log.gz 2024-08-17T02:27:29.360 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48504.log 2024-08-17T02:27:29.360 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42901.log.gz 2024-08-17T02:27:29.361 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49447.log 2024-08-17T02:27:29.361 INFO:teuthology.orchestra.run.smithi002.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.47426.log.gz 2024-08-17T02:27:29.362 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43103.log 2024-08-17T02:27:29.362 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48504.log.gz 2024-08-17T02:27:29.363 INFO:teuthology.orchestra.run.smithi145.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-17T02:27:29.363 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43649.log 2024-08-17T02:27:29.364 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49447.log.gz 2024-08-17T02:27:29.364 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50487.log 88.4% 2024-08-17T02:27:29.364 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43103.log.gz 2024-08-17T02:27:29.365 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41896.log 2024-08-17T02:27:29.365 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43649.log.gz 2024-08-17T02:27:29.366 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50487.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50487.log.gz 2024-08-17T02:27:29.367 INFO:teuthology.orchestra.run.smithi145.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-17T02:27:29.367 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47132.log 2024-08-17T02:27:29.368 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46486.log 2024-08-17T02:27:29.369 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41896.log.gz 2024-08-17T02:27:29.370 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50193.log 2024-08-17T02:27:29.370 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47132.log.gz 2024-08-17T02:27:29.370 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50235.log 2024-08-17T02:27:29.371 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46486.log.gz 2024-08-17T02:27:29.372 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41237.log 2024-08-17T02:27:29.372 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50193.log.gz 2024-08-17T02:27:29.373 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48985.log 2024-08-17T02:27:29.373 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50235.log.gz 2024-08-17T02:27:29.374 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44956.log 2024-08-17T02:27:29.375 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41237.log.gz 2024-08-17T02:27:29.375 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48985.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41898.log 2024-08-17T02:27:29.376 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48985.log.gz 2024-08-17T02:27:29.376 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48756.log 2024-08-17T02:27:29.377 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44956.log.gz 2024-08-17T02:27:29.377 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46444.log 2024-08-17T02:27:29.378 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41898.log.gz 2024-08-17T02:27:29.379 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48756.log: gzip -5 88.1% --verbose -- replaced with /var/log/ceph/ceph-client.admin.48756.log.gz 2024-08-17T02:27:29.379 INFO:teuthology.orchestra.run.smithi002.stderr: -- /var/log/ceph/ceph-client.admin.41881.log 2024-08-17T02:27:29.380 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43313.log 2024-08-17T02:27:29.381 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46444.log.gz 2024-08-17T02:27:29.381 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41881.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41881.log.gz 2024-08-17T02:27:29.381 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49279.log 2024-08-17T02:27:29.382 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48859.log 2024-08-17T02:27:29.383 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43313.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43313.log.gz 2024-08-17T02:27:29.383 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49279.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49279.log.gz 2024-08-17T02:27:29.383 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47174.log 2024-08-17T02:27:29.384 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43523.log 2024-08-17T02:27:29.385 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48859.log.gz 2024-08-17T02:27:29.386 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47004.log 2024-08-17T02:27:29.386 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47174.log.gz 2024-08-17T02:27:29.387 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43607.log 2024-08-17T02:27:29.387 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43523.log.gz 2024-08-17T02:27:29.388 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43439.log 2024-08-17T02:27:29.389 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47004.log.gz 2024-08-17T02:27:29.389 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43607.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43607.log.gz 2024-08-17T02:27:29.389 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42219.log 2024-08-17T02:27:29.390 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45040.log 2024-08-17T02:27:29.391 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43439.log.gz 2024-08-17T02:27:29.391 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42219.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42219.log.gz 2024-08-17T02:27:29.392 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41321.log 2024-08-17T02:27:29.392 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49237.log 2024-08-17T02:27:29.393 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45040.log: /var/log/ceph/ceph-client.admin.41321.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45040.log.gz 2024-08-17T02:27:29.393 INFO:teuthology.orchestra.run.smithi002.stderr: 89.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.41321.log.gz 2024-08-17T02:27:29.394 INFO:teuthology.orchestra.run.smithi002.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42904.log 2024-08-17T02:27:29.394 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49237.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-17T02:27:29.395 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49237.log.gz 2024-08-17T02:27:29.395 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48252.log 2024-08-17T02:27:29.396 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42904.log.gz 2024-08-17T02:27:29.396 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46910.log 2024-08-17T02:27:29.398 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48252.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48336.log 2024-08-17T02:27:29.398 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48252.log.gz 2024-08-17T02:27:29.399 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48420.log 2024-08-17T02:27:29.399 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46910.log.gz 2024-08-17T02:27:29.400 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48336.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48336.log.gz 2024-08-17T02:27:29.401 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41447.log 2024-08-17T02:27:29.402 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48420.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48420.log.gz 2024-08-17T02:27:29.402 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40896.log 2024-08-17T02:27:29.403 INFO:teuthology.orchestra.run.smithi145.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-17T02:27:29.403 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45082.log 2024-08-17T02:27:29.404 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41447.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41447.log.gz 2024-08-17T02:27:29.405 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41892.log 2024-08-17T02:27:29.405 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40896.log.gz 2024-08-17T02:27:29.405 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45082.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45082.log.gz 2024-08-17T02:27:29.406 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41887.log 2024-08-17T02:27:29.407 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49153.log 2024-08-17T02:27:29.407 INFO:teuthology.orchestra.run.smithi002.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41892.log.gz 2024-08-17T02:27:29.408 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48630.log 2024-08-17T02:27:29.408 INFO:teuthology.orchestra.run.smithi002.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41887.log.gz 2024-08-17T02:27:29.409 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49153.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49153.log.gz 2024-08-17T02:27:29.410 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45292.log 2024-08-17T02:27:29.411 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48714.log 2024-08-17T02:27:29.411 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48630.log.gz 2024-08-17T02:27:29.413 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45292.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45292.log.gz 2024-08-17T02:27:29.413 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46284.log 2024-08-17T02:27:29.413 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48714.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48714.log.gz 2024-08-17T02:27:29.414 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50403.log 2024-08-17T02:27:29.415 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49405.log 2024-08-17T02:27:29.416 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46284.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46284.log.gz 2024-08-17T02:27:29.416 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49731.log 2024-08-17T02:27:29.417 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50403.log.gz 2024-08-17T02:27:29.417 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49405.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49405.log.gz 2024-08-17T02:27:29.418 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47384.log 2024-08-17T02:27:29.419 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44620.log 2024-08-17T02:27:29.419 INFO:teuthology.orchestra.run.smithi002.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49731.log.gz 2024-08-17T02:27:29.420 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47384.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47384.log.gz 2024-08-17T02:27:29.420 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49363.log 2024-08-17T02:27:29.422 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42235.log 2024-08-17T02:27:29.422 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44620.log.gz 2024-08-17T02:27:29.423 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49363.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49363.log.gz 2024-08-17T02:27:29.423 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42917.log 2024-08-17T02:27:29.424 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42235.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42235.log.gz 2024-08-17T02:27:29.424 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50277.log 2024-08-17T02:27:29.426 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48588.log 2024-08-17T02:27:29.426 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42917.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42917.log.gz 2024-08-17T02:27:29.427 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46200.log 2024-08-17T02:27:29.427 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50277.log.gz 2024-08-17T02:27:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47808.log 2024-08-17T02:27:29.429 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48588.log.gz 2024-08-17T02:27:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46200.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46200.log.gz 2024-08-17T02:27:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45604.log 2024-08-17T02:27:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47808.log: 87.5%/var/log/ceph/ceph-client.admin.45604.log: -- replaced with /var/log/ceph/ceph-client.admin.47808.log.gz 2024-08-17T02:27:29.432 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45604.log.gz 2024-08-17T02:27:29.437 INFO:teuthology.orchestra.run.smithi145.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-17T02:27:29.440 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-08-17T02:27:29.441 INFO:teuthology.orchestra.run.smithi145.stderr:real 0m0.276s 2024-08-17T02:27:29.441 INFO:teuthology.orchestra.run.smithi145.stderr:user 0m1.094s 2024-08-17T02:27:29.441 INFO:teuthology.orchestra.run.smithi145.stderr:sys 0m0.188s 2024-08-17T02:27:29.442 INFO:teuthology.orchestra.run.smithi002.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-17T02:27:29.466 INFO:teuthology.orchestra.run.smithi002.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-17T02:27:29.471 INFO:teuthology.orchestra.run.smithi002.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-17T02:27:29.498 INFO:teuthology.orchestra.run.smithi002.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-17T02:27:29.583 INFO:teuthology.orchestra.run.smithi002.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-17T02:27:29.586 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-08-17T02:27:29.586 INFO:teuthology.orchestra.run.smithi002.stderr:real 0m0.426s 2024-08-17T02:27:29.586 INFO:teuthology.orchestra.run.smithi002.stderr:user 0m1.139s 2024-08-17T02:27:29.587 INFO:teuthology.orchestra.run.smithi002.stderr:sys 0m0.639s 2024-08-17T02:27:29.588 INFO:tasks.ceph:Archiving logs... 2024-08-17T02:27:29.588 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858261/remote/smithi002/log 2024-08-17T02:27:29.589 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:27:29.934 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858261/remote/smithi145/log 2024-08-17T02:27:29.935 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:27:30.136 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-17T02:27:30.158 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-17T02:27:30.158 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:27:30.162 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:27:30.265 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-17T02:27:30.273 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-17T02:27:30.274 DEBUG:teuthology.orchestra.run.smithi002:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:27:30.278 DEBUG:teuthology.orchestra.run.smithi145:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:27:30.308 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:27:30.311 INFO:teuthology.orchestra.run.smithi145.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:27:30.316 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:27:30.316 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-08-17T02:27:30.316 INFO:teuthology.orchestra.run.smithi002.stdout:^* hv01.front.sepia.ceph.com 3 6 377 3 -22us[ -11us] +/- 57ms 2024-08-17T02:27:30.316 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 3 -67us[ -56us] +/- 59ms 2024-08-17T02:27:30.316 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 +196us[ +207us] +/- 90ms 2024-08-17T02:27:30.316 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:27:30.318 INFO:teuthology.orchestra.run.smithi145.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:27:30.318 INFO:teuthology.orchestra.run.smithi145.stdout:=============================================================================== 2024-08-17T02:27:30.318 INFO:teuthology.orchestra.run.smithi145.stdout:^* hv01.front.sepia.ceph.com 3 6 377 3 -1582ns[ +14us] +/- 57ms 2024-08-17T02:27:30.318 INFO:teuthology.orchestra.run.smithi145.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 4 -67us[ -51us] +/- 59ms 2024-08-17T02:27:30.319 INFO:teuthology.orchestra.run.smithi145.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 +219us[ +235us] +/- 90ms 2024-08-17T02:27:30.319 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:27:30.320 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-17T02:27:30.329 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-17T02:27:30.329 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-17T02:27:30.338 DEBUG:teuthology.orchestra.run.smithi002:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:27:30.478 DEBUG:teuthology.orchestra.run.smithi145:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:27:30.592 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:27:30.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:27:30.653 DEBUG:teuthology.orchestra.run.smithi145:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:27:30.712 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:27:30.713 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-17T02:27:30.722 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-17T02:27:30.730 INFO:teuthology.task.internal:Duration was 739.346583 seconds 2024-08-17T02:27:30.730 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-17T02:27:30.739 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-17T02:27:30.740 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:27:30.746 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:27:30.828 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:27:30.833 INFO:teuthology.orchestra.run.smithi145.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:27:31.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-08-17T02:27:31.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-08-17T02:27:31.243 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-17T02:27:31.244 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:27:31.244 DEBUG:teuthology.orchestra.run.smithi002:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:27:31.294 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi145.front.sepia.ceph.com 2024-08-17T02:27:31.295 DEBUG:teuthology.orchestra.run.smithi145:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:27:31.345 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-17T02:27:31.345 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:27:31.349 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:27:31.409 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-17T02:27:31.409 DEBUG:teuthology.orchestra.run.smithi002:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:27:31.413 DEBUG:teuthology.orchestra.run.smithi145:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:27:31.556 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-17T02:27:31.568 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-17T02:27:31.568 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:27:31.624 DEBUG:teuthology.orchestra.run.smithi145:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:27:31.681 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-17T02:27:31.690 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:27:31.694 DEBUG:teuthology.orchestra.run.smithi145:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:27:31.761 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = core 2024-08-17T02:27:31.766 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = core 2024-08-17T02:27:31.795 DEBUG:teuthology.orchestra.run.smithi002:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:27:31.828 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:27:31.829 DEBUG:teuthology.orchestra.run.smithi145:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:27:31.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:27:31.862 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-17T02:27:31.871 INFO:teuthology.task.internal:Transferring archived files... 2024-08-17T02:27:31.872 DEBUG:teuthology.misc:Transferring archived files from smithi002:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858261/remote/smithi002 2024-08-17T02:27:31.872 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:27:31.936 DEBUG:teuthology.misc:Transferring archived files from smithi145:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858261/remote/smithi145 2024-08-17T02:27:31.936 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:27:32.000 INFO:teuthology.task.internal:Removing archive directory... 2024-08-17T02:27:32.000 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:27:32.005 DEBUG:teuthology.orchestra.run.smithi145:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:27:32.039 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-17T02:27:32.051 INFO:teuthology.task.internal:Not uploading archives. 2024-08-17T02:27:32.051 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-17T02:27:32.060 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-17T02:27:32.060 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:27:32.080 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:27:32.111 INFO:teuthology.orchestra.run.smithi002.stdout: 394018 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:27 /home/ubuntu/cephtest 2024-08-17T02:27:32.115 INFO:teuthology.orchestra.run.smithi145.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:27 /home/ubuntu/cephtest 2024-08-17T02:27:32.117 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-17T02:27:32.128 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-17T02:27:32.150 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 client.1-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} duration: 739.3465828895569 failure_reason: 'Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=95ab7280fd344fbab551a358ad68736b status: fail success: false 2024-08-17T02:27:32.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:27:32.233 INFO:teuthology.run:FAIL